Nov 14 00:40:37 user nova-compute[74850]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74850) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 00:40:37 user nova-compute[74850]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74850) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 00:40:37 user nova-compute[74850]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74850) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 00:40:37 user nova-compute[74850]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 14 00:40:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:40:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.021s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:40:38 user nova-compute[74850]: INFO nova.virt.driver [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 14 00:40:38 user nova-compute[74850]: INFO nova.compute.provider_config [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] Acquiring lock "singleton_lock" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] Acquired lock "singleton_lock" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] Releasing lock "singleton_lock" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] Full set of CONF: {{(pid=74850) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] ******************************************************************************** {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] Configuration options gathered from: {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] ================================================================================ {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] allow_resize_to_same_host      = True {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] arq_binding_timeout            = 300 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] backdoor_port                  = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] backdoor_socket                = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] block_device_allocate_retries  = 300 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] block_device_allocate_retries_interval = 5 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cert                           = self.pem {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] compute_monitors               = [] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] config_dir                     = [] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] config_drive_format            = iso9660 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] config_source                  = [] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] console_host                   = user {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] control_exchange               = nova {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cpu_allocation_ratio           = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] daemon                         = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] debug                          = True {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] default_access_ip_network_name = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] default_availability_zone      = nova {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] default_ephemeral_format       = ext4 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] default_green_pool_size        = 1000 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] default_schedule_zone          = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] disk_allocation_ratio          = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] enable_new_services            = True {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] enabled_apis                   = ['osapi_compute'] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] enabled_ssl_apis               = [] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] flat_injected                  = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] force_config_drive             = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] force_raw_images               = True {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] graceful_shutdown_timeout      = 5 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] heal_instance_info_cache_interval = 60 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] host                           = user {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] instance_build_timeout         = 0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] instance_delete_interval       = 300 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] instance_format                = [instance: %(uuid)s]  {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] instance_name_template         = instance-%08x {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] instance_usage_audit           = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] instance_usage_audit_period    = month {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] internal_service_availability_zone = internal {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] key                            = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] live_migration_retry_count     = 30 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] log_config_append              = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] log_dir                        = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] log_file                       = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] log_options                    = True {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] log_rotate_interval            = 1 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] log_rotate_interval_type       = days {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] log_rotation_type              = none {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] long_rpc_timeout               = 1800 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] max_concurrent_builds          = 10 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] max_concurrent_live_migrations = 1 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] max_concurrent_snapshots       = 5 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] max_local_block_devices        = 3 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] max_logfile_count              = 30 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] max_logfile_size_mb            = 200 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] maximum_instance_delete_attempts = 5 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] metadata_listen                = 0.0.0.0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] metadata_listen_port           = 8775 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] metadata_workers               = 3 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] migrate_max_retries            = -1 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] mkisofs_cmd                    = genisoimage {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] my_ip                          = 10.0.0.210 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] network_allocate_retries       = 0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] osapi_compute_listen_port      = 8774 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] osapi_compute_unique_server_name_scope =  {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] osapi_compute_workers          = 3 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] password_length                = 12 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] periodic_enable                = True {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] periodic_fuzzy_delay           = 60 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] pointer_model                  = ps2mouse {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] preallocate_images             = none {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] publish_errors                 = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] pybasedir                      = /opt/stack/nova {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] ram_allocation_ratio           = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] rate_limit_burst               = 0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] rate_limit_except_level        = CRITICAL {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] rate_limit_interval            = 0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] reboot_timeout                 = 0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] reclaim_instance_interval      = 0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] record                         = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] reimage_timeout_per_gb         = 60 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] report_interval                = 120 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] rescue_timeout                 = 0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] reserved_host_cpus             = 0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] reserved_host_disk_mb          = 0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] reserved_host_memory_mb        = 512 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] reserved_huge_pages            = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] resize_confirm_window          = 0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] resize_fs_using_block_device   = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] resume_guests_state_on_host_boot = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] rpc_response_timeout           = 60 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] run_external_periodic_tasks    = True {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] running_deleted_instance_action = reap {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] running_deleted_instance_poll_interval = 1800 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] running_deleted_instance_timeout = 0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] scheduler_instance_sync_interval = 120 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] service_down_time              = 720 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] servicegroup_driver            = db {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] shelved_offload_time           = 0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] shelved_poll_interval          = 3600 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] shutdown_timeout               = 0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] source_is_ipv6                 = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] ssl_only                       = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] state_path                     = /opt/stack/data/nova {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] sync_power_state_interval      = 600 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] sync_power_state_pool_size     = 1000 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] syslog_log_facility            = LOG_USER {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] tempdir                        = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] timeout_nbd                    = 10 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] transport_url                  = **** {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] update_resources_interval      = 0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] use_cow_images                 = True {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] use_eventlog                   = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] use_journal                    = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] use_json                       = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] use_rootwrap_daemon            = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] use_stderr                     = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] use_syslog                     = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vcpu_pin_set                   = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vif_plugging_is_fatal          = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vif_plugging_timeout           = 0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] virt_mkfs                      = [] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] volume_usage_poll_interval     = 0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] watch_log_file                 = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] web                            = /usr/share/spice-html5 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_concurrency.disable_process_locking = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api.auth_strategy              = keystone {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api.compute_link_prefix        = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api.dhcp_domain                = novalocal {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api.enable_instance_password   = True {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api.glance_link_prefix         = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api.instance_list_per_project_cells = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api.list_records_by_skipping_down_cells = True {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api.local_metadata_per_cell    = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api.max_limit                  = 1000 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api.metadata_cache_expiration  = 15 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api.neutron_default_tenant_id  = default {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api.use_forwarded_for          = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api.use_neutron_default_nets   = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api.vendordata_dynamic_targets = [] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api.vendordata_jsonfile_path   = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cache.backend                  = dogpile.cache.memcached {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cache.backend_argument         = **** {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cache.config_prefix            = cache.oslo {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cache.dead_timeout             = 60.0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cache.debug_cache_backend      = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cache.enable_retry_client      = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cache.enable_socket_keepalive  = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cache.enabled                  = True {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cache.expiration_time          = 600 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cache.hashclient_retry_attempts = 2 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cache.memcache_dead_retry      = 300 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cache.memcache_password        =  {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cache.memcache_pool_maxsize    = 10 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cache.memcache_sasl_enabled    = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cache.memcache_username        =  {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cache.proxies                  = [] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cache.retry_attempts           = 2 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cache.retry_delay              = 0.0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cache.socket_keepalive_count   = 1 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cache.socket_keepalive_idle    = 1 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cache.socket_keepalive_interval = 1 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cache.tls_allowed_ciphers      = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cache.tls_cafile               = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cache.tls_certfile             = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cache.tls_enabled              = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cache.tls_keyfile              = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cinder.auth_section            = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cinder.auth_type               = password {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cinder.cafile                  = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cinder.certfile                = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cinder.collect_timing          = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cinder.cross_az_attach         = True {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cinder.debug                   = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cinder.endpoint_template       = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cinder.http_retries            = 3 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cinder.insecure                = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cinder.keyfile                 = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cinder.os_region_name          = RegionOne {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cinder.split_loggers           = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cinder.timeout                 = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] compute.cpu_dedicated_set      = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] compute.cpu_shared_set         = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] compute.image_type_exclude_list = [] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] compute.max_concurrent_disk_ops = 0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] compute.max_disk_devices_to_attach = -1 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] compute.resource_provider_association_refresh = 300 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] compute.shutdown_retry_interval = 10 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] conductor.workers              = 3 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] console.allowed_origins        = [] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] console.ssl_ciphers            = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] console.ssl_minimum_version    = default {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] consoleauth.token_ttl          = 600 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cyborg.cafile                  = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cyborg.certfile                = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cyborg.collect_timing          = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cyborg.connect_retries         = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cyborg.connect_retry_delay     = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cyborg.endpoint_override       = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cyborg.insecure                = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cyborg.keyfile                 = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cyborg.max_version             = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cyborg.min_version             = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cyborg.region_name             = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cyborg.service_name            = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cyborg.service_type            = accelerator {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cyborg.split_loggers           = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cyborg.status_code_retries     = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cyborg.status_code_retry_delay = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cyborg.timeout                 = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] cyborg.version                 = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] database.backend               = sqlalchemy {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] database.connection            = **** {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] database.connection_debug      = 0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] database.connection_parameters =  {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] database.connection_recycle_time = 3600 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] database.connection_trace      = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] database.db_inc_retry_interval = True {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] database.db_max_retries        = 20 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] database.db_max_retry_interval = 10 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] database.db_retry_interval     = 1 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] database.max_overflow          = 50 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] database.max_pool_size         = 5 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] database.max_retries           = 10 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] database.mysql_wsrep_sync_wait = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] database.pool_timeout          = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] database.retry_interval        = 10 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] database.slave_connection      = **** {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] database.sqlite_synchronous    = True {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api_database.backend           = sqlalchemy {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api_database.connection        = **** {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api_database.connection_debug  = 0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api_database.connection_parameters =  {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api_database.connection_recycle_time = 3600 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api_database.connection_trace  = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api_database.db_inc_retry_interval = True {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api_database.db_max_retries    = 20 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api_database.db_max_retry_interval = 10 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api_database.db_retry_interval = 1 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api_database.max_overflow      = 50 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api_database.max_pool_size     = 5 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api_database.max_retries       = 10 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api_database.pool_timeout      = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api_database.retry_interval    = 10 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api_database.slave_connection  = **** {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] api_database.sqlite_synchronous = True {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] devices.enabled_mdev_types     = [] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] ephemeral_storage_encryption.enabled = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] glance.api_servers             = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] glance.cafile                  = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] glance.certfile                = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] glance.collect_timing          = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] glance.connect_retries         = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] glance.connect_retry_delay     = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] glance.debug                   = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] glance.default_trusted_certificate_ids = [] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] glance.enable_certificate_validation = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] glance.enable_rbd_download     = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] glance.endpoint_override       = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] glance.insecure                = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] glance.keyfile                 = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] glance.max_version             = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] glance.min_version             = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] glance.num_retries             = 3 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] glance.rbd_ceph_conf           =  {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] glance.rbd_connect_timeout     = 5 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] glance.rbd_pool                =  {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] glance.rbd_user                =  {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] glance.region_name             = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] glance.service_name            = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] glance.service_type            = image {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] glance.split_loggers           = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] glance.status_code_retries     = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] glance.status_code_retry_delay = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] glance.timeout                 = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] glance.verify_glance_signatures = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] glance.version                 = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] guestfs.debug                  = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] hyperv.config_drive_cdrom      = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] hyperv.config_drive_inject_password = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] hyperv.enable_instance_metrics_collection = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] hyperv.enable_remotefx         = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] hyperv.instances_path_share    =  {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] hyperv.iscsi_initiator_list    = [] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] hyperv.limit_cpu_features      = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] hyperv.power_state_check_timeframe = 60 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] hyperv.use_multipath_io        = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] hyperv.volume_attach_retry_count = 10 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] hyperv.vswitch_name            = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] mks.enabled                    = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] image_cache.manager_interval   = 2400 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] image_cache.precache_concurrency = 1 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] image_cache.remove_unused_base_images = True {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] image_cache.subdirectory_name  = _base {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] ironic.api_max_retries         = 60 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] ironic.api_retry_interval      = 2 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] ironic.auth_section            = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] ironic.auth_type               = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] ironic.cafile                  = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] ironic.certfile                = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] ironic.collect_timing          = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] ironic.conductor_group         = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] ironic.connect_retries         = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] ironic.connect_retry_delay     = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] ironic.endpoint_override       = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] ironic.insecure                = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] ironic.keyfile                 = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] ironic.max_version             = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] ironic.min_version             = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] ironic.peer_list               = [] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] ironic.region_name             = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] ironic.serial_console_state_timeout = 10 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] ironic.service_name            = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] ironic.service_type            = baremetal {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] ironic.split_loggers           = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] ironic.status_code_retries     = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] ironic.status_code_retry_delay = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] ironic.timeout                 = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] ironic.version                 = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] key_manager.fixed_key          = **** {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] barbican.barbican_api_version  = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] barbican.barbican_endpoint     = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] barbican.barbican_endpoint_type = public {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] barbican.barbican_region_name  = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] barbican.cafile                = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] barbican.certfile              = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] barbican.collect_timing        = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] barbican.insecure              = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] barbican.keyfile               = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] barbican.number_of_retries     = 60 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] barbican.retry_delay           = 1 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] barbican.send_service_user_token = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] barbican.split_loggers         = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] barbican.timeout               = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] barbican.verify_ssl            = True {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] barbican.verify_ssl_path       = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] barbican_service_user.auth_section = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] barbican_service_user.auth_type = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] barbican_service_user.cafile   = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] barbican_service_user.certfile = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] barbican_service_user.collect_timing = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] barbican_service_user.insecure = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] barbican_service_user.keyfile  = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] barbican_service_user.split_loggers = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] barbican_service_user.timeout  = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vault.approle_role_id          = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vault.approle_secret_id        = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vault.cafile                   = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vault.certfile                 = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vault.collect_timing           = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vault.insecure                 = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vault.keyfile                  = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vault.kv_mountpoint            = secret {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vault.kv_path                  = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vault.kv_version               = 2 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vault.namespace                = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vault.root_token_id            = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vault.split_loggers            = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vault.ssl_ca_crt_file          = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vault.timeout                  = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vault.use_ssl                  = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] keystone.auth_section          = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] keystone.auth_type             = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] keystone.cafile                = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] keystone.certfile              = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] keystone.collect_timing        = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] keystone.connect_retries       = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] keystone.connect_retry_delay   = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] keystone.endpoint_override     = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] keystone.insecure              = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] keystone.keyfile               = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] keystone.max_version           = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] keystone.min_version           = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] keystone.region_name           = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] keystone.service_name          = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] keystone.service_type          = identity {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] keystone.split_loggers         = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] keystone.status_code_retries   = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] keystone.status_code_retry_delay = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] keystone.timeout               = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] keystone.version               = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.connection_uri         =  {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.cpu_mode               = custom {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: WARNING oslo_config.cfg [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.cpu_power_governor_high = performance {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.cpu_power_governor_low = powersave {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.cpu_power_management   = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.device_detach_attempts = 8 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.device_detach_timeout  = 20 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.disk_cachemodes        = [] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.disk_prefix            = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.enabled_perf_events    = [] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.file_backed_memory     = 0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.gid_maps               = [] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.hw_disk_discard        = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.hw_machine_type        = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.images_rbd_glance_store_name =  {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.images_rbd_pool        = rbd {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.images_type            = default {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.images_volume_group    = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.inject_key             = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.inject_partition       = -2 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.inject_password        = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.iscsi_iface            = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.iser_use_multipath     = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.live_migration_bandwidth = 0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.live_migration_downtime = 500 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.live_migration_inbound_addr = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.live_migration_permit_post_copy = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.live_migration_scheme  = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.live_migration_timeout_action = abort {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.live_migration_tunnelled = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: WARNING oslo_config.cfg [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 14 00:40:38 user nova-compute[74850]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 14 00:40:38 user nova-compute[74850]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 14 00:40:38 user nova-compute[74850]: and ``live_migration_inbound_addr`` respectively.
Nov 14 00:40:38 user nova-compute[74850]: ).  Its value may be silently ignored in the future.
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.live_migration_with_native_tls = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.max_queues             = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.nfs_mount_options      = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.num_memory_encrypted_guests = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.num_pcie_ports         = 0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.pmem_namespaces        = [] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.quobyte_client_cfg     = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.rbd_secret_uuid        = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.rbd_user               = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.remote_filesystem_transport = ssh {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.rescue_image_id        = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.rescue_kernel_id       = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.rescue_ramdisk_id      = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.rx_queue_size          = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.smbfs_mount_options    =  {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.snapshot_compression   = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.snapshot_image_format  = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.sparse_logical_volumes = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.swtpm_enabled          = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.swtpm_group            = tss {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.swtpm_user             = tss {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.sysinfo_serial         = unique {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.tb_cache_size          = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.tx_queue_size          = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.uid_maps               = [] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.use_virtio_for_bridges = True {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.virt_type              = kvm {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.volume_clear           = zero {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.volume_clear_size      = 0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.volume_use_multipath   = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.vzstorage_cache_path   = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.vzstorage_mount_user   = stack {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] neutron.auth_section           = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] neutron.auth_type              = password {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] neutron.cafile                 = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] neutron.certfile               = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] neutron.collect_timing         = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] neutron.connect_retries        = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] neutron.connect_retry_delay    = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] neutron.default_floating_pool  = public {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] neutron.endpoint_override      = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] neutron.extension_sync_interval = 600 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] neutron.http_retries           = 3 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] neutron.insecure               = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] neutron.keyfile                = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] neutron.max_version            = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] neutron.min_version            = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] neutron.ovs_bridge             = br-int {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] neutron.physnets               = [] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] neutron.region_name            = RegionOne {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] neutron.service_metadata_proxy = True {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] neutron.service_name           = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] neutron.service_type           = network {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] neutron.split_loggers          = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] neutron.status_code_retries    = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] neutron.status_code_retry_delay = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] neutron.timeout                = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] neutron.version                = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] notifications.bdms_in_notifications = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] notifications.default_level    = INFO {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] notifications.notification_format = unversioned {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] notifications.notify_on_state_change = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] pci.alias                      = [] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] pci.device_spec                = [] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] pci.report_in_placement        = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] placement.auth_section         = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] placement.auth_type            = password {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] placement.cafile               = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] placement.certfile             = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] placement.collect_timing       = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] placement.connect_retries      = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] placement.connect_retry_delay  = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] placement.default_domain_id    = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] placement.default_domain_name  = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] placement.domain_id            = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] placement.domain_name          = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] placement.endpoint_override    = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] placement.insecure             = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] placement.keyfile              = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] placement.max_version          = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] placement.min_version          = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] placement.password             = **** {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] placement.project_domain_id    = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] placement.project_domain_name  = Default {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] placement.project_id           = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] placement.project_name         = service {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] placement.region_name          = RegionOne {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] placement.service_name         = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] placement.service_type         = placement {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] placement.split_loggers        = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] placement.status_code_retries  = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] placement.status_code_retry_delay = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] placement.system_scope         = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] placement.timeout              = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] placement.trust_id             = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] placement.user_domain_id       = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] placement.user_domain_name     = Default {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] placement.user_id              = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] placement.username             = placement {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] placement.version              = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] quota.cores                    = 20 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] quota.count_usage_from_placement = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] quota.injected_file_content_bytes = 10240 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] quota.injected_file_path_length = 255 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] quota.injected_files           = 5 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] quota.instances                = 10 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] quota.key_pairs                = 100 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] quota.metadata_items           = 128 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] quota.ram                      = 51200 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] quota.recheck_quota            = True {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] quota.server_group_members     = 10 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] quota.server_groups            = 10 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] rdp.enabled                    = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] scheduler.image_metadata_prefilter = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] scheduler.max_attempts         = 3 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] scheduler.max_placement_results = 1000 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] scheduler.query_placement_for_image_type_support = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] scheduler.workers              = 3 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] filter_scheduler.host_subset_size = 1 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] filter_scheduler.isolated_hosts = [] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] filter_scheduler.isolated_images = [] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] filter_scheduler.pci_in_placement = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] filter_scheduler.track_instance_changes = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] metrics.required               = True {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] metrics.weight_multiplier      = 1.0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] metrics.weight_setting         = [] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] serial_console.enabled         = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] serial_console.port_range      = 10000:20000 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] serial_console.serialproxy_port = 6083 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] service_user.auth_section      = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] service_user.auth_type         = password {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] service_user.cafile            = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] service_user.certfile          = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] service_user.collect_timing    = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] service_user.insecure          = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] service_user.keyfile           = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] service_user.send_service_user_token = True {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] service_user.split_loggers     = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] service_user.timeout           = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] spice.agent_enabled            = True {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] spice.enabled                  = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] spice.html5proxy_port          = 6082 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] spice.image_compression        = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] spice.jpeg_compression         = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] spice.playback_compression     = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] spice.server_listen            = 127.0.0.1 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] spice.streaming_mode           = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] spice.zlib_compression         = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] upgrade_levels.baseapi         = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] upgrade_levels.cert            = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] upgrade_levels.compute         = auto {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] upgrade_levels.conductor       = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] upgrade_levels.scheduler       = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vendordata_dynamic_auth.auth_section = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vendordata_dynamic_auth.auth_type = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vendordata_dynamic_auth.cafile = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vendordata_dynamic_auth.certfile = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vendordata_dynamic_auth.insecure = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vendordata_dynamic_auth.keyfile = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vendordata_dynamic_auth.timeout = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vmware.api_retry_count         = 10 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vmware.ca_file                 = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vmware.cache_prefix            = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vmware.cluster_name            = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vmware.connection_pool_size    = 10 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vmware.console_delay_seconds   = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vmware.datastore_regex         = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vmware.host_ip                 = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vmware.host_password           = **** {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vmware.host_port               = 443 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vmware.host_username           = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vmware.insecure                = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vmware.integration_bridge      = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vmware.maximum_objects         = 100 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vmware.pbm_default_policy      = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vmware.pbm_enabled             = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vmware.pbm_wsdl_location       = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vmware.serial_port_proxy_uri   = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vmware.serial_port_service_uri = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vmware.task_poll_interval      = 0.5 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vmware.use_linked_clone        = True {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vmware.vnc_keymap              = en-us {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vmware.vnc_port                = 5900 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vmware.vnc_port_total          = 10000 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vnc.auth_schemes               = ['none'] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vnc.enabled                    = True {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vnc.novncproxy_port            = 6080 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vnc.server_listen              = 0.0.0.0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vnc.vencrypt_ca_certs          = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vnc.vencrypt_client_cert       = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vnc.vencrypt_client_key        = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] workarounds.disable_rootwrap   = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] workarounds.enable_numa_live_migration = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] workarounds.libvirt_disable_apic = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] wsgi.client_socket_timeout     = 900 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] wsgi.default_pool_size         = 1000 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] wsgi.keep_alive                = True {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] wsgi.max_header_line           = 16384 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] wsgi.ssl_ca_file               = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] wsgi.ssl_cert_file             = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] wsgi.ssl_key_file              = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] wsgi.tcp_keepidle              = 600 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] zvm.ca_file                    = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] zvm.cloud_connector_url        = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] zvm.reachable_timeout          = 300 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_policy.enforce_new_defaults = True {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_policy.enforce_scope      = True {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_policy.policy_default_rule = default {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_policy.policy_file        = policy.yaml {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] profiler.connection_string     = messaging:// {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] profiler.enabled               = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] profiler.es_doc_type           = notification {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] profiler.es_scroll_size        = 10000 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] profiler.es_scroll_time        = 2m {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] profiler.filter_error_trace    = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] profiler.hmac_keys             = **** {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] profiler.sentinel_service_name = mymaster {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] profiler.socket_timeout        = 0.1 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] profiler.trace_requests        = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] profiler.trace_sqlalchemy      = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] profiler_jaeger.process_tags   = {} {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] profiler_jaeger.service_name_prefix = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] profiler_otlp.service_name_prefix = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] remote_debug.host              = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] remote_debug.port              = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_rabbit.ssl      = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_notifications.retry = -1 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_messaging_notifications.transport_url = **** {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_limit.auth_section        = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_limit.auth_type           = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_limit.cafile              = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_limit.certfile            = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_limit.collect_timing      = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_limit.connect_retries     = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_limit.connect_retry_delay = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_limit.endpoint_id         = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_limit.endpoint_override   = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_limit.insecure            = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_limit.keyfile             = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_limit.max_version         = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_limit.min_version         = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_limit.region_name         = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_limit.service_name        = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_limit.service_type        = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_limit.split_loggers       = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_limit.status_code_retries = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_limit.status_code_retry_delay = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_limit.timeout             = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_limit.valid_interfaces    = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_limit.version             = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_reports.file_event_handler = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] oslo_reports.log_dir           = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vif_plug_ovs_privileged.group  = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] vif_plug_ovs_privileged.user   = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] os_vif_linux_bridge.flat_interface = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] os_vif_ovs.isolate_vif         = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] os_vif_ovs.per_port_bridge     = False {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] os_brick.lock_path             = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] privsep_osbrick.capabilities   = [21] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] privsep_osbrick.group          = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] privsep_osbrick.helper_command = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] privsep_osbrick.user           = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] nova_sys_admin.group           = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] nova_sys_admin.helper_command  = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] nova_sys_admin.user            = None {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG oslo_service.service [None req-7d05ff1b-2091-4590-9fd4-4014fa9356ee None None] ******************************************************************************** {{(pid=74850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 14 00:40:38 user nova-compute[74850]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 14 00:40:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Connecting to libvirt: qemu:///system {{(pid=74850) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f9a5ff22f20> {{(pid=74850) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 14 00:40:38 user nova-compute[74850]: libvirt:  error : internal error: could not initialize domain event timer
Nov 14 00:40:38 user nova-compute[74850]: WARNING nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 14 00:40:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f9a5ff22f20> {{(pid=74850) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Starting native event thread {{(pid=74850) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Starting green dispatch thread {{(pid=74850) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 14 00:40:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Starting connection event dispatch thread {{(pid=74850) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 14 00:40:38 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Connection event '1' reason 'None'
Nov 14 00:40:38 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 14 00:40:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.mount [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Initialising _HostMountState generation 0 {{(pid=74850) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 14 00:40:45 user nova-compute[74850]: INFO nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Libvirt host capabilities <capabilities>
Nov 14 00:40:45 user nova-compute[74850]:   <host>
Nov 14 00:40:45 user nova-compute[74850]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 14 00:40:45 user nova-compute[74850]:     <cpu>
Nov 14 00:40:45 user nova-compute[74850]:       <arch>x86_64</arch>
Nov 14 00:40:45 user nova-compute[74850]:       <model>IvyBridge-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <vendor>Intel</vendor>
Nov 14 00:40:45 user nova-compute[74850]:       <microcode version='1070'/>
Nov 14 00:40:45 user nova-compute[74850]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 14 00:40:45 user nova-compute[74850]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature name='ss'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature name='vmx'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature name='pcid'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature name='osxsave'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature name='hypervisor'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature name='arat'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature name='tsc_adjust'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature name='md-clear'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature name='stibp'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature name='arch-capabilities'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature name='ssbd'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature name='invtsc'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature name='rsba'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature name='skip-l1dfl-vmentry'/>
Nov 14 00:40:45 user nova-compute[74850]:       <pages unit='KiB' size='4'/>
Nov 14 00:40:45 user nova-compute[74850]:       <pages unit='KiB' size='2048'/>
Nov 14 00:40:45 user nova-compute[74850]:     </cpu>
Nov 14 00:40:45 user nova-compute[74850]:     <power_management>
Nov 14 00:40:45 user nova-compute[74850]:       <suspend_mem/>
Nov 14 00:40:45 user nova-compute[74850]:       <suspend_disk/>
Nov 14 00:40:45 user nova-compute[74850]:       <suspend_hybrid/>
Nov 14 00:40:45 user nova-compute[74850]:     </power_management>
Nov 14 00:40:45 user nova-compute[74850]:     <iommu support='no'/>
Nov 14 00:40:45 user nova-compute[74850]:     <migration_features>
Nov 14 00:40:45 user nova-compute[74850]:       <live/>
Nov 14 00:40:45 user nova-compute[74850]:       <uri_transports>
Nov 14 00:40:45 user nova-compute[74850]:         <uri_transport>tcp</uri_transport>
Nov 14 00:40:45 user nova-compute[74850]:         <uri_transport>rdma</uri_transport>
Nov 14 00:40:45 user nova-compute[74850]:       </uri_transports>
Nov 14 00:40:45 user nova-compute[74850]:     </migration_features>
Nov 14 00:40:45 user nova-compute[74850]:     <topology>
Nov 14 00:40:45 user nova-compute[74850]:       <cells num='2'>
Nov 14 00:40:45 user nova-compute[74850]:         <cell id='0'>
Nov 14 00:40:45 user nova-compute[74850]:           <memory unit='KiB'>8140616</memory>
Nov 14 00:40:45 user nova-compute[74850]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 14 00:40:45 user nova-compute[74850]:           <pages unit='KiB' size='2048'>0</pages>
Nov 14 00:40:45 user nova-compute[74850]:           <distances>
Nov 14 00:40:45 user nova-compute[74850]:             <sibling id='0' value='10'/>
Nov 14 00:40:45 user nova-compute[74850]:             <sibling id='1' value='20'/>
Nov 14 00:40:45 user nova-compute[74850]:           </distances>
Nov 14 00:40:45 user nova-compute[74850]:           <cpus num='6'>
Nov 14 00:40:45 user nova-compute[74850]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 14 00:40:45 user nova-compute[74850]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 14 00:40:45 user nova-compute[74850]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 14 00:40:45 user nova-compute[74850]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 14 00:40:45 user nova-compute[74850]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 14 00:40:45 user nova-compute[74850]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 14 00:40:45 user nova-compute[74850]:           </cpus>
Nov 14 00:40:45 user nova-compute[74850]:         </cell>
Nov 14 00:40:45 user nova-compute[74850]:         <cell id='1'>
Nov 14 00:40:45 user nova-compute[74850]:           <memory unit='KiB'>8255100</memory>
Nov 14 00:40:45 user nova-compute[74850]:           <pages unit='KiB' size='4'>2063775</pages>
Nov 14 00:40:45 user nova-compute[74850]:           <pages unit='KiB' size='2048'>0</pages>
Nov 14 00:40:45 user nova-compute[74850]:           <distances>
Nov 14 00:40:45 user nova-compute[74850]:             <sibling id='0' value='20'/>
Nov 14 00:40:45 user nova-compute[74850]:             <sibling id='1' value='10'/>
Nov 14 00:40:45 user nova-compute[74850]:           </distances>
Nov 14 00:40:45 user nova-compute[74850]:           <cpus num='6'>
Nov 14 00:40:45 user nova-compute[74850]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 14 00:40:45 user nova-compute[74850]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 14 00:40:45 user nova-compute[74850]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 14 00:40:45 user nova-compute[74850]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 14 00:40:45 user nova-compute[74850]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 14 00:40:45 user nova-compute[74850]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 14 00:40:45 user nova-compute[74850]:           </cpus>
Nov 14 00:40:45 user nova-compute[74850]:         </cell>
Nov 14 00:40:45 user nova-compute[74850]:       </cells>
Nov 14 00:40:45 user nova-compute[74850]:     </topology>
Nov 14 00:40:45 user nova-compute[74850]:     <cache>
Nov 14 00:40:45 user nova-compute[74850]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 14 00:40:45 user nova-compute[74850]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 14 00:40:45 user nova-compute[74850]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 14 00:40:45 user nova-compute[74850]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 14 00:40:45 user nova-compute[74850]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 14 00:40:45 user nova-compute[74850]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 14 00:40:45 user nova-compute[74850]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 14 00:40:45 user nova-compute[74850]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 14 00:40:45 user nova-compute[74850]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 14 00:40:45 user nova-compute[74850]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 14 00:40:45 user nova-compute[74850]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 14 00:40:45 user nova-compute[74850]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 14 00:40:45 user nova-compute[74850]:     </cache>
Nov 14 00:40:45 user nova-compute[74850]:     <secmodel>
Nov 14 00:40:45 user nova-compute[74850]:       <model>apparmor</model>
Nov 14 00:40:45 user nova-compute[74850]:       <doi>0</doi>
Nov 14 00:40:45 user nova-compute[74850]:     </secmodel>
Nov 14 00:40:45 user nova-compute[74850]:     <secmodel>
Nov 14 00:40:45 user nova-compute[74850]:       <model>dac</model>
Nov 14 00:40:45 user nova-compute[74850]:       <doi>0</doi>
Nov 14 00:40:45 user nova-compute[74850]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 14 00:40:45 user nova-compute[74850]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 14 00:40:45 user nova-compute[74850]:     </secmodel>
Nov 14 00:40:45 user nova-compute[74850]:   </host>
Nov 14 00:40:45 user nova-compute[74850]:   <guest>
Nov 14 00:40:45 user nova-compute[74850]:     <os_type>hvm</os_type>
Nov 14 00:40:45 user nova-compute[74850]:     <arch name='alpha'>
Nov 14 00:40:45 user nova-compute[74850]:       <wordsize>64</wordsize>
Nov 14 00:40:45 user nova-compute[74850]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='4'>clipper</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <domain type='qemu'/>
Nov 14 00:40:45 user nova-compute[74850]:     </arch>
Nov 14 00:40:45 user nova-compute[74850]:     <features>
Nov 14 00:40:45 user nova-compute[74850]:       <cpuselection/>
Nov 14 00:40:45 user nova-compute[74850]:       <deviceboot/>
Nov 14 00:40:45 user nova-compute[74850]:       <disksnapshot default='on' toggle='no'/>
Nov 14 00:40:45 user nova-compute[74850]:     </features>
Nov 14 00:40:45 user nova-compute[74850]:   </guest>
Nov 14 00:40:45 user nova-compute[74850]:   <guest>
Nov 14 00:40:45 user nova-compute[74850]:     <os_type>hvm</os_type>
Nov 14 00:40:45 user nova-compute[74850]:     <arch name='armv6l'>
Nov 14 00:40:45 user nova-compute[74850]:       <wordsize>32</wordsize>
Nov 14 00:40:45 user nova-compute[74850]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>spitz</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>nuri</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>kzm</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>sx1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>z2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>tosa</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>n810</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>n800</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>terrier</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='4'>midway</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>microbit</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>verdex</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='4'>highbank</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>akita</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>connex</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>collie</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <domain type='qemu'/>
Nov 14 00:40:45 user nova-compute[74850]:     </arch>
Nov 14 00:40:45 user nova-compute[74850]:     <features>
Nov 14 00:40:45 user nova-compute[74850]:       <cpuselection/>
Nov 14 00:40:45 user nova-compute[74850]:       <deviceboot/>
Nov 14 00:40:45 user nova-compute[74850]:       <disksnapshot default='on' toggle='no'/>
Nov 14 00:40:45 user nova-compute[74850]:     </features>
Nov 14 00:40:45 user nova-compute[74850]:   </guest>
Nov 14 00:40:45 user nova-compute[74850]:   <guest>
Nov 14 00:40:45 user nova-compute[74850]:     <os_type>hvm</os_type>
Nov 14 00:40:45 user nova-compute[74850]:     <arch name='armv7l'>
Nov 14 00:40:45 user nova-compute[74850]:       <wordsize>32</wordsize>
Nov 14 00:40:45 user nova-compute[74850]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>spitz</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>nuri</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>kzm</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>sx1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>z2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>tosa</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>n810</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>n800</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>terrier</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='4'>midway</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>microbit</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>verdex</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='4'>highbank</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>akita</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>connex</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>collie</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <domain type='qemu'/>
Nov 14 00:40:45 user nova-compute[74850]:     </arch>
Nov 14 00:40:45 user nova-compute[74850]:     <features>
Nov 14 00:40:45 user nova-compute[74850]:       <cpuselection/>
Nov 14 00:40:45 user nova-compute[74850]:       <deviceboot/>
Nov 14 00:40:45 user nova-compute[74850]:       <disksnapshot default='on' toggle='no'/>
Nov 14 00:40:45 user nova-compute[74850]:     </features>
Nov 14 00:40:45 user nova-compute[74850]:   </guest>
Nov 14 00:40:45 user nova-compute[74850]:   <guest>
Nov 14 00:40:45 user nova-compute[74850]:     <os_type>hvm</os_type>
Nov 14 00:40:45 user nova-compute[74850]:     <arch name='aarch64'>
Nov 14 00:40:45 user nova-compute[74850]:       <wordsize>64</wordsize>
Nov 14 00:40:45 user nova-compute[74850]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>spitz</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>nuri</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>kzm</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>sx1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>z2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>tosa</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>n810</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>n800</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>terrier</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='4'>midway</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>microbit</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>verdex</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='4'>raspi3b</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='4'>highbank</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>akita</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>connex</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>collie</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <domain type='qemu'/>
Nov 14 00:40:45 user nova-compute[74850]:     </arch>
Nov 14 00:40:45 user nova-compute[74850]:     <features>
Nov 14 00:40:45 user nova-compute[74850]:       <acpi default='on' toggle='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:       <cpuselection/>
Nov 14 00:40:45 user nova-compute[74850]:       <deviceboot/>
Nov 14 00:40:45 user nova-compute[74850]:       <disksnapshot default='on' toggle='no'/>
Nov 14 00:40:45 user nova-compute[74850]:     </features>
Nov 14 00:40:45 user nova-compute[74850]:   </guest>
Nov 14 00:40:45 user nova-compute[74850]:   <guest>
Nov 14 00:40:45 user nova-compute[74850]:     <os_type>hvm</os_type>
Nov 14 00:40:45 user nova-compute[74850]:     <arch name='cris'>
Nov 14 00:40:45 user nova-compute[74850]:       <wordsize>32</wordsize>
Nov 14 00:40:45 user nova-compute[74850]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <domain type='qemu'/>
Nov 14 00:40:45 user nova-compute[74850]:     </arch>
Nov 14 00:40:45 user nova-compute[74850]:     <features>
Nov 14 00:40:45 user nova-compute[74850]:       <cpuselection/>
Nov 14 00:40:45 user nova-compute[74850]:       <deviceboot/>
Nov 14 00:40:45 user nova-compute[74850]:       <disksnapshot default='on' toggle='no'/>
Nov 14 00:40:45 user nova-compute[74850]:     </features>
Nov 14 00:40:45 user nova-compute[74850]:   </guest>
Nov 14 00:40:45 user nova-compute[74850]:   <guest>
Nov 14 00:40:45 user nova-compute[74850]:     <os_type>hvm</os_type>
Nov 14 00:40:45 user nova-compute[74850]:     <arch name='i686'>
Nov 14 00:40:45 user nova-compute[74850]:       <wordsize>32</wordsize>
Nov 14 00:40:45 user nova-compute[74850]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>x-remote</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>isapc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>microvm</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <domain type='qemu'/>
Nov 14 00:40:45 user nova-compute[74850]:       <domain type='kvm'/>
Nov 14 00:40:45 user nova-compute[74850]:     </arch>
Nov 14 00:40:45 user nova-compute[74850]:     <features>
Nov 14 00:40:45 user nova-compute[74850]:       <pae/>
Nov 14 00:40:45 user nova-compute[74850]:       <nonpae/>
Nov 14 00:40:45 user nova-compute[74850]:       <acpi default='on' toggle='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:       <apic default='on' toggle='no'/>
Nov 14 00:40:45 user nova-compute[74850]:       <cpuselection/>
Nov 14 00:40:45 user nova-compute[74850]:       <deviceboot/>
Nov 14 00:40:45 user nova-compute[74850]:       <disksnapshot default='on' toggle='no'/>
Nov 14 00:40:45 user nova-compute[74850]:     </features>
Nov 14 00:40:45 user nova-compute[74850]:   </guest>
Nov 14 00:40:45 user nova-compute[74850]:   <guest>
Nov 14 00:40:45 user nova-compute[74850]:     <os_type>hvm</os_type>
Nov 14 00:40:45 user nova-compute[74850]:     <arch name='m68k'>
Nov 14 00:40:45 user nova-compute[74850]:       <wordsize>32</wordsize>
Nov 14 00:40:45 user nova-compute[74850]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>an5206</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>q800</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>next-cube</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <domain type='qemu'/>
Nov 14 00:40:45 user nova-compute[74850]:     </arch>
Nov 14 00:40:45 user nova-compute[74850]:     <features>
Nov 14 00:40:45 user nova-compute[74850]:       <cpuselection/>
Nov 14 00:40:45 user nova-compute[74850]:       <deviceboot/>
Nov 14 00:40:45 user nova-compute[74850]:       <disksnapshot default='on' toggle='no'/>
Nov 14 00:40:45 user nova-compute[74850]:     </features>
Nov 14 00:40:45 user nova-compute[74850]:   </guest>
Nov 14 00:40:45 user nova-compute[74850]:   <guest>
Nov 14 00:40:45 user nova-compute[74850]:     <os_type>hvm</os_type>
Nov 14 00:40:45 user nova-compute[74850]:     <arch name='microblaze'>
Nov 14 00:40:45 user nova-compute[74850]:       <wordsize>32</wordsize>
Nov 14 00:40:45 user nova-compute[74850]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <domain type='qemu'/>
Nov 14 00:40:45 user nova-compute[74850]:     </arch>
Nov 14 00:40:45 user nova-compute[74850]:     <features>
Nov 14 00:40:45 user nova-compute[74850]:       <cpuselection/>
Nov 14 00:40:45 user nova-compute[74850]:       <deviceboot/>
Nov 14 00:40:45 user nova-compute[74850]:       <disksnapshot default='on' toggle='no'/>
Nov 14 00:40:45 user nova-compute[74850]:     </features>
Nov 14 00:40:45 user nova-compute[74850]:   </guest>
Nov 14 00:40:45 user nova-compute[74850]:   <guest>
Nov 14 00:40:45 user nova-compute[74850]:     <os_type>hvm</os_type>
Nov 14 00:40:45 user nova-compute[74850]:     <arch name='microblazeel'>
Nov 14 00:40:45 user nova-compute[74850]:       <wordsize>32</wordsize>
Nov 14 00:40:45 user nova-compute[74850]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <domain type='qemu'/>
Nov 14 00:40:45 user nova-compute[74850]:     </arch>
Nov 14 00:40:45 user nova-compute[74850]:     <features>
Nov 14 00:40:45 user nova-compute[74850]:       <cpuselection/>
Nov 14 00:40:45 user nova-compute[74850]:       <deviceboot/>
Nov 14 00:40:45 user nova-compute[74850]:       <disksnapshot default='on' toggle='no'/>
Nov 14 00:40:45 user nova-compute[74850]:     </features>
Nov 14 00:40:45 user nova-compute[74850]:   </guest>
Nov 14 00:40:45 user nova-compute[74850]:   <guest>
Nov 14 00:40:45 user nova-compute[74850]:     <os_type>hvm</os_type>
Nov 14 00:40:45 user nova-compute[74850]:     <arch name='mips'>
Nov 14 00:40:45 user nova-compute[74850]:       <wordsize>32</wordsize>
Nov 14 00:40:45 user nova-compute[74850]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='16'>malta</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <domain type='qemu'/>
Nov 14 00:40:45 user nova-compute[74850]:     </arch>
Nov 14 00:40:45 user nova-compute[74850]:     <features>
Nov 14 00:40:45 user nova-compute[74850]:       <cpuselection/>
Nov 14 00:40:45 user nova-compute[74850]:       <deviceboot/>
Nov 14 00:40:45 user nova-compute[74850]:       <disksnapshot default='on' toggle='no'/>
Nov 14 00:40:45 user nova-compute[74850]:     </features>
Nov 14 00:40:45 user nova-compute[74850]:   </guest>
Nov 14 00:40:45 user nova-compute[74850]:   <guest>
Nov 14 00:40:45 user nova-compute[74850]:     <os_type>hvm</os_type>
Nov 14 00:40:45 user nova-compute[74850]:     <arch name='mipsel'>
Nov 14 00:40:45 user nova-compute[74850]:       <wordsize>32</wordsize>
Nov 14 00:40:45 user nova-compute[74850]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='16'>malta</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <domain type='qemu'/>
Nov 14 00:40:45 user nova-compute[74850]:     </arch>
Nov 14 00:40:45 user nova-compute[74850]:     <features>
Nov 14 00:40:45 user nova-compute[74850]:       <cpuselection/>
Nov 14 00:40:45 user nova-compute[74850]:       <deviceboot/>
Nov 14 00:40:45 user nova-compute[74850]:       <disksnapshot default='on' toggle='no'/>
Nov 14 00:40:45 user nova-compute[74850]:     </features>
Nov 14 00:40:45 user nova-compute[74850]:   </guest>
Nov 14 00:40:45 user nova-compute[74850]:   <guest>
Nov 14 00:40:45 user nova-compute[74850]:     <os_type>hvm</os_type>
Nov 14 00:40:45 user nova-compute[74850]:     <arch name='mips64'>
Nov 14 00:40:45 user nova-compute[74850]:       <wordsize>64</wordsize>
Nov 14 00:40:45 user nova-compute[74850]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='16'>malta</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>pica61</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>magnum</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <domain type='qemu'/>
Nov 14 00:40:45 user nova-compute[74850]:     </arch>
Nov 14 00:40:45 user nova-compute[74850]:     <features>
Nov 14 00:40:45 user nova-compute[74850]:       <cpuselection/>
Nov 14 00:40:45 user nova-compute[74850]:       <deviceboot/>
Nov 14 00:40:45 user nova-compute[74850]:       <disksnapshot default='on' toggle='no'/>
Nov 14 00:40:45 user nova-compute[74850]:     </features>
Nov 14 00:40:45 user nova-compute[74850]:   </guest>
Nov 14 00:40:45 user nova-compute[74850]:   <guest>
Nov 14 00:40:45 user nova-compute[74850]:     <os_type>hvm</os_type>
Nov 14 00:40:45 user nova-compute[74850]:     <arch name='mips64el'>
Nov 14 00:40:45 user nova-compute[74850]:       <wordsize>64</wordsize>
Nov 14 00:40:45 user nova-compute[74850]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='16'>malta</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>pica61</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>magnum</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='16'>boston</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <domain type='qemu'/>
Nov 14 00:40:45 user nova-compute[74850]:     </arch>
Nov 14 00:40:45 user nova-compute[74850]:     <features>
Nov 14 00:40:45 user nova-compute[74850]:       <cpuselection/>
Nov 14 00:40:45 user nova-compute[74850]:       <deviceboot/>
Nov 14 00:40:45 user nova-compute[74850]:       <disksnapshot default='on' toggle='no'/>
Nov 14 00:40:45 user nova-compute[74850]:     </features>
Nov 14 00:40:45 user nova-compute[74850]:   </guest>
Nov 14 00:40:45 user nova-compute[74850]:   <guest>
Nov 14 00:40:45 user nova-compute[74850]:     <os_type>hvm</os_type>
Nov 14 00:40:45 user nova-compute[74850]:     <arch name='ppc'>
Nov 14 00:40:45 user nova-compute[74850]:       <wordsize>32</wordsize>
Nov 14 00:40:45 user nova-compute[74850]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>mac99</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>40p</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>taihu</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <domain type='qemu'/>
Nov 14 00:40:45 user nova-compute[74850]:     </arch>
Nov 14 00:40:45 user nova-compute[74850]:     <features>
Nov 14 00:40:45 user nova-compute[74850]:       <cpuselection/>
Nov 14 00:40:45 user nova-compute[74850]:       <deviceboot/>
Nov 14 00:40:45 user nova-compute[74850]:       <disksnapshot default='on' toggle='no'/>
Nov 14 00:40:45 user nova-compute[74850]:     </features>
Nov 14 00:40:45 user nova-compute[74850]:   </guest>
Nov 14 00:40:45 user nova-compute[74850]:   <guest>
Nov 14 00:40:45 user nova-compute[74850]:     <os_type>hvm</os_type>
Nov 14 00:40:45 user nova-compute[74850]:     <arch name='ppc64'>
Nov 14 00:40:45 user nova-compute[74850]:       <wordsize>64</wordsize>
Nov 14 00:40:45 user nova-compute[74850]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2048'>powernv9</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>taihu</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2048'>powernv10</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>40p</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>mac99</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2048'>powernv8</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <domain type='qemu'/>
Nov 14 00:40:45 user nova-compute[74850]:     </arch>
Nov 14 00:40:45 user nova-compute[74850]:     <features>
Nov 14 00:40:45 user nova-compute[74850]:       <cpuselection/>
Nov 14 00:40:45 user nova-compute[74850]:       <deviceboot/>
Nov 14 00:40:45 user nova-compute[74850]:       <disksnapshot default='on' toggle='no'/>
Nov 14 00:40:45 user nova-compute[74850]:     </features>
Nov 14 00:40:45 user nova-compute[74850]:   </guest>
Nov 14 00:40:45 user nova-compute[74850]:   <guest>
Nov 14 00:40:45 user nova-compute[74850]:     <os_type>hvm</os_type>
Nov 14 00:40:45 user nova-compute[74850]:     <arch name='ppc64le'>
Nov 14 00:40:45 user nova-compute[74850]:       <wordsize>64</wordsize>
Nov 14 00:40:45 user nova-compute[74850]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2048'>powernv9</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>taihu</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2048'>powernv10</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>40p</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>mac99</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2048'>powernv8</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <domain type='qemu'/>
Nov 14 00:40:45 user nova-compute[74850]:     </arch>
Nov 14 00:40:45 user nova-compute[74850]:     <features>
Nov 14 00:40:45 user nova-compute[74850]:       <cpuselection/>
Nov 14 00:40:45 user nova-compute[74850]:       <deviceboot/>
Nov 14 00:40:45 user nova-compute[74850]:       <disksnapshot default='on' toggle='no'/>
Nov 14 00:40:45 user nova-compute[74850]:     </features>
Nov 14 00:40:45 user nova-compute[74850]:   </guest>
Nov 14 00:40:45 user nova-compute[74850]:   <guest>
Nov 14 00:40:45 user nova-compute[74850]:     <os_type>hvm</os_type>
Nov 14 00:40:45 user nova-compute[74850]:     <arch name='riscv32'>
Nov 14 00:40:45 user nova-compute[74850]:       <wordsize>32</wordsize>
Nov 14 00:40:45 user nova-compute[74850]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='8'>spike</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>opentitan</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='5'>sifive_u</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>sifive_e</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='8'>virt</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <domain type='qemu'/>
Nov 14 00:40:45 user nova-compute[74850]:     </arch>
Nov 14 00:40:45 user nova-compute[74850]:     <features>
Nov 14 00:40:45 user nova-compute[74850]:       <cpuselection/>
Nov 14 00:40:45 user nova-compute[74850]:       <deviceboot/>
Nov 14 00:40:45 user nova-compute[74850]:       <disksnapshot default='on' toggle='no'/>
Nov 14 00:40:45 user nova-compute[74850]:     </features>
Nov 14 00:40:45 user nova-compute[74850]:   </guest>
Nov 14 00:40:45 user nova-compute[74850]:   <guest>
Nov 14 00:40:45 user nova-compute[74850]:     <os_type>hvm</os_type>
Nov 14 00:40:45 user nova-compute[74850]:     <arch name='riscv64'>
Nov 14 00:40:45 user nova-compute[74850]:       <wordsize>64</wordsize>
Nov 14 00:40:45 user nova-compute[74850]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='8'>spike</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='5'>sifive_u</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>shakti_c</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>sifive_e</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='8'>virt</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <domain type='qemu'/>
Nov 14 00:40:45 user nova-compute[74850]:     </arch>
Nov 14 00:40:45 user nova-compute[74850]:     <features>
Nov 14 00:40:45 user nova-compute[74850]:       <cpuselection/>
Nov 14 00:40:45 user nova-compute[74850]:       <deviceboot/>
Nov 14 00:40:45 user nova-compute[74850]:       <disksnapshot default='on' toggle='no'/>
Nov 14 00:40:45 user nova-compute[74850]:     </features>
Nov 14 00:40:45 user nova-compute[74850]:   </guest>
Nov 14 00:40:45 user nova-compute[74850]:   <guest>
Nov 14 00:40:45 user nova-compute[74850]:     <os_type>hvm</os_type>
Nov 14 00:40:45 user nova-compute[74850]:     <arch name='s390x'>
Nov 14 00:40:45 user nova-compute[74850]:       <wordsize>64</wordsize>
Nov 14 00:40:45 user nova-compute[74850]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <domain type='qemu'/>
Nov 14 00:40:45 user nova-compute[74850]:     </arch>
Nov 14 00:40:45 user nova-compute[74850]:     <features>
Nov 14 00:40:45 user nova-compute[74850]:       <cpuselection/>
Nov 14 00:40:45 user nova-compute[74850]:       <deviceboot/>
Nov 14 00:40:45 user nova-compute[74850]:       <disksnapshot default='on' toggle='no'/>
Nov 14 00:40:45 user nova-compute[74850]:     </features>
Nov 14 00:40:45 user nova-compute[74850]:   </guest>
Nov 14 00:40:45 user nova-compute[74850]:   <guest>
Nov 14 00:40:45 user nova-compute[74850]:     <os_type>hvm</os_type>
Nov 14 00:40:45 user nova-compute[74850]:     <arch name='sh4'>
Nov 14 00:40:45 user nova-compute[74850]:       <wordsize>32</wordsize>
Nov 14 00:40:45 user nova-compute[74850]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>shix</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>r2d</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <domain type='qemu'/>
Nov 14 00:40:45 user nova-compute[74850]:     </arch>
Nov 14 00:40:45 user nova-compute[74850]:     <features>
Nov 14 00:40:45 user nova-compute[74850]:       <cpuselection/>
Nov 14 00:40:45 user nova-compute[74850]:       <deviceboot/>
Nov 14 00:40:45 user nova-compute[74850]:       <disksnapshot default='on' toggle='no'/>
Nov 14 00:40:45 user nova-compute[74850]:     </features>
Nov 14 00:40:45 user nova-compute[74850]:   </guest>
Nov 14 00:40:45 user nova-compute[74850]:   <guest>
Nov 14 00:40:45 user nova-compute[74850]:     <os_type>hvm</os_type>
Nov 14 00:40:45 user nova-compute[74850]:     <arch name='sh4eb'>
Nov 14 00:40:45 user nova-compute[74850]:       <wordsize>64</wordsize>
Nov 14 00:40:45 user nova-compute[74850]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>shix</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>r2d</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <domain type='qemu'/>
Nov 14 00:40:45 user nova-compute[74850]:     </arch>
Nov 14 00:40:45 user nova-compute[74850]:     <features>
Nov 14 00:40:45 user nova-compute[74850]:       <cpuselection/>
Nov 14 00:40:45 user nova-compute[74850]:       <deviceboot/>
Nov 14 00:40:45 user nova-compute[74850]:       <disksnapshot default='on' toggle='no'/>
Nov 14 00:40:45 user nova-compute[74850]:     </features>
Nov 14 00:40:45 user nova-compute[74850]:   </guest>
Nov 14 00:40:45 user nova-compute[74850]:   <guest>
Nov 14 00:40:45 user nova-compute[74850]:     <os_type>hvm</os_type>
Nov 14 00:40:45 user nova-compute[74850]:     <arch name='sparc'>
Nov 14 00:40:45 user nova-compute[74850]:       <wordsize>32</wordsize>
Nov 14 00:40:45 user nova-compute[74850]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>SS-5</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='4'>SS-20</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>LX</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>SS-4</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='4'>SS-10</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>Voyager</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <domain type='qemu'/>
Nov 14 00:40:45 user nova-compute[74850]:     </arch>
Nov 14 00:40:45 user nova-compute[74850]:     <features>
Nov 14 00:40:45 user nova-compute[74850]:       <cpuselection/>
Nov 14 00:40:45 user nova-compute[74850]:       <deviceboot/>
Nov 14 00:40:45 user nova-compute[74850]:       <disksnapshot default='on' toggle='no'/>
Nov 14 00:40:45 user nova-compute[74850]:     </features>
Nov 14 00:40:45 user nova-compute[74850]:   </guest>
Nov 14 00:40:45 user nova-compute[74850]:   <guest>
Nov 14 00:40:45 user nova-compute[74850]:     <os_type>hvm</os_type>
Nov 14 00:40:45 user nova-compute[74850]:     <arch name='sparc64'>
Nov 14 00:40:45 user nova-compute[74850]:       <wordsize>64</wordsize>
Nov 14 00:40:45 user nova-compute[74850]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>sun4u</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>niagara</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>sun4v</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <domain type='qemu'/>
Nov 14 00:40:45 user nova-compute[74850]:     </arch>
Nov 14 00:40:45 user nova-compute[74850]:     <features>
Nov 14 00:40:45 user nova-compute[74850]:       <cpuselection/>
Nov 14 00:40:45 user nova-compute[74850]:       <deviceboot/>
Nov 14 00:40:45 user nova-compute[74850]:       <disksnapshot default='on' toggle='no'/>
Nov 14 00:40:45 user nova-compute[74850]:     </features>
Nov 14 00:40:45 user nova-compute[74850]:   </guest>
Nov 14 00:40:45 user nova-compute[74850]:   <guest>
Nov 14 00:40:45 user nova-compute[74850]:     <os_type>hvm</os_type>
Nov 14 00:40:45 user nova-compute[74850]:     <arch name='x86_64'>
Nov 14 00:40:45 user nova-compute[74850]:       <wordsize>64</wordsize>
Nov 14 00:40:45 user nova-compute[74850]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>x-remote</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='1'>isapc</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>microvm</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <domain type='qemu'/>
Nov 14 00:40:45 user nova-compute[74850]:       <domain type='kvm'/>
Nov 14 00:40:45 user nova-compute[74850]:     </arch>
Nov 14 00:40:45 user nova-compute[74850]:     <features>
Nov 14 00:40:45 user nova-compute[74850]:       <acpi default='on' toggle='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:       <apic default='on' toggle='no'/>
Nov 14 00:40:45 user nova-compute[74850]:       <cpuselection/>
Nov 14 00:40:45 user nova-compute[74850]:       <deviceboot/>
Nov 14 00:40:45 user nova-compute[74850]:       <disksnapshot default='on' toggle='no'/>
Nov 14 00:40:45 user nova-compute[74850]:     </features>
Nov 14 00:40:45 user nova-compute[74850]:   </guest>
Nov 14 00:40:45 user nova-compute[74850]:   <guest>
Nov 14 00:40:45 user nova-compute[74850]:     <os_type>hvm</os_type>
Nov 14 00:40:45 user nova-compute[74850]:     <arch name='xtensa'>
Nov 14 00:40:45 user nova-compute[74850]:       <wordsize>32</wordsize>
Nov 14 00:40:45 user nova-compute[74850]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='4'>sim</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='32'>kc705</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='32'>ml605</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='32'>virt</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='32'>lx200</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='32'>lx60</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <domain type='qemu'/>
Nov 14 00:40:45 user nova-compute[74850]:     </arch>
Nov 14 00:40:45 user nova-compute[74850]:     <features>
Nov 14 00:40:45 user nova-compute[74850]:       <cpuselection/>
Nov 14 00:40:45 user nova-compute[74850]:       <deviceboot/>
Nov 14 00:40:45 user nova-compute[74850]:       <disksnapshot default='on' toggle='no'/>
Nov 14 00:40:45 user nova-compute[74850]:     </features>
Nov 14 00:40:45 user nova-compute[74850]:   </guest>
Nov 14 00:40:45 user nova-compute[74850]:   <guest>
Nov 14 00:40:45 user nova-compute[74850]:     <os_type>hvm</os_type>
Nov 14 00:40:45 user nova-compute[74850]:     <arch name='xtensaeb'>
Nov 14 00:40:45 user nova-compute[74850]:       <wordsize>32</wordsize>
Nov 14 00:40:45 user nova-compute[74850]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='4'>sim</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='32'>kc705</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='32'>ml605</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='32'>virt</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='32'>lx200</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='32'>lx60</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 14 00:40:45 user nova-compute[74850]:       <domain type='qemu'/>
Nov 14 00:40:45 user nova-compute[74850]:     </arch>
Nov 14 00:40:45 user nova-compute[74850]:     <features>
Nov 14 00:40:45 user nova-compute[74850]:       <cpuselection/>
Nov 14 00:40:45 user nova-compute[74850]:       <deviceboot/>
Nov 14 00:40:45 user nova-compute[74850]:       <disksnapshot default='on' toggle='no'/>
Nov 14 00:40:45 user nova-compute[74850]:     </features>
Nov 14 00:40:45 user nova-compute[74850]:   </guest>
Nov 14 00:40:45 user nova-compute[74850]: </capabilities>
Nov 14 00:40:45 user nova-compute[74850]: 
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Getting domain capabilities for i686 via machine types: {'q35', 'pc', 'ubuntu', 'ubuntu-q35'} {{(pid=74850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 14 00:40:45 user nova-compute[74850]: <domainCapabilities>
Nov 14 00:40:45 user nova-compute[74850]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 00:40:45 user nova-compute[74850]:   <domain>kvm</domain>
Nov 14 00:40:45 user nova-compute[74850]:   <machine>pc-q35-6.2</machine>
Nov 14 00:40:45 user nova-compute[74850]:   <arch>i686</arch>
Nov 14 00:40:45 user nova-compute[74850]:   <vcpu max='288'/>
Nov 14 00:40:45 user nova-compute[74850]:   <iothreads supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:   <os supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:     <enum name='firmware'/>
Nov 14 00:40:45 user nova-compute[74850]:     <loader supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 00:40:45 user nova-compute[74850]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 00:40:45 user nova-compute[74850]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 00:40:45 user nova-compute[74850]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 00:40:45 user nova-compute[74850]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='type'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>rom</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>pflash</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='readonly'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>yes</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>no</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='secure'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>no</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </loader>
Nov 14 00:40:45 user nova-compute[74850]:   </os>
Nov 14 00:40:45 user nova-compute[74850]:   <cpu>
Nov 14 00:40:45 user nova-compute[74850]:     <mode name='host-passthrough' supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='hostPassthroughMigratable'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>off</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </mode>
Nov 14 00:40:45 user nova-compute[74850]:     <mode name='maximum' supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='maximumMigratable'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>on</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>off</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </mode>
Nov 14 00:40:45 user nova-compute[74850]:     <mode name='host-model' supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <vendor>Intel</vendor>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='ss'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='vmx'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='pcid'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='hypervisor'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='arat'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='umip'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='md-clear'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='stibp'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='ssbd'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='ibpb'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='ibrs'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='amd-stibp'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='disable' name='erms'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='disable' name='lm'/>
Nov 14 00:40:45 user nova-compute[74850]:     </mode>
Nov 14 00:40:45 user nova-compute[74850]:     <mode name='custom' supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>qemu64</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>qemu32</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>phenom</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>pentium3</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>pentium2</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>pentium</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>n270</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>kvm64</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>kvm32</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>coreduo</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>core2duo</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>athlon</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Westmere</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Snowridge</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Server</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Client</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>SandyBridge</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Penryn</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Opteron_G5</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Opteron_G4</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Opteron_G3</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Opteron_G2</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Opteron_G1</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Nehalem</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>IvyBridge</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Icelake-Server</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Haswell</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>EPYC-Rome</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>EPYC-Milan</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>EPYC</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Dhyana</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Cooperlake</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Conroe</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Broadwell</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>486</model>
Nov 14 00:40:45 user nova-compute[74850]:     </mode>
Nov 14 00:40:45 user nova-compute[74850]:   </cpu>
Nov 14 00:40:45 user nova-compute[74850]:   <memoryBacking supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:     <enum name='sourceType'>
Nov 14 00:40:45 user nova-compute[74850]:       <value>file</value>
Nov 14 00:40:45 user nova-compute[74850]:       <value>anonymous</value>
Nov 14 00:40:45 user nova-compute[74850]:       <value>memfd</value>
Nov 14 00:40:45 user nova-compute[74850]:     </enum>
Nov 14 00:40:45 user nova-compute[74850]:   </memoryBacking>
Nov 14 00:40:45 user nova-compute[74850]:   <devices>
Nov 14 00:40:45 user nova-compute[74850]:     <disk supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='diskDevice'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>disk</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>cdrom</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>floppy</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>lun</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='bus'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>fdc</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>scsi</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>usb</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>sata</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='model'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio-transitional</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio-non-transitional</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </disk>
Nov 14 00:40:45 user nova-compute[74850]:     <graphics supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='type'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>sdl</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>vnc</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>spice</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>egl-headless</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </graphics>
Nov 14 00:40:45 user nova-compute[74850]:     <video supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='modelType'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>vga</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>cirrus</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>vmvga</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>qxl</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>none</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>bochs</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>ramfb</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </video>
Nov 14 00:40:45 user nova-compute[74850]:     <hostdev supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='mode'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>subsystem</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='startupPolicy'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>default</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>mandatory</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>requisite</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>optional</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='subsysType'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>usb</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>pci</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>scsi</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='capsType'/>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='pciBackend'/>
Nov 14 00:40:45 user nova-compute[74850]:     </hostdev>
Nov 14 00:40:45 user nova-compute[74850]:     <rng supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='model'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio-transitional</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio-non-transitional</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='backendModel'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>random</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>egd</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>builtin</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </rng>
Nov 14 00:40:45 user nova-compute[74850]:     <filesystem supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='driverType'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>path</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>handle</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtiofs</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </filesystem>
Nov 14 00:40:45 user nova-compute[74850]:     <tpm supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='model'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>tpm-tis</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>tpm-crb</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='backendModel'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>passthrough</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>emulator</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </tpm>
Nov 14 00:40:45 user nova-compute[74850]:   </devices>
Nov 14 00:40:45 user nova-compute[74850]:   <features>
Nov 14 00:40:45 user nova-compute[74850]:     <gic supported='no'/>
Nov 14 00:40:45 user nova-compute[74850]:     <vmcoreinfo supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:     <genid supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:     <backingStoreInput supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:     <backup supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:     <sev supported='no'/>
Nov 14 00:40:45 user nova-compute[74850]:   </features>
Nov 14 00:40:45 user nova-compute[74850]: </domainCapabilities>
Nov 14 00:40:45 user nova-compute[74850]:  {{(pid=74850) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 14 00:40:45 user nova-compute[74850]: <domainCapabilities>
Nov 14 00:40:45 user nova-compute[74850]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 00:40:45 user nova-compute[74850]:   <domain>kvm</domain>
Nov 14 00:40:45 user nova-compute[74850]:   <machine>pc-i440fx-6.2</machine>
Nov 14 00:40:45 user nova-compute[74850]:   <arch>i686</arch>
Nov 14 00:40:45 user nova-compute[74850]:   <vcpu max='255'/>
Nov 14 00:40:45 user nova-compute[74850]:   <iothreads supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:   <os supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:     <enum name='firmware'/>
Nov 14 00:40:45 user nova-compute[74850]:     <loader supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 00:40:45 user nova-compute[74850]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 00:40:45 user nova-compute[74850]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 00:40:45 user nova-compute[74850]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 00:40:45 user nova-compute[74850]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='type'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>rom</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>pflash</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='readonly'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>yes</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>no</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='secure'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>no</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </loader>
Nov 14 00:40:45 user nova-compute[74850]:   </os>
Nov 14 00:40:45 user nova-compute[74850]:   <cpu>
Nov 14 00:40:45 user nova-compute[74850]:     <mode name='host-passthrough' supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='hostPassthroughMigratable'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>off</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </mode>
Nov 14 00:40:45 user nova-compute[74850]:     <mode name='maximum' supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='maximumMigratable'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>on</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>off</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </mode>
Nov 14 00:40:45 user nova-compute[74850]:     <mode name='host-model' supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <vendor>Intel</vendor>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='ss'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='vmx'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='pcid'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='hypervisor'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='arat'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='umip'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='md-clear'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='stibp'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='ssbd'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='ibpb'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='ibrs'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='amd-stibp'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='disable' name='erms'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='disable' name='lm'/>
Nov 14 00:40:45 user nova-compute[74850]:     </mode>
Nov 14 00:40:45 user nova-compute[74850]:     <mode name='custom' supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>qemu64</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>qemu32</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>phenom</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>pentium3</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>pentium2</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>pentium</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>n270</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>kvm64</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>kvm32</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>coreduo</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>core2duo</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>athlon</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Westmere</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Snowridge</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Server</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Client</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>SandyBridge</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Penryn</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Opteron_G5</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Opteron_G4</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Opteron_G3</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Opteron_G2</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Opteron_G1</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Nehalem</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>IvyBridge</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Icelake-Server</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Haswell</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>EPYC-Rome</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>EPYC-Milan</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>EPYC</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Dhyana</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Cooperlake</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Conroe</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Broadwell</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>486</model>
Nov 14 00:40:45 user nova-compute[74850]:     </mode>
Nov 14 00:40:45 user nova-compute[74850]:   </cpu>
Nov 14 00:40:45 user nova-compute[74850]:   <memoryBacking supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:     <enum name='sourceType'>
Nov 14 00:40:45 user nova-compute[74850]:       <value>file</value>
Nov 14 00:40:45 user nova-compute[74850]:       <value>anonymous</value>
Nov 14 00:40:45 user nova-compute[74850]:       <value>memfd</value>
Nov 14 00:40:45 user nova-compute[74850]:     </enum>
Nov 14 00:40:45 user nova-compute[74850]:   </memoryBacking>
Nov 14 00:40:45 user nova-compute[74850]:   <devices>
Nov 14 00:40:45 user nova-compute[74850]:     <disk supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='diskDevice'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>disk</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>cdrom</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>floppy</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>lun</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='bus'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>ide</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>fdc</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>scsi</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>usb</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>sata</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='model'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio-transitional</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio-non-transitional</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </disk>
Nov 14 00:40:45 user nova-compute[74850]:     <graphics supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='type'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>sdl</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>vnc</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>spice</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>egl-headless</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </graphics>
Nov 14 00:40:45 user nova-compute[74850]:     <video supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='modelType'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>vga</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>cirrus</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>vmvga</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>qxl</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>none</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>bochs</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>ramfb</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </video>
Nov 14 00:40:45 user nova-compute[74850]:     <hostdev supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='mode'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>subsystem</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='startupPolicy'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>default</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>mandatory</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>requisite</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>optional</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='subsysType'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>usb</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>pci</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>scsi</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='capsType'/>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='pciBackend'/>
Nov 14 00:40:45 user nova-compute[74850]:     </hostdev>
Nov 14 00:40:45 user nova-compute[74850]:     <rng supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='model'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio-transitional</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio-non-transitional</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='backendModel'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>random</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>egd</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>builtin</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </rng>
Nov 14 00:40:45 user nova-compute[74850]:     <filesystem supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='driverType'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>path</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>handle</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtiofs</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </filesystem>
Nov 14 00:40:45 user nova-compute[74850]:     <tpm supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='model'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>tpm-tis</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>tpm-crb</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='backendModel'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>passthrough</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>emulator</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </tpm>
Nov 14 00:40:45 user nova-compute[74850]:   </devices>
Nov 14 00:40:45 user nova-compute[74850]:   <features>
Nov 14 00:40:45 user nova-compute[74850]:     <gic supported='no'/>
Nov 14 00:40:45 user nova-compute[74850]:     <vmcoreinfo supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:     <genid supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:     <backingStoreInput supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:     <backup supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:     <sev supported='no'/>
Nov 14 00:40:45 user nova-compute[74850]:   </features>
Nov 14 00:40:45 user nova-compute[74850]: </domainCapabilities>
Nov 14 00:40:45 user nova-compute[74850]:  {{(pid=74850) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 14 00:40:45 user nova-compute[74850]: <domainCapabilities>
Nov 14 00:40:45 user nova-compute[74850]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 00:40:45 user nova-compute[74850]:   <domain>kvm</domain>
Nov 14 00:40:45 user nova-compute[74850]:   <machine>pc-i440fx-jammy</machine>
Nov 14 00:40:45 user nova-compute[74850]:   <arch>i686</arch>
Nov 14 00:40:45 user nova-compute[74850]:   <vcpu max='255'/>
Nov 14 00:40:45 user nova-compute[74850]:   <iothreads supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:   <os supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:     <enum name='firmware'/>
Nov 14 00:40:45 user nova-compute[74850]:     <loader supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 00:40:45 user nova-compute[74850]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 00:40:45 user nova-compute[74850]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 00:40:45 user nova-compute[74850]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 00:40:45 user nova-compute[74850]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='type'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>rom</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>pflash</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='readonly'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>yes</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>no</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='secure'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>no</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </loader>
Nov 14 00:40:45 user nova-compute[74850]:   </os>
Nov 14 00:40:45 user nova-compute[74850]:   <cpu>
Nov 14 00:40:45 user nova-compute[74850]:     <mode name='host-passthrough' supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='hostPassthroughMigratable'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>off</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </mode>
Nov 14 00:40:45 user nova-compute[74850]:     <mode name='maximum' supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='maximumMigratable'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>on</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>off</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </mode>
Nov 14 00:40:45 user nova-compute[74850]:     <mode name='host-model' supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <vendor>Intel</vendor>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='ss'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='vmx'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='pcid'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='hypervisor'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='arat'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='umip'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='md-clear'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='stibp'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='ssbd'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='ibpb'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='ibrs'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='amd-stibp'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='disable' name='erms'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='disable' name='lm'/>
Nov 14 00:40:45 user nova-compute[74850]:     </mode>
Nov 14 00:40:45 user nova-compute[74850]:     <mode name='custom' supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>qemu64</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>qemu32</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>phenom</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>pentium3</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>pentium2</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>pentium</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>n270</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>kvm64</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>kvm32</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>coreduo</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>core2duo</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>athlon</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Westmere</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Snowridge</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Server</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Client</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>SandyBridge</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Penryn</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Opteron_G5</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Opteron_G4</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Opteron_G3</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Opteron_G2</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Opteron_G1</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Nehalem</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>IvyBridge</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Icelake-Server</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Haswell</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>EPYC-Rome</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>EPYC-Milan</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>EPYC</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Dhyana</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Cooperlake</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Conroe</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Broadwell</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>486</model>
Nov 14 00:40:45 user nova-compute[74850]:     </mode>
Nov 14 00:40:45 user nova-compute[74850]:   </cpu>
Nov 14 00:40:45 user nova-compute[74850]:   <memoryBacking supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:     <enum name='sourceType'>
Nov 14 00:40:45 user nova-compute[74850]:       <value>file</value>
Nov 14 00:40:45 user nova-compute[74850]:       <value>anonymous</value>
Nov 14 00:40:45 user nova-compute[74850]:       <value>memfd</value>
Nov 14 00:40:45 user nova-compute[74850]:     </enum>
Nov 14 00:40:45 user nova-compute[74850]:   </memoryBacking>
Nov 14 00:40:45 user nova-compute[74850]:   <devices>
Nov 14 00:40:45 user nova-compute[74850]:     <disk supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='diskDevice'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>disk</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>cdrom</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>floppy</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>lun</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='bus'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>ide</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>fdc</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>scsi</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>usb</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>sata</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='model'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio-transitional</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio-non-transitional</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </disk>
Nov 14 00:40:45 user nova-compute[74850]:     <graphics supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='type'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>sdl</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>vnc</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>spice</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>egl-headless</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </graphics>
Nov 14 00:40:45 user nova-compute[74850]:     <video supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='modelType'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>vga</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>cirrus</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>vmvga</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>qxl</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>none</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>bochs</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>ramfb</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </video>
Nov 14 00:40:45 user nova-compute[74850]:     <hostdev supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='mode'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>subsystem</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='startupPolicy'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>default</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>mandatory</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>requisite</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>optional</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='subsysType'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>usb</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>pci</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>scsi</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='capsType'/>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='pciBackend'/>
Nov 14 00:40:45 user nova-compute[74850]:     </hostdev>
Nov 14 00:40:45 user nova-compute[74850]:     <rng supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='model'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio-transitional</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio-non-transitional</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='backendModel'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>random</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>egd</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>builtin</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </rng>
Nov 14 00:40:45 user nova-compute[74850]:     <filesystem supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='driverType'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>path</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>handle</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtiofs</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </filesystem>
Nov 14 00:40:45 user nova-compute[74850]:     <tpm supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='model'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>tpm-tis</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>tpm-crb</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='backendModel'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>passthrough</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>emulator</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </tpm>
Nov 14 00:40:45 user nova-compute[74850]:   </devices>
Nov 14 00:40:45 user nova-compute[74850]:   <features>
Nov 14 00:40:45 user nova-compute[74850]:     <gic supported='no'/>
Nov 14 00:40:45 user nova-compute[74850]:     <vmcoreinfo supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:     <genid supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:     <backingStoreInput supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:     <backup supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:     <sev supported='no'/>
Nov 14 00:40:45 user nova-compute[74850]:   </features>
Nov 14 00:40:45 user nova-compute[74850]: </domainCapabilities>
Nov 14 00:40:45 user nova-compute[74850]:  {{(pid=74850) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 14 00:40:45 user nova-compute[74850]: <domainCapabilities>
Nov 14 00:40:45 user nova-compute[74850]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 00:40:45 user nova-compute[74850]:   <domain>kvm</domain>
Nov 14 00:40:45 user nova-compute[74850]:   <machine>pc-q35-jammy</machine>
Nov 14 00:40:45 user nova-compute[74850]:   <arch>i686</arch>
Nov 14 00:40:45 user nova-compute[74850]:   <vcpu max='288'/>
Nov 14 00:40:45 user nova-compute[74850]:   <iothreads supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:   <os supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:     <enum name='firmware'/>
Nov 14 00:40:45 user nova-compute[74850]:     <loader supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 00:40:45 user nova-compute[74850]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 00:40:45 user nova-compute[74850]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 00:40:45 user nova-compute[74850]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 00:40:45 user nova-compute[74850]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='type'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>rom</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>pflash</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='readonly'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>yes</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>no</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='secure'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>no</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </loader>
Nov 14 00:40:45 user nova-compute[74850]:   </os>
Nov 14 00:40:45 user nova-compute[74850]:   <cpu>
Nov 14 00:40:45 user nova-compute[74850]:     <mode name='host-passthrough' supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='hostPassthroughMigratable'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>off</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </mode>
Nov 14 00:40:45 user nova-compute[74850]:     <mode name='maximum' supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='maximumMigratable'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>on</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>off</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </mode>
Nov 14 00:40:45 user nova-compute[74850]:     <mode name='host-model' supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <vendor>Intel</vendor>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='ss'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='vmx'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='pcid'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='hypervisor'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='arat'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='umip'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='md-clear'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='stibp'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='ssbd'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='ibpb'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='ibrs'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='amd-stibp'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='disable' name='erms'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='disable' name='lm'/>
Nov 14 00:40:45 user nova-compute[74850]:     </mode>
Nov 14 00:40:45 user nova-compute[74850]:     <mode name='custom' supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>qemu64</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>qemu32</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>phenom</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>pentium3</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>pentium2</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>pentium</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>n270</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>kvm64</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>kvm32</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>coreduo</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>core2duo</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>athlon</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Westmere</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Snowridge</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Server</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Client</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>SandyBridge</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Penryn</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Opteron_G5</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Opteron_G4</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Opteron_G3</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Opteron_G2</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Opteron_G1</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Nehalem</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>IvyBridge</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Icelake-Server</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Haswell</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>EPYC-Rome</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>EPYC-Milan</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>EPYC</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Dhyana</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Cooperlake</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Conroe</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Broadwell</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>486</model>
Nov 14 00:40:45 user nova-compute[74850]:     </mode>
Nov 14 00:40:45 user nova-compute[74850]:   </cpu>
Nov 14 00:40:45 user nova-compute[74850]:   <memoryBacking supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:     <enum name='sourceType'>
Nov 14 00:40:45 user nova-compute[74850]:       <value>file</value>
Nov 14 00:40:45 user nova-compute[74850]:       <value>anonymous</value>
Nov 14 00:40:45 user nova-compute[74850]:       <value>memfd</value>
Nov 14 00:40:45 user nova-compute[74850]:     </enum>
Nov 14 00:40:45 user nova-compute[74850]:   </memoryBacking>
Nov 14 00:40:45 user nova-compute[74850]:   <devices>
Nov 14 00:40:45 user nova-compute[74850]:     <disk supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='diskDevice'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>disk</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>cdrom</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>floppy</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>lun</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='bus'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>fdc</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>scsi</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>usb</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>sata</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='model'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio-transitional</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio-non-transitional</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </disk>
Nov 14 00:40:45 user nova-compute[74850]:     <graphics supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='type'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>sdl</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>vnc</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>spice</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>egl-headless</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </graphics>
Nov 14 00:40:45 user nova-compute[74850]:     <video supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='modelType'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>vga</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>cirrus</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>vmvga</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>qxl</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>none</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>bochs</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>ramfb</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </video>
Nov 14 00:40:45 user nova-compute[74850]:     <hostdev supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='mode'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>subsystem</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='startupPolicy'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>default</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>mandatory</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>requisite</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>optional</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='subsysType'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>usb</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>pci</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>scsi</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='capsType'/>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='pciBackend'/>
Nov 14 00:40:45 user nova-compute[74850]:     </hostdev>
Nov 14 00:40:45 user nova-compute[74850]:     <rng supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='model'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio-transitional</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio-non-transitional</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='backendModel'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>random</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>egd</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>builtin</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </rng>
Nov 14 00:40:45 user nova-compute[74850]:     <filesystem supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='driverType'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>path</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>handle</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtiofs</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </filesystem>
Nov 14 00:40:45 user nova-compute[74850]:     <tpm supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='model'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>tpm-tis</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>tpm-crb</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='backendModel'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>passthrough</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>emulator</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </tpm>
Nov 14 00:40:45 user nova-compute[74850]:   </devices>
Nov 14 00:40:45 user nova-compute[74850]:   <features>
Nov 14 00:40:45 user nova-compute[74850]:     <gic supported='no'/>
Nov 14 00:40:45 user nova-compute[74850]:     <vmcoreinfo supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:     <genid supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:     <backingStoreInput supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:     <backup supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:     <sev supported='no'/>
Nov 14 00:40:45 user nova-compute[74850]:   </features>
Nov 14 00:40:45 user nova-compute[74850]: </domainCapabilities>
Nov 14 00:40:45 user nova-compute[74850]:  {{(pid=74850) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=74850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=74850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'pc', 'ubuntu', 'ubuntu-q35'} {{(pid=74850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 14 00:40:45 user nova-compute[74850]: <domainCapabilities>
Nov 14 00:40:45 user nova-compute[74850]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 00:40:45 user nova-compute[74850]:   <domain>kvm</domain>
Nov 14 00:40:45 user nova-compute[74850]:   <machine>pc-q35-6.2</machine>
Nov 14 00:40:45 user nova-compute[74850]:   <arch>x86_64</arch>
Nov 14 00:40:45 user nova-compute[74850]:   <vcpu max='288'/>
Nov 14 00:40:45 user nova-compute[74850]:   <iothreads supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:   <os supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:     <enum name='firmware'>
Nov 14 00:40:45 user nova-compute[74850]:       <value>efi</value>
Nov 14 00:40:45 user nova-compute[74850]:     </enum>
Nov 14 00:40:45 user nova-compute[74850]:     <loader supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 14 00:40:45 user nova-compute[74850]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 14 00:40:45 user nova-compute[74850]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='type'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>rom</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>pflash</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='readonly'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>yes</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>no</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='secure'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>yes</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>no</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </loader>
Nov 14 00:40:45 user nova-compute[74850]:   </os>
Nov 14 00:40:45 user nova-compute[74850]:   <cpu>
Nov 14 00:40:45 user nova-compute[74850]:     <mode name='host-passthrough' supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='hostPassthroughMigratable'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>on</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>off</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </mode>
Nov 14 00:40:45 user nova-compute[74850]:     <mode name='maximum' supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='maximumMigratable'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>on</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>off</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </mode>
Nov 14 00:40:45 user nova-compute[74850]:     <mode name='host-model' supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <vendor>Intel</vendor>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='ss'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='vmx'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='pcid'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='hypervisor'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='arat'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='umip'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='md-clear'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='stibp'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='ssbd'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='invtsc'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='ibpb'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='ibrs'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='amd-stibp'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='rsba'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='disable' name='erms'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 00:40:45 user nova-compute[74850]:     </mode>
Nov 14 00:40:45 user nova-compute[74850]:     <mode name='custom' supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>qemu64</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>qemu32</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>phenom</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>pentium3</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>pentium2</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>pentium</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>n270</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>kvm64</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>kvm32</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>coreduo</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>core2duo</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>athlon</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>Westmere</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Snowridge</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Server</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Client</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>SandyBridge</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>Penryn</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Opteron_G5</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Opteron_G4</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Opteron_G3</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Opteron_G2</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>Opteron_G1</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>Nehalem</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>IvyBridge</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Icelake-Server</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Haswell</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>EPYC-Rome</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>EPYC-Milan</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>EPYC</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Dhyana</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Cooperlake</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>Conroe</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Broadwell</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>486</model>
Nov 14 00:40:45 user nova-compute[74850]:     </mode>
Nov 14 00:40:45 user nova-compute[74850]:   </cpu>
Nov 14 00:40:45 user nova-compute[74850]:   <memoryBacking supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:     <enum name='sourceType'>
Nov 14 00:40:45 user nova-compute[74850]:       <value>file</value>
Nov 14 00:40:45 user nova-compute[74850]:       <value>anonymous</value>
Nov 14 00:40:45 user nova-compute[74850]:       <value>memfd</value>
Nov 14 00:40:45 user nova-compute[74850]:     </enum>
Nov 14 00:40:45 user nova-compute[74850]:   </memoryBacking>
Nov 14 00:40:45 user nova-compute[74850]:   <devices>
Nov 14 00:40:45 user nova-compute[74850]:     <disk supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='diskDevice'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>disk</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>cdrom</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>floppy</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>lun</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='bus'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>fdc</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>scsi</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>usb</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>sata</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='model'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio-transitional</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio-non-transitional</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </disk>
Nov 14 00:40:45 user nova-compute[74850]:     <graphics supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='type'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>sdl</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>vnc</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>spice</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>egl-headless</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </graphics>
Nov 14 00:40:45 user nova-compute[74850]:     <video supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='modelType'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>vga</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>cirrus</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>vmvga</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>qxl</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>none</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>bochs</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>ramfb</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </video>
Nov 14 00:40:45 user nova-compute[74850]:     <hostdev supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='mode'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>subsystem</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='startupPolicy'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>default</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>mandatory</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>requisite</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>optional</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='subsysType'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>usb</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>pci</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>scsi</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='capsType'/>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='pciBackend'/>
Nov 14 00:40:45 user nova-compute[74850]:     </hostdev>
Nov 14 00:40:45 user nova-compute[74850]:     <rng supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='model'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio-transitional</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio-non-transitional</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='backendModel'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>random</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>egd</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>builtin</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </rng>
Nov 14 00:40:45 user nova-compute[74850]:     <filesystem supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='driverType'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>path</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>handle</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtiofs</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </filesystem>
Nov 14 00:40:45 user nova-compute[74850]:     <tpm supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='model'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>tpm-tis</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>tpm-crb</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='backendModel'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>passthrough</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>emulator</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </tpm>
Nov 14 00:40:45 user nova-compute[74850]:   </devices>
Nov 14 00:40:45 user nova-compute[74850]:   <features>
Nov 14 00:40:45 user nova-compute[74850]:     <gic supported='no'/>
Nov 14 00:40:45 user nova-compute[74850]:     <vmcoreinfo supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:     <genid supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:     <backingStoreInput supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:     <backup supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:     <sev supported='no'/>
Nov 14 00:40:45 user nova-compute[74850]:   </features>
Nov 14 00:40:45 user nova-compute[74850]: </domainCapabilities>
Nov 14 00:40:45 user nova-compute[74850]:  {{(pid=74850) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 14 00:40:45 user nova-compute[74850]: <domainCapabilities>
Nov 14 00:40:45 user nova-compute[74850]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 00:40:45 user nova-compute[74850]:   <domain>kvm</domain>
Nov 14 00:40:45 user nova-compute[74850]:   <machine>pc-i440fx-6.2</machine>
Nov 14 00:40:45 user nova-compute[74850]:   <arch>x86_64</arch>
Nov 14 00:40:45 user nova-compute[74850]:   <vcpu max='255'/>
Nov 14 00:40:45 user nova-compute[74850]:   <iothreads supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:   <os supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:     <enum name='firmware'>
Nov 14 00:40:45 user nova-compute[74850]:       <value>efi</value>
Nov 14 00:40:45 user nova-compute[74850]:     </enum>
Nov 14 00:40:45 user nova-compute[74850]:     <loader supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='type'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>rom</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>pflash</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='readonly'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>yes</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>no</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='secure'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>no</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </loader>
Nov 14 00:40:45 user nova-compute[74850]:   </os>
Nov 14 00:40:45 user nova-compute[74850]:   <cpu>
Nov 14 00:40:45 user nova-compute[74850]:     <mode name='host-passthrough' supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='hostPassthroughMigratable'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>on</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>off</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </mode>
Nov 14 00:40:45 user nova-compute[74850]:     <mode name='maximum' supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='maximumMigratable'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>on</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>off</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </mode>
Nov 14 00:40:45 user nova-compute[74850]:     <mode name='host-model' supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <vendor>Intel</vendor>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='ss'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='vmx'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='pcid'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='hypervisor'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='arat'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='umip'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='md-clear'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='stibp'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='ssbd'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='invtsc'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='ibpb'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='ibrs'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='amd-stibp'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='rsba'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='disable' name='erms'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 00:40:45 user nova-compute[74850]:     </mode>
Nov 14 00:40:45 user nova-compute[74850]:     <mode name='custom' supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>qemu64</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>qemu32</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>phenom</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>pentium3</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>pentium2</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>pentium</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>n270</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>kvm64</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>kvm32</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>coreduo</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>core2duo</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>athlon</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>Westmere</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Snowridge</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Server</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Client</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>SandyBridge</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>Penryn</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Opteron_G5</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Opteron_G4</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Opteron_G3</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Opteron_G2</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>Opteron_G1</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>Nehalem</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>IvyBridge</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Icelake-Server</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Haswell</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>EPYC-Rome</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>EPYC-Milan</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>EPYC</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Dhyana</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Cooperlake</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>Conroe</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Broadwell</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>486</model>
Nov 14 00:40:45 user nova-compute[74850]:     </mode>
Nov 14 00:40:45 user nova-compute[74850]:   </cpu>
Nov 14 00:40:45 user nova-compute[74850]:   <memoryBacking supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:     <enum name='sourceType'>
Nov 14 00:40:45 user nova-compute[74850]:       <value>file</value>
Nov 14 00:40:45 user nova-compute[74850]:       <value>anonymous</value>
Nov 14 00:40:45 user nova-compute[74850]:       <value>memfd</value>
Nov 14 00:40:45 user nova-compute[74850]:     </enum>
Nov 14 00:40:45 user nova-compute[74850]:   </memoryBacking>
Nov 14 00:40:45 user nova-compute[74850]:   <devices>
Nov 14 00:40:45 user nova-compute[74850]:     <disk supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='diskDevice'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>disk</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>cdrom</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>floppy</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>lun</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='bus'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>ide</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>fdc</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>scsi</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>usb</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>sata</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='model'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio-transitional</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio-non-transitional</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </disk>
Nov 14 00:40:45 user nova-compute[74850]:     <graphics supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='type'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>sdl</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>vnc</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>spice</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>egl-headless</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </graphics>
Nov 14 00:40:45 user nova-compute[74850]:     <video supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='modelType'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>vga</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>cirrus</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>vmvga</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>qxl</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>none</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>bochs</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>ramfb</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </video>
Nov 14 00:40:45 user nova-compute[74850]:     <hostdev supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='mode'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>subsystem</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='startupPolicy'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>default</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>mandatory</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>requisite</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>optional</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='subsysType'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>usb</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>pci</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>scsi</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='capsType'/>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='pciBackend'/>
Nov 14 00:40:45 user nova-compute[74850]:     </hostdev>
Nov 14 00:40:45 user nova-compute[74850]:     <rng supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='model'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio-transitional</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio-non-transitional</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='backendModel'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>random</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>egd</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>builtin</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </rng>
Nov 14 00:40:45 user nova-compute[74850]:     <filesystem supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='driverType'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>path</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>handle</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtiofs</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </filesystem>
Nov 14 00:40:45 user nova-compute[74850]:     <tpm supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='model'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>tpm-tis</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>tpm-crb</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='backendModel'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>passthrough</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>emulator</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </tpm>
Nov 14 00:40:45 user nova-compute[74850]:   </devices>
Nov 14 00:40:45 user nova-compute[74850]:   <features>
Nov 14 00:40:45 user nova-compute[74850]:     <gic supported='no'/>
Nov 14 00:40:45 user nova-compute[74850]:     <vmcoreinfo supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:     <genid supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:     <backingStoreInput supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:     <backup supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:     <sev supported='no'/>
Nov 14 00:40:45 user nova-compute[74850]:   </features>
Nov 14 00:40:45 user nova-compute[74850]: </domainCapabilities>
Nov 14 00:40:45 user nova-compute[74850]:  {{(pid=74850) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 14 00:40:45 user nova-compute[74850]: <domainCapabilities>
Nov 14 00:40:45 user nova-compute[74850]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 00:40:45 user nova-compute[74850]:   <domain>kvm</domain>
Nov 14 00:40:45 user nova-compute[74850]:   <machine>pc-i440fx-jammy</machine>
Nov 14 00:40:45 user nova-compute[74850]:   <arch>x86_64</arch>
Nov 14 00:40:45 user nova-compute[74850]:   <vcpu max='255'/>
Nov 14 00:40:45 user nova-compute[74850]:   <iothreads supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:   <os supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:     <enum name='firmware'>
Nov 14 00:40:45 user nova-compute[74850]:       <value>efi</value>
Nov 14 00:40:45 user nova-compute[74850]:     </enum>
Nov 14 00:40:45 user nova-compute[74850]:     <loader supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='type'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>rom</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>pflash</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='readonly'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>yes</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>no</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='secure'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>no</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </loader>
Nov 14 00:40:45 user nova-compute[74850]:   </os>
Nov 14 00:40:45 user nova-compute[74850]:   <cpu>
Nov 14 00:40:45 user nova-compute[74850]:     <mode name='host-passthrough' supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='hostPassthroughMigratable'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>on</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>off</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </mode>
Nov 14 00:40:45 user nova-compute[74850]:     <mode name='maximum' supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='maximumMigratable'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>on</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>off</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </mode>
Nov 14 00:40:45 user nova-compute[74850]:     <mode name='host-model' supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <vendor>Intel</vendor>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='ss'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='vmx'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='pcid'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='hypervisor'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='arat'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='umip'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='md-clear'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='stibp'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='ssbd'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='invtsc'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='ibpb'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='ibrs'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='amd-stibp'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='rsba'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='disable' name='erms'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 00:40:45 user nova-compute[74850]:     </mode>
Nov 14 00:40:45 user nova-compute[74850]:     <mode name='custom' supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>qemu64</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>qemu32</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>phenom</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>pentium3</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>pentium2</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>pentium</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>n270</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>kvm64</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>kvm32</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>coreduo</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>core2duo</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>athlon</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>Westmere</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Snowridge</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Server</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Client</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>SandyBridge</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>Penryn</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Opteron_G5</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Opteron_G4</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Opteron_G3</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Opteron_G2</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>Opteron_G1</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>Nehalem</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>IvyBridge</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Icelake-Server</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Haswell</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>EPYC-Rome</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>EPYC-Milan</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>EPYC</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Dhyana</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Cooperlake</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>Conroe</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Broadwell</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>486</model>
Nov 14 00:40:45 user nova-compute[74850]:     </mode>
Nov 14 00:40:45 user nova-compute[74850]:   </cpu>
Nov 14 00:40:45 user nova-compute[74850]:   <memoryBacking supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:     <enum name='sourceType'>
Nov 14 00:40:45 user nova-compute[74850]:       <value>file</value>
Nov 14 00:40:45 user nova-compute[74850]:       <value>anonymous</value>
Nov 14 00:40:45 user nova-compute[74850]:       <value>memfd</value>
Nov 14 00:40:45 user nova-compute[74850]:     </enum>
Nov 14 00:40:45 user nova-compute[74850]:   </memoryBacking>
Nov 14 00:40:45 user nova-compute[74850]:   <devices>
Nov 14 00:40:45 user nova-compute[74850]:     <disk supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='diskDevice'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>disk</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>cdrom</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>floppy</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>lun</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='bus'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>ide</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>fdc</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>scsi</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>usb</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>sata</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='model'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio-transitional</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio-non-transitional</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </disk>
Nov 14 00:40:45 user nova-compute[74850]:     <graphics supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='type'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>sdl</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>vnc</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>spice</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>egl-headless</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </graphics>
Nov 14 00:40:45 user nova-compute[74850]:     <video supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='modelType'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>vga</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>cirrus</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>vmvga</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>qxl</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>none</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>bochs</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>ramfb</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </video>
Nov 14 00:40:45 user nova-compute[74850]:     <hostdev supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='mode'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>subsystem</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='startupPolicy'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>default</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>mandatory</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>requisite</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>optional</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='subsysType'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>usb</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>pci</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>scsi</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='capsType'/>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='pciBackend'/>
Nov 14 00:40:45 user nova-compute[74850]:     </hostdev>
Nov 14 00:40:45 user nova-compute[74850]:     <rng supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='model'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio-transitional</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio-non-transitional</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='backendModel'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>random</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>egd</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>builtin</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </rng>
Nov 14 00:40:45 user nova-compute[74850]:     <filesystem supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='driverType'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>path</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>handle</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtiofs</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </filesystem>
Nov 14 00:40:45 user nova-compute[74850]:     <tpm supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='model'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>tpm-tis</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>tpm-crb</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='backendModel'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>passthrough</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>emulator</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </tpm>
Nov 14 00:40:45 user nova-compute[74850]:   </devices>
Nov 14 00:40:45 user nova-compute[74850]:   <features>
Nov 14 00:40:45 user nova-compute[74850]:     <gic supported='no'/>
Nov 14 00:40:45 user nova-compute[74850]:     <vmcoreinfo supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:     <genid supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:     <backingStoreInput supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:     <backup supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:     <sev supported='no'/>
Nov 14 00:40:45 user nova-compute[74850]:   </features>
Nov 14 00:40:45 user nova-compute[74850]: </domainCapabilities>
Nov 14 00:40:45 user nova-compute[74850]:  {{(pid=74850) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 14 00:40:45 user nova-compute[74850]: <domainCapabilities>
Nov 14 00:40:45 user nova-compute[74850]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 00:40:45 user nova-compute[74850]:   <domain>kvm</domain>
Nov 14 00:40:45 user nova-compute[74850]:   <machine>pc-q35-jammy</machine>
Nov 14 00:40:45 user nova-compute[74850]:   <arch>x86_64</arch>
Nov 14 00:40:45 user nova-compute[74850]:   <vcpu max='288'/>
Nov 14 00:40:45 user nova-compute[74850]:   <iothreads supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:   <os supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:     <enum name='firmware'>
Nov 14 00:40:45 user nova-compute[74850]:       <value>efi</value>
Nov 14 00:40:45 user nova-compute[74850]:     </enum>
Nov 14 00:40:45 user nova-compute[74850]:     <loader supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 14 00:40:45 user nova-compute[74850]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 14 00:40:45 user nova-compute[74850]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='type'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>rom</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>pflash</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='readonly'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>yes</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>no</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='secure'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>yes</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>no</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </loader>
Nov 14 00:40:45 user nova-compute[74850]:   </os>
Nov 14 00:40:45 user nova-compute[74850]:   <cpu>
Nov 14 00:40:45 user nova-compute[74850]:     <mode name='host-passthrough' supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='hostPassthroughMigratable'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>on</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>off</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </mode>
Nov 14 00:40:45 user nova-compute[74850]:     <mode name='maximum' supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='maximumMigratable'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>on</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>off</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </mode>
Nov 14 00:40:45 user nova-compute[74850]:     <mode name='host-model' supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <vendor>Intel</vendor>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='ss'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='vmx'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='pcid'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='hypervisor'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='arat'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='umip'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='md-clear'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='stibp'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='ssbd'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='invtsc'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='ibpb'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='ibrs'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='amd-stibp'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='rsba'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='disable' name='erms'/>
Nov 14 00:40:45 user nova-compute[74850]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 00:40:45 user nova-compute[74850]:     </mode>
Nov 14 00:40:45 user nova-compute[74850]:     <mode name='custom' supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>qemu64</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>qemu32</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>phenom</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>pentium3</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>pentium2</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>pentium</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>n270</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>kvm64</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>kvm32</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>coreduo</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>core2duo</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>athlon</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>Westmere</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Snowridge</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Server</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Skylake-Client</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>SandyBridge</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>Penryn</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Opteron_G5</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Opteron_G4</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Opteron_G3</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Opteron_G2</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>Opteron_G1</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>Nehalem</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>IvyBridge</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Icelake-Server</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Haswell</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>EPYC-Rome</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>EPYC-Milan</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>EPYC</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Dhyana</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Cooperlake</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>Conroe</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='no'>Broadwell</model>
Nov 14 00:40:45 user nova-compute[74850]:       <model usable='yes'>486</model>
Nov 14 00:40:45 user nova-compute[74850]:     </mode>
Nov 14 00:40:45 user nova-compute[74850]:   </cpu>
Nov 14 00:40:45 user nova-compute[74850]:   <memoryBacking supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:     <enum name='sourceType'>
Nov 14 00:40:45 user nova-compute[74850]:       <value>file</value>
Nov 14 00:40:45 user nova-compute[74850]:       <value>anonymous</value>
Nov 14 00:40:45 user nova-compute[74850]:       <value>memfd</value>
Nov 14 00:40:45 user nova-compute[74850]:     </enum>
Nov 14 00:40:45 user nova-compute[74850]:   </memoryBacking>
Nov 14 00:40:45 user nova-compute[74850]:   <devices>
Nov 14 00:40:45 user nova-compute[74850]:     <disk supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='diskDevice'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>disk</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>cdrom</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>floppy</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>lun</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='bus'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>fdc</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>scsi</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>usb</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>sata</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='model'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio-transitional</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio-non-transitional</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </disk>
Nov 14 00:40:45 user nova-compute[74850]:     <graphics supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='type'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>sdl</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>vnc</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>spice</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>egl-headless</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </graphics>
Nov 14 00:40:45 user nova-compute[74850]:     <video supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='modelType'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>vga</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>cirrus</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>vmvga</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>qxl</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>none</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>bochs</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>ramfb</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </video>
Nov 14 00:40:45 user nova-compute[74850]:     <hostdev supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='mode'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>subsystem</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='startupPolicy'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>default</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>mandatory</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>requisite</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>optional</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='subsysType'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>usb</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>pci</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>scsi</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='capsType'/>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='pciBackend'/>
Nov 14 00:40:45 user nova-compute[74850]:     </hostdev>
Nov 14 00:40:45 user nova-compute[74850]:     <rng supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='model'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio-transitional</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtio-non-transitional</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='backendModel'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>random</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>egd</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>builtin</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </rng>
Nov 14 00:40:45 user nova-compute[74850]:     <filesystem supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='driverType'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>path</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>handle</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>virtiofs</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </filesystem>
Nov 14 00:40:45 user nova-compute[74850]:     <tpm supported='yes'>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='model'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>tpm-tis</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>tpm-crb</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:       <enum name='backendModel'>
Nov 14 00:40:45 user nova-compute[74850]:         <value>passthrough</value>
Nov 14 00:40:45 user nova-compute[74850]:         <value>emulator</value>
Nov 14 00:40:45 user nova-compute[74850]:       </enum>
Nov 14 00:40:45 user nova-compute[74850]:     </tpm>
Nov 14 00:40:45 user nova-compute[74850]:   </devices>
Nov 14 00:40:45 user nova-compute[74850]:   <features>
Nov 14 00:40:45 user nova-compute[74850]:     <gic supported='no'/>
Nov 14 00:40:45 user nova-compute[74850]:     <vmcoreinfo supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:     <genid supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:     <backingStoreInput supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:     <backup supported='yes'/>
Nov 14 00:40:45 user nova-compute[74850]:     <sev supported='no'/>
Nov 14 00:40:45 user nova-compute[74850]:   </features>
Nov 14 00:40:45 user nova-compute[74850]: </domainCapabilities>
Nov 14 00:40:45 user nova-compute[74850]:  {{(pid=74850) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Checking secure boot support for host arch (x86_64) {{(pid=74850) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 14 00:40:45 user nova-compute[74850]: INFO nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Secure Boot support detected
Nov 14 00:40:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] cpu compare xml: <cpu match="exact">
Nov 14 00:40:45 user nova-compute[74850]:   <model>Nehalem</model>
Nov 14 00:40:45 user nova-compute[74850]: </cpu>
Nov 14 00:40:45 user nova-compute[74850]:  {{(pid=74850) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 14 00:40:45 user nova-compute[74850]: INFO nova.virt.node [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Generated node identity fe703abb-f68c-420d-a7f0-bf5240e23c54
Nov 14 00:40:45 user nova-compute[74850]: INFO nova.virt.node [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Wrote node identity fe703abb-f68c-420d-a7f0-bf5240e23c54 to /opt/stack/data/nova/compute_id
Nov 14 00:40:45 user nova-compute[74850]: WARNING nova.compute.manager [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Compute nodes ['fe703abb-f68c-420d-a7f0-bf5240e23c54'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 14 00:40:46 user nova-compute[74850]: INFO nova.compute.manager [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 14 00:40:46 user nova-compute[74850]: WARNING nova.compute.manager [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 14 00:40:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:40:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:40:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:40:46 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 00:40:46 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:40:46 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:40:46 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Hypervisor/Node resource view: name=user free_ram=10991MB free_disk=26.108871459960938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 00:40:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:40:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:40:46 user nova-compute[74850]: WARNING nova.compute.resource_tracker [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] No compute node record for user:fe703abb-f68c-420d-a7f0-bf5240e23c54: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host fe703abb-f68c-420d-a7f0-bf5240e23c54 could not be found.
Nov 14 00:40:46 user nova-compute[74850]: INFO nova.compute.resource_tracker [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Compute node record created for user:user with uuid: fe703abb-f68c-420d-a7f0-bf5240e23c54
Nov 14 00:40:46 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 00:40:46 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 00:40:46 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] [req-7fe191f6-c82f-44c8-bba5-4f10191b4842] Created resource provider record via placement API for resource provider with UUID fe703abb-f68c-420d-a7f0-bf5240e23c54 and name user.
Nov 14 00:40:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74850) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 14 00:40:46 user nova-compute[74850]: INFO nova.virt.libvirt.host [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] kernel doesn't support AMD SEV
Nov 14 00:40:46 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Updating inventory in ProviderTree for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 00:40:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:40:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Libvirt baseline CPU <cpu>
Nov 14 00:40:46 user nova-compute[74850]:   <arch>x86_64</arch>
Nov 14 00:40:46 user nova-compute[74850]:   <model>Nehalem</model>
Nov 14 00:40:46 user nova-compute[74850]:   <vendor>Intel</vendor>
Nov 14 00:40:46 user nova-compute[74850]:   <topology sockets="6" cores="1" threads="1"/>
Nov 14 00:40:46 user nova-compute[74850]: </cpu>
Nov 14 00:40:46 user nova-compute[74850]:  {{(pid=74850) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 14 00:40:46 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Updated inventory for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 14 00:40:46 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Updating resource provider fe703abb-f68c-420d-a7f0-bf5240e23c54 generation from 0 to 1 during operation: update_inventory {{(pid=74850) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 14 00:40:46 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Updating inventory in ProviderTree for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 00:40:47 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Updating resource provider fe703abb-f68c-420d-a7f0-bf5240e23c54 generation from 1 to 2 during operation: update_traits {{(pid=74850) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 14 00:40:47 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 00:40:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.608s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:40:47 user nova-compute[74850]: DEBUG nova.service [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Creating RPC server for service compute {{(pid=74850) start /opt/stack/nova/nova/service.py:182}}
Nov 14 00:40:47 user nova-compute[74850]: DEBUG nova.service [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] Join ServiceGroup membership for this service compute {{(pid=74850) start /opt/stack/nova/nova/service.py:199}}
Nov 14 00:40:47 user nova-compute[74850]: DEBUG nova.servicegroup.drivers.db [None req-3fce4936-ae20-4d27-a1b5-433a26a6d141 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74850) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 14 00:40:47 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:40:47 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:41:37 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:41:37 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:41:37 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 00:41:37 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Rebuilding the list of instances to heal {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 00:41:37 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Didn't find any instances for network info cache update. {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 00:41:37 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:41:37 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:41:37 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:41:37 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:41:37 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:41:37 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:41:37 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 00:41:37 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:41:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:41:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:41:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:41:37 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 00:41:38 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:41:38 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:41:38 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=10411MB free_disk=26.01266860961914GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 00:41:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:41:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:41:38 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 00:41:38 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 00:41:38 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:41:38 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:41:38 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 00:41:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:42:38 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:42:38 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:42:38 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:42:38 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 00:42:38 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:42:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:42:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:42:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:42:38 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 00:42:38 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:42:38 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:42:38 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=10369MB free_disk=26.07703399658203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 00:42:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:42:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:42:38 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 00:42:38 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 00:42:38 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:42:38 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:42:38 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 00:42:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:42:39 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:42:39 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:42:39 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:42:39 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:42:39 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:42:39 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 00:42:39 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Rebuilding the list of instances to heal {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 00:42:39 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Didn't find any instances for network info cache update. {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 00:42:39 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:43:37 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:43:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:43:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:43:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:43:37 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 00:43:38 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:43:38 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:43:38 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=10355MB free_disk=25.829540252685547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 00:43:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:43:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:43:38 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 00:43:38 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 00:43:38 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:43:38 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:43:38 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 00:43:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:43:39 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:43:39 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:43:39 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:43:39 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:43:39 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 00:43:40 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:43:40 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:43:40 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 00:43:40 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Rebuilding the list of instances to heal {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 00:43:40 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Didn't find any instances for network info cache update. {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 00:43:40 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:43:40 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:44:37 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:44:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:44:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:44:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:44:37 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 00:44:38 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:44:38 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:44:38 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=9653MB free_disk=25.849754333496094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 00:44:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:44:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:44:38 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 00:44:38 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 00:44:38 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:44:38 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:44:38 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 00:44:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.269s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:44:39 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:44:39 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:44:40 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:44:40 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 00:44:40 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Rebuilding the list of instances to heal {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 00:44:40 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Didn't find any instances for network info cache update. {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 00:44:40 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:44:40 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:44:40 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:44:40 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 00:44:41 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:44:41 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:44:41 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:44:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:44:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:44:44 user nova-compute[74850]: DEBUG nova.compute.manager [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 00:44:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:44:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:44:44 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 00:44:44 user nova-compute[74850]: INFO nova.compute.claims [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Claim successful on node user
Nov 14 00:44:45 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:44:45 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:44:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.481s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:44:45 user nova-compute[74850]: DEBUG nova.compute.manager [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 00:44:45 user nova-compute[74850]: DEBUG nova.compute.manager [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 00:44:45 user nova-compute[74850]: DEBUG nova.network.neutron [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 00:44:45 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 00:44:45 user nova-compute[74850]: DEBUG nova.compute.manager [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 00:44:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Acquiring lock "1282f7f3-c81e-4a6e-bd86-42459f49674f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:44:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Lock "1282f7f3-c81e-4a6e-bd86-42459f49674f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:44:45 user nova-compute[74850]: DEBUG nova.compute.manager [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 00:44:45 user nova-compute[74850]: DEBUG nova.compute.manager [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 00:44:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 00:44:45 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Creating image(s)
Nov 14 00:44:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "/opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:44:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "/opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:44:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "/opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:44:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:44:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:44:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:44:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:44:45 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 00:44:45 user nova-compute[74850]: INFO nova.compute.claims [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Claim successful on node user
Nov 14 00:44:45 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:44:45 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:44:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.270s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:44:45 user nova-compute[74850]: DEBUG nova.compute.manager [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 00:44:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549.part --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:44:46 user nova-compute[74850]: DEBUG nova.policy [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '84158c07e3344e01bf82e0e25e2a7244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933e8bc63bd442d882ff59243bd7faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 00:44:46 user nova-compute[74850]: DEBUG nova.compute.manager [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 00:44:46 user nova-compute[74850]: DEBUG nova.network.neutron [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 00:44:46 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 00:44:46 user nova-compute[74850]: DEBUG nova.compute.manager [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 00:44:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549.part --force-share --output=json" returned: 0 in 0.164s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:44:46 user nova-compute[74850]: DEBUG nova.virt.images [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] 5ed46099-4abf-4916-8deb-e38edb515c26 was qcow2, converting to raw {{(pid=74850) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 00:44:46 user nova-compute[74850]: DEBUG nova.privsep.utils [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74850) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 00:44:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549.part /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549.converted {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:44:46 user nova-compute[74850]: DEBUG nova.compute.manager [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 00:44:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 00:44:46 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Creating image(s)
Nov 14 00:44:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Acquiring lock "/opt/stack/data/nova/instances/1282f7f3-c81e-4a6e-bd86-42459f49674f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:44:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Lock "/opt/stack/data/nova/instances/1282f7f3-c81e-4a6e-bd86-42459f49674f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:44:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Lock "/opt/stack/data/nova/instances/1282f7f3-c81e-4a6e-bd86-42459f49674f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:44:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:44:46 user nova-compute[74850]: DEBUG nova.policy [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '951c453212bf442795089fc1f59199ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfd43e655ec42eebeae8f1b379138cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 00:44:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549.part /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549.converted" returned: 0 in 0.287s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:44:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549.converted --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:44:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549.converted --force-share --output=json" returned: 0 in 0.170s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:44:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.263s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:44:46 user nova-compute[74850]: INFO oslo.privsep.daemon [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp6jjbuuiw/privsep.sock']
Nov 14 00:44:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.234s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:44:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:44:46 user sudo[84108]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp6jjbuuiw/privsep.sock
Nov 14 00:44:46 user sudo[84108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 00:44:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "1879be4c-9226-4c8c-a56c-f8e37398851b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:44:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "1879be4c-9226-4c8c-a56c-f8e37398851b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:44:47 user nova-compute[74850]: DEBUG nova.compute.manager [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 00:44:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:44:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:44:47 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 00:44:47 user nova-compute[74850]: INFO nova.compute.claims [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Claim successful on node user
Nov 14 00:44:47 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:44:47 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:44:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.285s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:44:47 user nova-compute[74850]: DEBUG nova.compute.manager [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 00:44:47 user nova-compute[74850]: DEBUG nova.compute.manager [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 00:44:47 user nova-compute[74850]: DEBUG nova.network.neutron [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 00:44:47 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 00:44:47 user nova-compute[74850]: DEBUG nova.compute.manager [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 00:44:47 user nova-compute[74850]: DEBUG nova.compute.manager [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 00:44:47 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 00:44:47 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Creating image(s)
Nov 14 00:44:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "/opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:44:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "/opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:44:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "/opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:44:48 user nova-compute[74850]: DEBUG nova.policy [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '84158c07e3344e01bf82e0e25e2a7244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933e8bc63bd442d882ff59243bd7faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 00:44:48 user sudo[84108]: pam_unix(sudo:session): session closed for user root
Nov 14 00:44:48 user nova-compute[74850]: INFO oslo.privsep.daemon [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Spawned new privsep daemon via rootwrap
Nov 14 00:44:48 user nova-compute[74850]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 00:44:48 user nova-compute[74850]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 00:44:48 user nova-compute[74850]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 14 00:44:48 user nova-compute[74850]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84115
Nov 14 00:44:48 user nova-compute[74850]: WARNING oslo_privsep.priv_context [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] privsep daemon already running
Nov 14 00:44:48 user nova-compute[74850]: WARNING oslo_privsep.priv_context [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] privsep daemon already running
Nov 14 00:44:48 user nova-compute[74850]: DEBUG nova.network.neutron [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Successfully created port: 792bf62b-99b4-4d65-a55b-4e97c64eb1c5 {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:44:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:44:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:44:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:44:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.188s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:44:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:44:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:44:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:44:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.163s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:44:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:44:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.201s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:44:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:44:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.163s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:44:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/1282f7f3-c81e-4a6e-bd86-42459f49674f/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:44:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/1282f7f3-c81e-4a6e-bd86-42459f49674f/disk 1073741824" returned: 0 in 0.053s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:44:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:44:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:44:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.215s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:44:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:44:48 user nova-compute[74850]: DEBUG nova.network.neutron [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Successfully created port: f0de03a3-fd19-4cd1-a408-5168dcf267d7 {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:44:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.169s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:44:48 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1282f7f3-c81e-4a6e-bd86-42459f49674f/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 00:44:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1282f7f3-c81e-4a6e-bd86-42459f49674f/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:44:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.168s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:44:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:44:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk 1073741824" returned: 0 in 0.049s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:44:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:44:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:44:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.465s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:44:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:44:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1282f7f3-c81e-4a6e-bd86-42459f49674f/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:44:48 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Cannot resize image /opt/stack/data/nova/instances/1282f7f3-c81e-4a6e-bd86-42459f49674f/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 00:44:48 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 00:44:48 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Ensure instance console log exists: /opt/stack/data/nova/instances/1282f7f3-c81e-4a6e-bd86-42459f49674f/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 00:44:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:44:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:44:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:44:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.190s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:44:49 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 00:44:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:44:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.185s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:44:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:44:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk 1073741824" returned: 0 in 0.074s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:44:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:44:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:44:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:44:49 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Cannot resize image /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 00:44:49 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 00:44:49 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Ensure instance console log exists: /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 00:44:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:44:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:44:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:44:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.163s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:44:49 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 00:44:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:44:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:44:49 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Cannot resize image /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 00:44:49 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 00:44:49 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Ensure instance console log exists: /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 00:44:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:44:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:44:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:44:50 user nova-compute[74850]: DEBUG nova.network.neutron [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Successfully updated port: 792bf62b-99b4-4d65-a55b-4e97c64eb1c5 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:44:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Acquiring lock "refresh_cache-1282f7f3-c81e-4a6e-bd86-42459f49674f" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:44:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Acquired lock "refresh_cache-1282f7f3-c81e-4a6e-bd86-42459f49674f" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:44:50 user nova-compute[74850]: DEBUG nova.network.neutron [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG nova.network.neutron [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG nova.compute.manager [req-00112ef6-70fd-41ac-8a71-a79783ab14ba req-46994423-0892-447a-9705-db8d1e02e343 service nova] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Received event network-changed-792bf62b-99b4-4d65-a55b-4e97c64eb1c5 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG nova.compute.manager [req-00112ef6-70fd-41ac-8a71-a79783ab14ba req-46994423-0892-447a-9705-db8d1e02e343 service nova] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Refreshing instance network info cache due to event network-changed-792bf62b-99b4-4d65-a55b-4e97c64eb1c5. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-00112ef6-70fd-41ac-8a71-a79783ab14ba req-46994423-0892-447a-9705-db8d1e02e343 service nova] Acquiring lock "refresh_cache-1282f7f3-c81e-4a6e-bd86-42459f49674f" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG nova.network.neutron [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Successfully created port: ff543781-9ab0-418a-ab62-1a74ee0ed1a9 {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG nova.network.neutron [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Updating instance_info_cache with network_info: [{"id": "792bf62b-99b4-4d65-a55b-4e97c64eb1c5", "address": "fa:16:3e:56:7c:b6", "network": {"id": "1466749e-8ac2-47c1-881f-aaa26f1cfa07", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1181152542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cfd43e655ec42eebeae8f1b379138cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap792bf62b-99", "ovs_interfaceid": "792bf62b-99b4-4d65-a55b-4e97c64eb1c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Releasing lock "refresh_cache-1282f7f3-c81e-4a6e-bd86-42459f49674f" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG nova.compute.manager [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Instance network_info: |[{"id": "792bf62b-99b4-4d65-a55b-4e97c64eb1c5", "address": "fa:16:3e:56:7c:b6", "network": {"id": "1466749e-8ac2-47c1-881f-aaa26f1cfa07", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1181152542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cfd43e655ec42eebeae8f1b379138cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap792bf62b-99", "ovs_interfaceid": "792bf62b-99b4-4d65-a55b-4e97c64eb1c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-00112ef6-70fd-41ac-8a71-a79783ab14ba req-46994423-0892-447a-9705-db8d1e02e343 service nova] Acquired lock "refresh_cache-1282f7f3-c81e-4a6e-bd86-42459f49674f" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG nova.network.neutron [req-00112ef6-70fd-41ac-8a71-a79783ab14ba req-46994423-0892-447a-9705-db8d1e02e343 service nova] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Refreshing network info cache for port 792bf62b-99b4-4d65-a55b-4e97c64eb1c5 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Start _get_guest_xml network_info=[{"id": "792bf62b-99b4-4d65-a55b-4e97c64eb1c5", "address": "fa:16:3e:56:7c:b6", "network": {"id": "1466749e-8ac2-47c1-881f-aaa26f1cfa07", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1181152542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cfd43e655ec42eebeae8f1b379138cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap792bf62b-99", "ovs_interfaceid": "792bf62b-99b4-4d65-a55b-4e97c64eb1c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:44:51 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:44:51 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:44:51 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG nova.privsep.utils [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74850) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:44:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1489627532',display_name='tempest-DeleteServersTestJSON-server-1489627532',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1489627532',id=2,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cfd43e655ec42eebeae8f1b379138cf',ramdisk_id='',reservation_id='r-p6afbhx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1071534720',owner_user_name='tempest-DeleteServersTestJSON-1071534720-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:44:46Z,user_data=None,user_id='951c453212bf442795089fc1f59199ef',uuid=1282f7f3-c81e-4a6e-bd86-42459f49674f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "792bf62b-99b4-4d65-a55b-4e97c64eb1c5", "address": "fa:16:3e:56:7c:b6", "network": {"id": "1466749e-8ac2-47c1-881f-aaa26f1cfa07", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1181152542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cfd43e655ec42eebeae8f1b379138cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap792bf62b-99", "ovs_interfaceid": "792bf62b-99b4-4d65-a55b-4e97c64eb1c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Converting VIF {"id": "792bf62b-99b4-4d65-a55b-4e97c64eb1c5", "address": "fa:16:3e:56:7c:b6", "network": {"id": "1466749e-8ac2-47c1-881f-aaa26f1cfa07", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1181152542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cfd43e655ec42eebeae8f1b379138cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap792bf62b-99", "ovs_interfaceid": "792bf62b-99b4-4d65-a55b-4e97c64eb1c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:7c:b6,bridge_name='br-int',has_traffic_filtering=True,id=792bf62b-99b4-4d65-a55b-4e97c64eb1c5,network=Network(1466749e-8ac2-47c1-881f-aaa26f1cfa07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap792bf62b-99') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG nova.objects.instance [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Lazy-loading 'pci_devices' on Instance uuid 1282f7f3-c81e-4a6e-bd86-42459f49674f {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:44:51 user nova-compute[74850]:   <uuid>1282f7f3-c81e-4a6e-bd86-42459f49674f</uuid>
Nov 14 00:44:51 user nova-compute[74850]:   <name>instance-00000002</name>
Nov 14 00:44:51 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:44:51 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:44:51 user nova-compute[74850]:   <metadata>
Nov 14 00:44:51 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:44:51 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:44:51 user nova-compute[74850]:       <nova:name>tempest-DeleteServersTestJSON-server-1489627532</nova:name>
Nov 14 00:44:51 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:44:51</nova:creationTime>
Nov 14 00:44:51 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:44:51 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:44:51 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:44:51 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:44:51 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:44:51 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:44:51 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:44:51 user nova-compute[74850]:       <nova:owner>
Nov 14 00:44:51 user nova-compute[74850]:         <nova:user uuid="951c453212bf442795089fc1f59199ef">tempest-DeleteServersTestJSON-1071534720-project-member</nova:user>
Nov 14 00:44:51 user nova-compute[74850]:         <nova:project uuid="7cfd43e655ec42eebeae8f1b379138cf">tempest-DeleteServersTestJSON-1071534720</nova:project>
Nov 14 00:44:51 user nova-compute[74850]:       </nova:owner>
Nov 14 00:44:51 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:44:51 user nova-compute[74850]:       <nova:ports>
Nov 14 00:44:51 user nova-compute[74850]:         <nova:port uuid="792bf62b-99b4-4d65-a55b-4e97c64eb1c5">
Nov 14 00:44:51 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 00:44:51 user nova-compute[74850]:         </nova:port>
Nov 14 00:44:51 user nova-compute[74850]:       </nova:ports>
Nov 14 00:44:51 user nova-compute[74850]:     </nova:instance>
Nov 14 00:44:51 user nova-compute[74850]:   </metadata>
Nov 14 00:44:51 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:44:51 user nova-compute[74850]:     <system>
Nov 14 00:44:51 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:44:51 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:44:51 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:44:51 user nova-compute[74850]:       <entry name="serial">1282f7f3-c81e-4a6e-bd86-42459f49674f</entry>
Nov 14 00:44:51 user nova-compute[74850]:       <entry name="uuid">1282f7f3-c81e-4a6e-bd86-42459f49674f</entry>
Nov 14 00:44:51 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:44:51 user nova-compute[74850]:     </system>
Nov 14 00:44:51 user nova-compute[74850]:   </sysinfo>
Nov 14 00:44:51 user nova-compute[74850]:   <os>
Nov 14 00:44:51 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:44:51 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 00:44:51 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:44:51 user nova-compute[74850]:   </os>
Nov 14 00:44:51 user nova-compute[74850]:   <features>
Nov 14 00:44:51 user nova-compute[74850]:     <acpi/>
Nov 14 00:44:51 user nova-compute[74850]:     <apic/>
Nov 14 00:44:51 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:44:51 user nova-compute[74850]:   </features>
Nov 14 00:44:51 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:44:51 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:44:51 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:44:51 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:44:51 user nova-compute[74850]:   </clock>
Nov 14 00:44:51 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:44:51 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:44:51 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:44:51 user nova-compute[74850]:   </cpu>
Nov 14 00:44:51 user nova-compute[74850]:   <devices>
Nov 14 00:44:51 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 00:44:51 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:44:51 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/1282f7f3-c81e-4a6e-bd86-42459f49674f/disk"/>
Nov 14 00:44:51 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:44:51 user nova-compute[74850]:     </disk>
Nov 14 00:44:51 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:44:51 user nova-compute[74850]:       <mac address="fa:16:3e:56:7c:b6"/>
Nov 14 00:44:51 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:44:51 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:44:51 user nova-compute[74850]:       <target dev="tap792bf62b-99"/>
Nov 14 00:44:51 user nova-compute[74850]:     </interface>
Nov 14 00:44:51 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:44:51 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/1282f7f3-c81e-4a6e-bd86-42459f49674f/console.log" append="off"/>
Nov 14 00:44:51 user nova-compute[74850]:     </serial>
Nov 14 00:44:51 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:44:51 user nova-compute[74850]:     <video>
Nov 14 00:44:51 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:44:51 user nova-compute[74850]:     </video>
Nov 14 00:44:51 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:44:51 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:44:51 user nova-compute[74850]:     </rng>
Nov 14 00:44:51 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:44:51 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:44:51 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:44:51 user nova-compute[74850]:     </memballoon>
Nov 14 00:44:51 user nova-compute[74850]:   </devices>
Nov 14 00:44:51 user nova-compute[74850]: </domain>
Nov 14 00:44:51 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:44:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1489627532',display_name='tempest-DeleteServersTestJSON-server-1489627532',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1489627532',id=2,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cfd43e655ec42eebeae8f1b379138cf',ramdisk_id='',reservation_id='r-p6afbhx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1071534720',owner_user_name='tempest-DeleteServersTestJSON-1071534720-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:44:46Z,user_data=None,user_id='951c453212bf442795089fc1f59199ef',uuid=1282f7f3-c81e-4a6e-bd86-42459f49674f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "792bf62b-99b4-4d65-a55b-4e97c64eb1c5", "address": "fa:16:3e:56:7c:b6", "network": {"id": "1466749e-8ac2-47c1-881f-aaa26f1cfa07", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1181152542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cfd43e655ec42eebeae8f1b379138cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap792bf62b-99", "ovs_interfaceid": "792bf62b-99b4-4d65-a55b-4e97c64eb1c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Converting VIF {"id": "792bf62b-99b4-4d65-a55b-4e97c64eb1c5", "address": "fa:16:3e:56:7c:b6", "network": {"id": "1466749e-8ac2-47c1-881f-aaa26f1cfa07", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1181152542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cfd43e655ec42eebeae8f1b379138cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap792bf62b-99", "ovs_interfaceid": "792bf62b-99b4-4d65-a55b-4e97c64eb1c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:7c:b6,bridge_name='br-int',has_traffic_filtering=True,id=792bf62b-99b4-4d65-a55b-4e97c64eb1c5,network=Network(1466749e-8ac2-47c1-881f-aaa26f1cfa07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap792bf62b-99') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG os_vif [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:7c:b6,bridge_name='br-int',has_traffic_filtering=True,id=792bf62b-99b4-4d65-a55b-4e97c64eb1c5,network=Network(1466749e-8ac2-47c1-881f-aaa26f1cfa07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap792bf62b-99') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Created schema index Interface.name {{(pid=74850) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Created schema index Port.name {{(pid=74850) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Created schema index Bridge.name {{(pid=74850) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [POLLOUT] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:44:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:44:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cc2aa05c-f021-56d8-9156-e444936a002e', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:44:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:44:52 user nova-compute[74850]: INFO oslo.privsep.daemon [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpayte3n8p/privsep.sock']
Nov 14 00:44:52 user sudo[84187]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpayte3n8p/privsep.sock
Nov 14 00:44:52 user sudo[84187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 00:44:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:53 user nova-compute[74850]: DEBUG nova.network.neutron [req-00112ef6-70fd-41ac-8a71-a79783ab14ba req-46994423-0892-447a-9705-db8d1e02e343 service nova] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Updated VIF entry in instance network info cache for port 792bf62b-99b4-4d65-a55b-4e97c64eb1c5. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:44:53 user nova-compute[74850]: DEBUG nova.network.neutron [req-00112ef6-70fd-41ac-8a71-a79783ab14ba req-46994423-0892-447a-9705-db8d1e02e343 service nova] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Updating instance_info_cache with network_info: [{"id": "792bf62b-99b4-4d65-a55b-4e97c64eb1c5", "address": "fa:16:3e:56:7c:b6", "network": {"id": "1466749e-8ac2-47c1-881f-aaa26f1cfa07", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1181152542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cfd43e655ec42eebeae8f1b379138cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap792bf62b-99", "ovs_interfaceid": "792bf62b-99b4-4d65-a55b-4e97c64eb1c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:44:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-00112ef6-70fd-41ac-8a71-a79783ab14ba req-46994423-0892-447a-9705-db8d1e02e343 service nova] Releasing lock "refresh_cache-1282f7f3-c81e-4a6e-bd86-42459f49674f" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:44:53 user sudo[84187]: pam_unix(sudo:session): session closed for user root
Nov 14 00:44:53 user nova-compute[74850]: INFO oslo.privsep.daemon [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Spawned new privsep daemon via rootwrap
Nov 14 00:44:53 user nova-compute[74850]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 00:44:53 user nova-compute[74850]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 00:44:53 user nova-compute[74850]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 14 00:44:53 user nova-compute[74850]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84196
Nov 14 00:44:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:53 user nova-compute[74850]: DEBUG nova.network.neutron [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Successfully updated port: f0de03a3-fd19-4cd1-a408-5168dcf267d7 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:44:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "refresh_cache-a70d0196-f90e-47c4-be67-bf7ef4c3d8c4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:44:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquired lock "refresh_cache-a70d0196-f90e-47c4-be67-bf7ef4c3d8c4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:44:53 user nova-compute[74850]: DEBUG nova.network.neutron [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:44:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:54 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap792bf62b-99, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:44:54 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap792bf62b-99, col_values=(('qos', UUID('dfd72188-11e9-4702-9395-2bda92c78c41')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:44:54 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap792bf62b-99, col_values=(('external_ids', {'iface-id': '792bf62b-99b4-4d65-a55b-4e97c64eb1c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:7c:b6', 'vm-uuid': '1282f7f3-c81e-4a6e-bd86-42459f49674f'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:44:54 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:54 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:44:54 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:54 user nova-compute[74850]: INFO os_vif [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:7c:b6,bridge_name='br-int',has_traffic_filtering=True,id=792bf62b-99b4-4d65-a55b-4e97c64eb1c5,network=Network(1466749e-8ac2-47c1-881f-aaa26f1cfa07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap792bf62b-99')
Nov 14 00:44:54 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:44:54 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] No VIF found with MAC fa:16:3e:56:7c:b6, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:44:54 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:54 user nova-compute[74850]: DEBUG nova.compute.manager [req-ddc32949-11c1-4a1a-87f4-a9bb0dded922 req-24936e2b-a5a7-4fad-8317-58db5ca8fc00 service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Received event network-changed-f0de03a3-fd19-4cd1-a408-5168dcf267d7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:44:54 user nova-compute[74850]: DEBUG nova.compute.manager [req-ddc32949-11c1-4a1a-87f4-a9bb0dded922 req-24936e2b-a5a7-4fad-8317-58db5ca8fc00 service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Refreshing instance network info cache due to event network-changed-f0de03a3-fd19-4cd1-a408-5168dcf267d7. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:44:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ddc32949-11c1-4a1a-87f4-a9bb0dded922 req-24936e2b-a5a7-4fad-8317-58db5ca8fc00 service nova] Acquiring lock "refresh_cache-a70d0196-f90e-47c4-be67-bf7ef4c3d8c4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:44:54 user nova-compute[74850]: DEBUG nova.network.neutron [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:44:54 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG nova.network.neutron [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Updating instance_info_cache with network_info: [{"id": "f0de03a3-fd19-4cd1-a408-5168dcf267d7", "address": "fa:16:3e:44:d7:64", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0de03a3-fd", "ovs_interfaceid": "f0de03a3-fd19-4cd1-a408-5168dcf267d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Releasing lock "refresh_cache-a70d0196-f90e-47c4-be67-bf7ef4c3d8c4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG nova.compute.manager [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Instance network_info: |[{"id": "f0de03a3-fd19-4cd1-a408-5168dcf267d7", "address": "fa:16:3e:44:d7:64", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0de03a3-fd", "ovs_interfaceid": "f0de03a3-fd19-4cd1-a408-5168dcf267d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ddc32949-11c1-4a1a-87f4-a9bb0dded922 req-24936e2b-a5a7-4fad-8317-58db5ca8fc00 service nova] Acquired lock "refresh_cache-a70d0196-f90e-47c4-be67-bf7ef4c3d8c4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG nova.network.neutron [req-ddc32949-11c1-4a1a-87f4-a9bb0dded922 req-24936e2b-a5a7-4fad-8317-58db5ca8fc00 service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Refreshing network info cache for port f0de03a3-fd19-4cd1-a408-5168dcf267d7 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Start _get_guest_xml network_info=[{"id": "f0de03a3-fd19-4cd1-a408-5168dcf267d7", "address": "fa:16:3e:44:d7:64", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0de03a3-fd", "ovs_interfaceid": "f0de03a3-fd19-4cd1-a408-5168dcf267d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:44:55 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:44:55 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:44:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:44:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1788047839',display_name='tempest-ServerRescueNegativeTestJSON-server-1788047839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1788047839',id=1,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e933e8bc63bd442d882ff59243bd7faa',ramdisk_id='',reservation_id='r-ex3095uo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-103787426',owner_user_name='tempest-ServerRescueNegativeTestJSON-103787426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:44:45Z,user_data=None,user_id='84158c07e3344e01bf82e0e25e2a7244',uuid=a70d0196-f90e-47c4-be67-bf7ef4c3d8c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0de03a3-fd19-4cd1-a408-5168dcf267d7", "address": "fa:16:3e:44:d7:64", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0de03a3-fd", "ovs_interfaceid": "f0de03a3-fd19-4cd1-a408-5168dcf267d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Converting VIF {"id": "f0de03a3-fd19-4cd1-a408-5168dcf267d7", "address": "fa:16:3e:44:d7:64", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0de03a3-fd", "ovs_interfaceid": "f0de03a3-fd19-4cd1-a408-5168dcf267d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:d7:64,bridge_name='br-int',has_traffic_filtering=True,id=f0de03a3-fd19-4cd1-a408-5168dcf267d7,network=Network(4bb9b9bb-4485-4fed-bf0e-f549b29f09da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0de03a3-fd') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG nova.objects.instance [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lazy-loading 'pci_devices' on Instance uuid a70d0196-f90e-47c4-be67-bf7ef4c3d8c4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:44:55 user nova-compute[74850]:   <uuid>a70d0196-f90e-47c4-be67-bf7ef4c3d8c4</uuid>
Nov 14 00:44:55 user nova-compute[74850]:   <name>instance-00000001</name>
Nov 14 00:44:55 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:44:55 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:44:55 user nova-compute[74850]:   <metadata>
Nov 14 00:44:55 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:44:55 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:44:55 user nova-compute[74850]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1788047839</nova:name>
Nov 14 00:44:55 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:44:55</nova:creationTime>
Nov 14 00:44:55 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:44:55 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:44:55 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:44:55 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:44:55 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:44:55 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:44:55 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:44:55 user nova-compute[74850]:       <nova:owner>
Nov 14 00:44:55 user nova-compute[74850]:         <nova:user uuid="84158c07e3344e01bf82e0e25e2a7244">tempest-ServerRescueNegativeTestJSON-103787426-project-member</nova:user>
Nov 14 00:44:55 user nova-compute[74850]:         <nova:project uuid="e933e8bc63bd442d882ff59243bd7faa">tempest-ServerRescueNegativeTestJSON-103787426</nova:project>
Nov 14 00:44:55 user nova-compute[74850]:       </nova:owner>
Nov 14 00:44:55 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:44:55 user nova-compute[74850]:       <nova:ports>
Nov 14 00:44:55 user nova-compute[74850]:         <nova:port uuid="f0de03a3-fd19-4cd1-a408-5168dcf267d7">
Nov 14 00:44:55 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 00:44:55 user nova-compute[74850]:         </nova:port>
Nov 14 00:44:55 user nova-compute[74850]:       </nova:ports>
Nov 14 00:44:55 user nova-compute[74850]:     </nova:instance>
Nov 14 00:44:55 user nova-compute[74850]:   </metadata>
Nov 14 00:44:55 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:44:55 user nova-compute[74850]:     <system>
Nov 14 00:44:55 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:44:55 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:44:55 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:44:55 user nova-compute[74850]:       <entry name="serial">a70d0196-f90e-47c4-be67-bf7ef4c3d8c4</entry>
Nov 14 00:44:55 user nova-compute[74850]:       <entry name="uuid">a70d0196-f90e-47c4-be67-bf7ef4c3d8c4</entry>
Nov 14 00:44:55 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:44:55 user nova-compute[74850]:     </system>
Nov 14 00:44:55 user nova-compute[74850]:   </sysinfo>
Nov 14 00:44:55 user nova-compute[74850]:   <os>
Nov 14 00:44:55 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:44:55 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 00:44:55 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:44:55 user nova-compute[74850]:   </os>
Nov 14 00:44:55 user nova-compute[74850]:   <features>
Nov 14 00:44:55 user nova-compute[74850]:     <acpi/>
Nov 14 00:44:55 user nova-compute[74850]:     <apic/>
Nov 14 00:44:55 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:44:55 user nova-compute[74850]:   </features>
Nov 14 00:44:55 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:44:55 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:44:55 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:44:55 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:44:55 user nova-compute[74850]:   </clock>
Nov 14 00:44:55 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:44:55 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:44:55 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:44:55 user nova-compute[74850]:   </cpu>
Nov 14 00:44:55 user nova-compute[74850]:   <devices>
Nov 14 00:44:55 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 00:44:55 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:44:55 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk"/>
Nov 14 00:44:55 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:44:55 user nova-compute[74850]:     </disk>
Nov 14 00:44:55 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:44:55 user nova-compute[74850]:       <mac address="fa:16:3e:44:d7:64"/>
Nov 14 00:44:55 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:44:55 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:44:55 user nova-compute[74850]:       <target dev="tapf0de03a3-fd"/>
Nov 14 00:44:55 user nova-compute[74850]:     </interface>
Nov 14 00:44:55 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:44:55 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/console.log" append="off"/>
Nov 14 00:44:55 user nova-compute[74850]:     </serial>
Nov 14 00:44:55 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:44:55 user nova-compute[74850]:     <video>
Nov 14 00:44:55 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:44:55 user nova-compute[74850]:     </video>
Nov 14 00:44:55 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:44:55 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:44:55 user nova-compute[74850]:     </rng>
Nov 14 00:44:55 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:44:55 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:44:55 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:44:55 user nova-compute[74850]:     </memballoon>
Nov 14 00:44:55 user nova-compute[74850]:   </devices>
Nov 14 00:44:55 user nova-compute[74850]: </domain>
Nov 14 00:44:55 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:44:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1788047839',display_name='tempest-ServerRescueNegativeTestJSON-server-1788047839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1788047839',id=1,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e933e8bc63bd442d882ff59243bd7faa',ramdisk_id='',reservation_id='r-ex3095uo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-103787426',owner_user_name='tempest-ServerRescueNegativeTestJSON-103787426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:44:45Z,user_data=None,user_id='84158c07e3344e01bf82e0e25e2a7244',uuid=a70d0196-f90e-47c4-be67-bf7ef4c3d8c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0de03a3-fd19-4cd1-a408-5168dcf267d7", "address": "fa:16:3e:44:d7:64", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0de03a3-fd", "ovs_interfaceid": "f0de03a3-fd19-4cd1-a408-5168dcf267d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Converting VIF {"id": "f0de03a3-fd19-4cd1-a408-5168dcf267d7", "address": "fa:16:3e:44:d7:64", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0de03a3-fd", "ovs_interfaceid": "f0de03a3-fd19-4cd1-a408-5168dcf267d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:d7:64,bridge_name='br-int',has_traffic_filtering=True,id=f0de03a3-fd19-4cd1-a408-5168dcf267d7,network=Network(4bb9b9bb-4485-4fed-bf0e-f549b29f09da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0de03a3-fd') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG os_vif [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:d7:64,bridge_name='br-int',has_traffic_filtering=True,id=f0de03a3-fd19-4cd1-a408-5168dcf267d7,network=Network(4bb9b9bb-4485-4fed-bf0e-f549b29f09da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0de03a3-fd') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a0c85fa2-bc3a-5046-8d80-e2193877297b', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0de03a3-fd, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf0de03a3-fd, col_values=(('qos', UUID('3eb51dcf-9360-42e7-b69a-6ecc3702eaaf')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf0de03a3-fd, col_values=(('external_ids', {'iface-id': 'f0de03a3-fd19-4cd1-a408-5168dcf267d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:d7:64', 'vm-uuid': 'a70d0196-f90e-47c4-be67-bf7ef4c3d8c4'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:55 user nova-compute[74850]: INFO os_vif [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:d7:64,bridge_name='br-int',has_traffic_filtering=True,id=f0de03a3-fd19-4cd1-a408-5168dcf267d7,network=Network(4bb9b9bb-4485-4fed-bf0e-f549b29f09da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0de03a3-fd')
Nov 14 00:44:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] No VIF found with MAC fa:16:3e:44:d7:64, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:44:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:56 user nova-compute[74850]: DEBUG nova.network.neutron [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Successfully updated port: ff543781-9ab0-418a-ab62-1a74ee0ed1a9 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:44:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "refresh_cache-1879be4c-9226-4c8c-a56c-f8e37398851b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:44:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquired lock "refresh_cache-1879be4c-9226-4c8c-a56c-f8e37398851b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:44:56 user nova-compute[74850]: DEBUG nova.network.neutron [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:44:56 user nova-compute[74850]: DEBUG nova.compute.manager [req-61164d0a-8073-4a3a-94ed-e7369586edb2 req-6195f6e9-4958-4ab1-b0e9-60233745282e service nova] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Received event network-changed-ff543781-9ab0-418a-ab62-1a74ee0ed1a9 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:44:56 user nova-compute[74850]: DEBUG nova.compute.manager [req-61164d0a-8073-4a3a-94ed-e7369586edb2 req-6195f6e9-4958-4ab1-b0e9-60233745282e service nova] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Refreshing instance network info cache due to event network-changed-ff543781-9ab0-418a-ab62-1a74ee0ed1a9. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:44:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-61164d0a-8073-4a3a-94ed-e7369586edb2 req-6195f6e9-4958-4ab1-b0e9-60233745282e service nova] Acquiring lock "refresh_cache-1879be4c-9226-4c8c-a56c-f8e37398851b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:44:56 user nova-compute[74850]: DEBUG nova.network.neutron [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG nova.network.neutron [req-ddc32949-11c1-4a1a-87f4-a9bb0dded922 req-24936e2b-a5a7-4fad-8317-58db5ca8fc00 service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Updated VIF entry in instance network info cache for port f0de03a3-fd19-4cd1-a408-5168dcf267d7. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG nova.network.neutron [req-ddc32949-11c1-4a1a-87f4-a9bb0dded922 req-24936e2b-a5a7-4fad-8317-58db5ca8fc00 service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Updating instance_info_cache with network_info: [{"id": "f0de03a3-fd19-4cd1-a408-5168dcf267d7", "address": "fa:16:3e:44:d7:64", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0de03a3-fd", "ovs_interfaceid": "f0de03a3-fd19-4cd1-a408-5168dcf267d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ddc32949-11c1-4a1a-87f4-a9bb0dded922 req-24936e2b-a5a7-4fad-8317-58db5ca8fc00 service nova] Releasing lock "refresh_cache-a70d0196-f90e-47c4-be67-bf7ef4c3d8c4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG nova.network.neutron [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Updating instance_info_cache with network_info: [{"id": "ff543781-9ab0-418a-ab62-1a74ee0ed1a9", "address": "fa:16:3e:04:e7:ab", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff543781-9a", "ovs_interfaceid": "ff543781-9ab0-418a-ab62-1a74ee0ed1a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Releasing lock "refresh_cache-1879be4c-9226-4c8c-a56c-f8e37398851b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG nova.compute.manager [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Instance network_info: |[{"id": "ff543781-9ab0-418a-ab62-1a74ee0ed1a9", "address": "fa:16:3e:04:e7:ab", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff543781-9a", "ovs_interfaceid": "ff543781-9ab0-418a-ab62-1a74ee0ed1a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-61164d0a-8073-4a3a-94ed-e7369586edb2 req-6195f6e9-4958-4ab1-b0e9-60233745282e service nova] Acquired lock "refresh_cache-1879be4c-9226-4c8c-a56c-f8e37398851b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG nova.network.neutron [req-61164d0a-8073-4a3a-94ed-e7369586edb2 req-6195f6e9-4958-4ab1-b0e9-60233745282e service nova] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Refreshing network info cache for port ff543781-9ab0-418a-ab62-1a74ee0ed1a9 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Start _get_guest_xml network_info=[{"id": "ff543781-9ab0-418a-ab62-1a74ee0ed1a9", "address": "fa:16:3e:04:e7:ab", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff543781-9a", "ovs_interfaceid": "ff543781-9ab0-418a-ab62-1a74ee0ed1a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:44:57 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:44:57 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:44:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-298091161',display_name='tempest-ServerRescueNegativeTestJSON-server-298091161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-298091161',id=3,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e933e8bc63bd442d882ff59243bd7faa',ramdisk_id='',reservation_id='r-t20jwzvz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-103787426',owner_user_name='tempest-ServerRescueNegativeTestJSON-103787426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:44:48Z,user_data=None,user_id='84158c07e3344e01bf82e0e25e2a7244',uuid=1879be4c-9226-4c8c-a56c-f8e37398851b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff543781-9ab0-418a-ab62-1a74ee0ed1a9", "address": "fa:16:3e:04:e7:ab", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff543781-9a", "ovs_interfaceid": "ff543781-9ab0-418a-ab62-1a74ee0ed1a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Converting VIF {"id": "ff543781-9ab0-418a-ab62-1a74ee0ed1a9", "address": "fa:16:3e:04:e7:ab", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff543781-9a", "ovs_interfaceid": "ff543781-9ab0-418a-ab62-1a74ee0ed1a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:e7:ab,bridge_name='br-int',has_traffic_filtering=True,id=ff543781-9ab0-418a-ab62-1a74ee0ed1a9,network=Network(4bb9b9bb-4485-4fed-bf0e-f549b29f09da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff543781-9a') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG nova.objects.instance [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lazy-loading 'pci_devices' on Instance uuid 1879be4c-9226-4c8c-a56c-f8e37398851b {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:44:57 user nova-compute[74850]:   <uuid>1879be4c-9226-4c8c-a56c-f8e37398851b</uuid>
Nov 14 00:44:57 user nova-compute[74850]:   <name>instance-00000003</name>
Nov 14 00:44:57 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:44:57 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:44:57 user nova-compute[74850]:   <metadata>
Nov 14 00:44:57 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:44:57 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:44:57 user nova-compute[74850]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-298091161</nova:name>
Nov 14 00:44:57 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:44:57</nova:creationTime>
Nov 14 00:44:57 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:44:57 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:44:57 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:44:57 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:44:57 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:44:57 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:44:57 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:44:57 user nova-compute[74850]:       <nova:owner>
Nov 14 00:44:57 user nova-compute[74850]:         <nova:user uuid="84158c07e3344e01bf82e0e25e2a7244">tempest-ServerRescueNegativeTestJSON-103787426-project-member</nova:user>
Nov 14 00:44:57 user nova-compute[74850]:         <nova:project uuid="e933e8bc63bd442d882ff59243bd7faa">tempest-ServerRescueNegativeTestJSON-103787426</nova:project>
Nov 14 00:44:57 user nova-compute[74850]:       </nova:owner>
Nov 14 00:44:57 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:44:57 user nova-compute[74850]:       <nova:ports>
Nov 14 00:44:57 user nova-compute[74850]:         <nova:port uuid="ff543781-9ab0-418a-ab62-1a74ee0ed1a9">
Nov 14 00:44:57 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 00:44:57 user nova-compute[74850]:         </nova:port>
Nov 14 00:44:57 user nova-compute[74850]:       </nova:ports>
Nov 14 00:44:57 user nova-compute[74850]:     </nova:instance>
Nov 14 00:44:57 user nova-compute[74850]:   </metadata>
Nov 14 00:44:57 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:44:57 user nova-compute[74850]:     <system>
Nov 14 00:44:57 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:44:57 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:44:57 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:44:57 user nova-compute[74850]:       <entry name="serial">1879be4c-9226-4c8c-a56c-f8e37398851b</entry>
Nov 14 00:44:57 user nova-compute[74850]:       <entry name="uuid">1879be4c-9226-4c8c-a56c-f8e37398851b</entry>
Nov 14 00:44:57 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:44:57 user nova-compute[74850]:     </system>
Nov 14 00:44:57 user nova-compute[74850]:   </sysinfo>
Nov 14 00:44:57 user nova-compute[74850]:   <os>
Nov 14 00:44:57 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:44:57 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 00:44:57 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:44:57 user nova-compute[74850]:   </os>
Nov 14 00:44:57 user nova-compute[74850]:   <features>
Nov 14 00:44:57 user nova-compute[74850]:     <acpi/>
Nov 14 00:44:57 user nova-compute[74850]:     <apic/>
Nov 14 00:44:57 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:44:57 user nova-compute[74850]:   </features>
Nov 14 00:44:57 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:44:57 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:44:57 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:44:57 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:44:57 user nova-compute[74850]:   </clock>
Nov 14 00:44:57 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:44:57 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:44:57 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:44:57 user nova-compute[74850]:   </cpu>
Nov 14 00:44:57 user nova-compute[74850]:   <devices>
Nov 14 00:44:57 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 00:44:57 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:44:57 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk"/>
Nov 14 00:44:57 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:44:57 user nova-compute[74850]:     </disk>
Nov 14 00:44:57 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:44:57 user nova-compute[74850]:       <mac address="fa:16:3e:04:e7:ab"/>
Nov 14 00:44:57 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:44:57 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:44:57 user nova-compute[74850]:       <target dev="tapff543781-9a"/>
Nov 14 00:44:57 user nova-compute[74850]:     </interface>
Nov 14 00:44:57 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:44:57 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/console.log" append="off"/>
Nov 14 00:44:57 user nova-compute[74850]:     </serial>
Nov 14 00:44:57 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:44:57 user nova-compute[74850]:     <video>
Nov 14 00:44:57 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:44:57 user nova-compute[74850]:     </video>
Nov 14 00:44:57 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:44:57 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:44:57 user nova-compute[74850]:     </rng>
Nov 14 00:44:57 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:44:57 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:44:57 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:44:57 user nova-compute[74850]:     </memballoon>
Nov 14 00:44:57 user nova-compute[74850]:   </devices>
Nov 14 00:44:57 user nova-compute[74850]: </domain>
Nov 14 00:44:57 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-298091161',display_name='tempest-ServerRescueNegativeTestJSON-server-298091161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-298091161',id=3,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e933e8bc63bd442d882ff59243bd7faa',ramdisk_id='',reservation_id='r-t20jwzvz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-103787426',owner_user_name='tempest-ServerRescueNegativeTestJSON-103787426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:44:48Z,user_data=None,user_id='84158c07e3344e01bf82e0e25e2a7244',uuid=1879be4c-9226-4c8c-a56c-f8e37398851b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff543781-9ab0-418a-ab62-1a74ee0ed1a9", "address": "fa:16:3e:04:e7:ab", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff543781-9a", "ovs_interfaceid": "ff543781-9ab0-418a-ab62-1a74ee0ed1a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Converting VIF {"id": "ff543781-9ab0-418a-ab62-1a74ee0ed1a9", "address": "fa:16:3e:04:e7:ab", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff543781-9a", "ovs_interfaceid": "ff543781-9ab0-418a-ab62-1a74ee0ed1a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:e7:ab,bridge_name='br-int',has_traffic_filtering=True,id=ff543781-9ab0-418a-ab62-1a74ee0ed1a9,network=Network(4bb9b9bb-4485-4fed-bf0e-f549b29f09da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff543781-9a') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG os_vif [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:e7:ab,bridge_name='br-int',has_traffic_filtering=True,id=ff543781-9ab0-418a-ab62-1a74ee0ed1a9,network=Network(4bb9b9bb-4485-4fed-bf0e-f549b29f09da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff543781-9a') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b65419eb-bb32-5192-94fc-c1fd965995bb', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff543781-9a, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapff543781-9a, col_values=(('qos', UUID('52de8f71-8f30-4d03-81f1-5699bd7a3342')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapff543781-9a, col_values=(('external_ids', {'iface-id': 'ff543781-9ab0-418a-ab62-1a74ee0ed1a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:e7:ab', 'vm-uuid': '1879be4c-9226-4c8c-a56c-f8e37398851b'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:57 user nova-compute[74850]: INFO os_vif [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:e7:ab,bridge_name='br-int',has_traffic_filtering=True,id=ff543781-9ab0-418a-ab62-1a74ee0ed1a9,network=Network(4bb9b9bb-4485-4fed-bf0e-f549b29f09da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff543781-9a')
Nov 14 00:44:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:44:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] No VIF found with MAC fa:16:3e:04:e7:ab, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:44:58 user nova-compute[74850]: DEBUG nova.compute.manager [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:44:58 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 00:44:58 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Instance spawned successfully.
Nov 14 00:44:58 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 00:44:58 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:44:58 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:44:58 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:44:58 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:44:58 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:44:58 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:44:58 user nova-compute[74850]: INFO nova.compute.manager [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Took 11.93 seconds to spawn the instance on the hypervisor.
Nov 14 00:44:58 user nova-compute[74850]: DEBUG nova.compute.manager [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:44:58 user nova-compute[74850]: INFO nova.compute.manager [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Took 13.11 seconds to build instance.
Nov 14 00:44:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-efb52cb5-cf01-4ed4-a729-a838e068c80b tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Lock "1282f7f3-c81e-4a6e-bd86-42459f49674f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.251s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:44:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:59 user nova-compute[74850]: DEBUG nova.compute.manager [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:44:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 00:44:59 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Instance spawned successfully.
Nov 14 00:44:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 00:44:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:44:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:44:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:44:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:44:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:44:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:44:59 user nova-compute[74850]: INFO nova.compute.manager [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Took 13.86 seconds to spawn the instance on the hypervisor.
Nov 14 00:44:59 user nova-compute[74850]: DEBUG nova.compute.manager [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:44:59 user nova-compute[74850]: INFO nova.compute.manager [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Took 14.83 seconds to build instance.
Nov 14 00:44:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a391ff5d-cceb-43d8-9953-39d403da239a tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.155s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:44:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:59 user nova-compute[74850]: DEBUG nova.network.neutron [req-61164d0a-8073-4a3a-94ed-e7369586edb2 req-6195f6e9-4958-4ab1-b0e9-60233745282e service nova] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Updated VIF entry in instance network info cache for port ff543781-9ab0-418a-ab62-1a74ee0ed1a9. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:44:59 user nova-compute[74850]: DEBUG nova.network.neutron [req-61164d0a-8073-4a3a-94ed-e7369586edb2 req-6195f6e9-4958-4ab1-b0e9-60233745282e service nova] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Updating instance_info_cache with network_info: [{"id": "ff543781-9ab0-418a-ab62-1a74ee0ed1a9", "address": "fa:16:3e:04:e7:ab", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff543781-9a", "ovs_interfaceid": "ff543781-9ab0-418a-ab62-1a74ee0ed1a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:44:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:44:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-61164d0a-8073-4a3a-94ed-e7369586edb2 req-6195f6e9-4958-4ab1-b0e9-60233745282e service nova] Releasing lock "refresh_cache-1879be4c-9226-4c8c-a56c-f8e37398851b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:44:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:02 user nova-compute[74850]: DEBUG nova.compute.manager [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:45:02 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 00:45:02 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Instance spawned successfully.
Nov 14 00:45:02 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 00:45:02 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:02 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:02 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:02 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:02 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:02 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:02 user nova-compute[74850]: INFO nova.compute.manager [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Took 14.69 seconds to spawn the instance on the hypervisor.
Nov 14 00:45:02 user nova-compute[74850]: DEBUG nova.compute.manager [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:45:02 user nova-compute[74850]: INFO nova.compute.manager [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Took 15.49 seconds to build instance.
Nov 14 00:45:02 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dcb84866-8cb8-416c-ae54-53dc0773a631 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "1879be4c-9226-4c8c-a56c-f8e37398851b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.613s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Acquiring lock "7f1a88ea-83a3-447b-a83d-40b2c1c908f5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Lock "7f1a88ea-83a3-447b-a83d-40b2c1c908f5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:08 user nova-compute[74850]: DEBUG nova.compute.manager [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 00:45:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.042s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:09 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 00:45:09 user nova-compute[74850]: INFO nova.compute.claims [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Claim successful on node user
Nov 14 00:45:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:09 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:45:09 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:45:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.567s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:09 user nova-compute[74850]: DEBUG nova.compute.manager [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 00:45:09 user nova-compute[74850]: DEBUG nova.compute.manager [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 00:45:09 user nova-compute[74850]: DEBUG nova.network.neutron [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 00:45:09 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 00:45:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:09 user nova-compute[74850]: DEBUG nova.compute.manager [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 00:45:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:10 user nova-compute[74850]: DEBUG nova.compute.manager [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 00:45:10 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 00:45:10 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Creating image(s)
Nov 14 00:45:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Acquiring lock "/opt/stack/data/nova/instances/7f1a88ea-83a3-447b-a83d-40b2c1c908f5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Lock "/opt/stack/data/nova/instances/7f1a88ea-83a3-447b-a83d-40b2c1c908f5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Lock "/opt/stack/data/nova/instances/7f1a88ea-83a3-447b-a83d-40b2c1c908f5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:10 user nova-compute[74850]: DEBUG nova.policy [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '895d12a3660d43ffbdbc8cd4d5e1b989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cae3e5d11c40f0b499837464422c86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 00:45:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.214s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Acquiring lock "4a2881e6-ee6e-4165-a6d9-35fda79c142d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Lock "4a2881e6-ee6e-4165-a6d9-35fda79c142d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:10 user nova-compute[74850]: DEBUG nova.compute.manager [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 00:45:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.218s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/7f1a88ea-83a3-447b-a83d-40b2c1c908f5/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/7f1a88ea-83a3-447b-a83d-40b2c1c908f5/disk 1073741824" returned: 0 in 0.059s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:10 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 00:45:10 user nova-compute[74850]: INFO nova.compute.claims [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Claim successful on node user
Nov 14 00:45:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.199s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:10 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7f1a88ea-83a3-447b-a83d-40b2c1c908f5/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 00:45:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f1a88ea-83a3-447b-a83d-40b2c1c908f5/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f1a88ea-83a3-447b-a83d-40b2c1c908f5/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:11 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Cannot resize image /opt/stack/data/nova/instances/7f1a88ea-83a3-447b-a83d-40b2c1c908f5/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 00:45:11 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 00:45:11 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Ensure instance console log exists: /opt/stack/data/nova/instances/7f1a88ea-83a3-447b-a83d-40b2c1c908f5/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 00:45:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:11 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:45:11 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:45:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.567s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:11 user nova-compute[74850]: DEBUG nova.compute.manager [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 00:45:11 user nova-compute[74850]: DEBUG nova.compute.manager [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 00:45:11 user nova-compute[74850]: DEBUG nova.network.neutron [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 00:45:11 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 14 00:45:11 user nova-compute[74850]: DEBUG nova.compute.manager [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 00:45:11 user nova-compute[74850]: DEBUG nova.compute.manager [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 00:45:11 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 00:45:11 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Creating image(s)
Nov 14 00:45:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a2881e6-ee6e-4165-a6d9-35fda79c142d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Lock "/opt/stack/data/nova/instances/4a2881e6-ee6e-4165-a6d9-35fda79c142d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Lock "/opt/stack/data/nova/instances/4a2881e6-ee6e-4165-a6d9-35fda79c142d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.030s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Acquiring lock "3c60c2c4ee861c3e92317a7996f4f8a6e80713e3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Lock "3c60c2c4ee861c3e92317a7996f4f8a6e80713e3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:11 user nova-compute[74850]: DEBUG nova.policy [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c8611932bd704d8ea467ee48ba50ce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd0e10c315346cabe45d8cb1596b3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 00:45:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c60c2c4ee861c3e92317a7996f4f8a6e80713e3.part --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:12 user nova-compute[74850]: DEBUG nova.network.neutron [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Successfully created port: 4a56ca60-9419-4150-8a41-81d8709e001c {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:45:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c60c2c4ee861c3e92317a7996f4f8a6e80713e3.part --force-share --output=json" returned: 0 in 0.217s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:12 user nova-compute[74850]: DEBUG nova.virt.images [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] ed4d3d48-93f7-4f21-b25a-975b83645c87 was qcow2, converting to raw {{(pid=74850) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 00:45:12 user nova-compute[74850]: DEBUG nova.privsep.utils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74850) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 00:45:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3c60c2c4ee861c3e92317a7996f4f8a6e80713e3.part /opt/stack/data/nova/instances/_base/3c60c2c4ee861c3e92317a7996f4f8a6e80713e3.converted {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3c60c2c4ee861c3e92317a7996f4f8a6e80713e3.part /opt/stack/data/nova/instances/_base/3c60c2c4ee861c3e92317a7996f4f8a6e80713e3.converted" returned: 0 in 0.204s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c60c2c4ee861c3e92317a7996f4f8a6e80713e3.converted --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c60c2c4ee861c3e92317a7996f4f8a6e80713e3.converted --force-share --output=json" returned: 0 in 0.246s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Lock "3c60c2c4ee861c3e92317a7996f4f8a6e80713e3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.321s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c60c2c4ee861c3e92317a7996f4f8a6e80713e3 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:13 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c60c2c4ee861c3e92317a7996f4f8a6e80713e3 --force-share --output=json" returned: 0 in 0.251s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Acquiring lock "3c60c2c4ee861c3e92317a7996f4f8a6e80713e3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Lock "3c60c2c4ee861c3e92317a7996f4f8a6e80713e3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:13 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c60c2c4ee861c3e92317a7996f4f8a6e80713e3 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:13 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c60c2c4ee861c3e92317a7996f4f8a6e80713e3 --force-share --output=json" returned: 0 in 0.237s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:13 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3c60c2c4ee861c3e92317a7996f4f8a6e80713e3,backing_fmt=raw /opt/stack/data/nova/instances/4a2881e6-ee6e-4165-a6d9-35fda79c142d/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:13 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:13 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3c60c2c4ee861c3e92317a7996f4f8a6e80713e3,backing_fmt=raw /opt/stack/data/nova/instances/4a2881e6-ee6e-4165-a6d9-35fda79c142d/disk 1073741824" returned: 0 in 0.085s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Lock "3c60c2c4ee861c3e92317a7996f4f8a6e80713e3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.331s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:13 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c60c2c4ee861c3e92317a7996f4f8a6e80713e3 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Acquiring lock "28212eec-99be-4171-97ed-7748bbb75c88" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "28212eec-99be-4171-97ed-7748bbb75c88" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:13 user nova-compute[74850]: DEBUG nova.compute.manager [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 00:45:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:13 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 00:45:13 user nova-compute[74850]: INFO nova.compute.claims [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Claim successful on node user
Nov 14 00:45:13 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c60c2c4ee861c3e92317a7996f4f8a6e80713e3 --force-share --output=json" returned: 0 in 0.262s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:13 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4a2881e6-ee6e-4165-a6d9-35fda79c142d/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 00:45:13 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2881e6-ee6e-4165-a6d9-35fda79c142d/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:14 user nova-compute[74850]: DEBUG nova.network.neutron [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Successfully created port: f8d36bc2-b85b-4eaf-8c22-e58c9dae360d {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:45:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2881e6-ee6e-4165-a6d9-35fda79c142d/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:14 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Cannot resize image /opt/stack/data/nova/instances/4a2881e6-ee6e-4165-a6d9-35fda79c142d/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 00:45:14 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 00:45:14 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Ensure instance console log exists: /opt/stack/data/nova/instances/4a2881e6-ee6e-4165-a6d9-35fda79c142d/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 00:45:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:14 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:45:14 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:45:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.573s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:14 user nova-compute[74850]: DEBUG nova.compute.manager [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 00:45:14 user nova-compute[74850]: DEBUG nova.compute.manager [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 00:45:14 user nova-compute[74850]: DEBUG nova.network.neutron [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 00:45:14 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 00:45:14 user nova-compute[74850]: DEBUG nova.compute.manager [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 00:45:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:14 user nova-compute[74850]: DEBUG nova.policy [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7cb1b3c8b5c24f399c674f9dde90aadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c848440ceb46dabf1eb8cca6533f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 00:45:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Acquiring lock "937d7470-ec86-4972-b975-257d626329dd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Lock "937d7470-ec86-4972-b975-257d626329dd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:14 user nova-compute[74850]: DEBUG nova.compute.manager [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 00:45:14 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 00:45:14 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Creating image(s)
Nov 14 00:45:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Acquiring lock "/opt/stack/data/nova/instances/28212eec-99be-4171-97ed-7748bbb75c88/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "/opt/stack/data/nova/instances/28212eec-99be-4171-97ed-7748bbb75c88/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "/opt/stack/data/nova/instances/28212eec-99be-4171-97ed-7748bbb75c88/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:14 user nova-compute[74850]: DEBUG nova.compute.manager [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 00:45:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:14 user nova-compute[74850]: DEBUG nova.network.neutron [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Successfully updated port: 4a56ca60-9419-4150-8a41-81d8709e001c {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:45:14 user nova-compute[74850]: DEBUG nova.compute.manager [req-89af54cf-e61c-4ca9-8685-51f4de8abe6a req-2856aed0-a979-4345-a9a8-a24970846edb service nova] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Received event network-changed-4a56ca60-9419-4150-8a41-81d8709e001c {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:14 user nova-compute[74850]: DEBUG nova.compute.manager [req-89af54cf-e61c-4ca9-8685-51f4de8abe6a req-2856aed0-a979-4345-a9a8-a24970846edb service nova] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Refreshing instance network info cache due to event network-changed-4a56ca60-9419-4150-8a41-81d8709e001c. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:45:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-89af54cf-e61c-4ca9-8685-51f4de8abe6a req-2856aed0-a979-4345-a9a8-a24970846edb service nova] Acquiring lock "refresh_cache-7f1a88ea-83a3-447b-a83d-40b2c1c908f5" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:45:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-89af54cf-e61c-4ca9-8685-51f4de8abe6a req-2856aed0-a979-4345-a9a8-a24970846edb service nova] Acquired lock "refresh_cache-7f1a88ea-83a3-447b-a83d-40b2c1c908f5" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:45:14 user nova-compute[74850]: DEBUG nova.network.neutron [req-89af54cf-e61c-4ca9-8685-51f4de8abe6a req-2856aed0-a979-4345-a9a8-a24970846edb service nova] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Refreshing network info cache for port 4a56ca60-9419-4150-8a41-81d8709e001c {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:45:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Acquiring lock "refresh_cache-7f1a88ea-83a3-447b-a83d-40b2c1c908f5" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:45:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.214s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:15 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 00:45:15 user nova-compute[74850]: INFO nova.compute.claims [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Claim successful on node user
Nov 14 00:45:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.210s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/28212eec-99be-4171-97ed-7748bbb75c88/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:15 user nova-compute[74850]: DEBUG nova.network.neutron [req-89af54cf-e61c-4ca9-8685-51f4de8abe6a req-2856aed0-a979-4345-a9a8-a24970846edb service nova] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:45:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/28212eec-99be-4171-97ed-7748bbb75c88/disk 1073741824" returned: 0 in 0.084s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:15 user nova-compute[74850]: DEBUG nova.compute.manager [req-0734a715-2d78-4768-9e40-580ee7cc3f37 req-193e1b98-08bc-4c39-8738-14bf0bf4592b service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Received event network-vif-plugged-f0de03a3-fd19-4cd1-a408-5168dcf267d7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-0734a715-2d78-4768-9e40-580ee7cc3f37 req-193e1b98-08bc-4c39-8738-14bf0bf4592b service nova] Acquiring lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-0734a715-2d78-4768-9e40-580ee7cc3f37 req-193e1b98-08bc-4c39-8738-14bf0bf4592b service nova] Lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-0734a715-2d78-4768-9e40-580ee7cc3f37 req-193e1b98-08bc-4c39-8738-14bf0bf4592b service nova] Lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:15 user nova-compute[74850]: DEBUG nova.compute.manager [req-0734a715-2d78-4768-9e40-580ee7cc3f37 req-193e1b98-08bc-4c39-8738-14bf0bf4592b service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] No waiting events found dispatching network-vif-plugged-f0de03a3-fd19-4cd1-a408-5168dcf267d7 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:45:15 user nova-compute[74850]: WARNING nova.compute.manager [req-0734a715-2d78-4768-9e40-580ee7cc3f37 req-193e1b98-08bc-4c39-8738-14bf0bf4592b service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Received unexpected event network-vif-plugged-f0de03a3-fd19-4cd1-a408-5168dcf267d7 for instance with vm_state active and task_state None.
Nov 14 00:45:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.223s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:15 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Checking if we can resize image /opt/stack/data/nova/instances/28212eec-99be-4171-97ed-7748bbb75c88/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 00:45:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28212eec-99be-4171-97ed-7748bbb75c88/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:15 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:45:15 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:45:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28212eec-99be-4171-97ed-7748bbb75c88/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:15 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Cannot resize image /opt/stack/data/nova/instances/28212eec-99be-4171-97ed-7748bbb75c88/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 00:45:15 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 00:45:15 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Ensure instance console log exists: /opt/stack/data/nova/instances/28212eec-99be-4171-97ed-7748bbb75c88/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 00:45:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.711s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:15 user nova-compute[74850]: DEBUG nova.compute.manager [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 00:45:15 user nova-compute[74850]: DEBUG nova.compute.manager [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 00:45:15 user nova-compute[74850]: DEBUG nova.network.neutron [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 00:45:16 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 00:45:16 user nova-compute[74850]: DEBUG nova.compute.manager [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 00:45:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Acquiring lock "b54b37bc-8c90-4c48-a943-e489e830b93b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Lock "b54b37bc-8c90-4c48-a943-e489e830b93b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:16 user nova-compute[74850]: DEBUG nova.compute.manager [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 00:45:16 user nova-compute[74850]: DEBUG nova.policy [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cd597d37ed9b48a1bfaa3da62b286ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ee2171e47543fa818dc601abc63ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 00:45:16 user nova-compute[74850]: DEBUG nova.network.neutron [req-89af54cf-e61c-4ca9-8685-51f4de8abe6a req-2856aed0-a979-4345-a9a8-a24970846edb service nova] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:45:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.007s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-89af54cf-e61c-4ca9-8685-51f4de8abe6a req-2856aed0-a979-4345-a9a8-a24970846edb service nova] Releasing lock "refresh_cache-7f1a88ea-83a3-447b-a83d-40b2c1c908f5" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:45:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Acquired lock "refresh_cache-7f1a88ea-83a3-447b-a83d-40b2c1c908f5" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:45:16 user nova-compute[74850]: DEBUG nova.network.neutron [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:45:16 user nova-compute[74850]: DEBUG nova.compute.manager [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 00:45:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 00:45:16 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Creating image(s)
Nov 14 00:45:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Acquiring lock "/opt/stack/data/nova/instances/937d7470-ec86-4972-b975-257d626329dd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Lock "/opt/stack/data/nova/instances/937d7470-ec86-4972-b975-257d626329dd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Lock "/opt/stack/data/nova/instances/937d7470-ec86-4972-b975-257d626329dd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:16 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 00:45:16 user nova-compute[74850]: INFO nova.compute.claims [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Claim successful on node user
Nov 14 00:45:16 user nova-compute[74850]: DEBUG nova.network.neutron [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Successfully created port: 9df19d5e-989a-48d6-97ce-03b6a897a611 {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:45:16 user nova-compute[74850]: DEBUG nova.network.neutron [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:45:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.226s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:16 user nova-compute[74850]: DEBUG nova.network.neutron [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Successfully updated port: f8d36bc2-b85b-4eaf-8c22-e58c9dae360d {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:45:16 user nova-compute[74850]: DEBUG nova.compute.manager [req-9ea7fe86-ffbe-46c5-b0ce-50c664c1b66e req-6871124a-69ee-4ced-9d72-c454e8998eed service nova] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Received event network-vif-plugged-ff543781-9ab0-418a-ab62-1a74ee0ed1a9 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9ea7fe86-ffbe-46c5-b0ce-50c664c1b66e req-6871124a-69ee-4ced-9d72-c454e8998eed service nova] Acquiring lock "1879be4c-9226-4c8c-a56c-f8e37398851b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9ea7fe86-ffbe-46c5-b0ce-50c664c1b66e req-6871124a-69ee-4ced-9d72-c454e8998eed service nova] Lock "1879be4c-9226-4c8c-a56c-f8e37398851b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9ea7fe86-ffbe-46c5-b0ce-50c664c1b66e req-6871124a-69ee-4ced-9d72-c454e8998eed service nova] Lock "1879be4c-9226-4c8c-a56c-f8e37398851b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:16 user nova-compute[74850]: DEBUG nova.compute.manager [req-9ea7fe86-ffbe-46c5-b0ce-50c664c1b66e req-6871124a-69ee-4ced-9d72-c454e8998eed service nova] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] No waiting events found dispatching network-vif-plugged-ff543781-9ab0-418a-ab62-1a74ee0ed1a9 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:45:16 user nova-compute[74850]: WARNING nova.compute.manager [req-9ea7fe86-ffbe-46c5-b0ce-50c664c1b66e req-6871124a-69ee-4ced-9d72-c454e8998eed service nova] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Received unexpected event network-vif-plugged-ff543781-9ab0-418a-ab62-1a74ee0ed1a9 for instance with vm_state active and task_state None.
Nov 14 00:45:16 user nova-compute[74850]: DEBUG nova.compute.manager [req-9ea7fe86-ffbe-46c5-b0ce-50c664c1b66e req-6871124a-69ee-4ced-9d72-c454e8998eed service nova] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Received event network-vif-plugged-ff543781-9ab0-418a-ab62-1a74ee0ed1a9 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9ea7fe86-ffbe-46c5-b0ce-50c664c1b66e req-6871124a-69ee-4ced-9d72-c454e8998eed service nova] Acquiring lock "1879be4c-9226-4c8c-a56c-f8e37398851b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9ea7fe86-ffbe-46c5-b0ce-50c664c1b66e req-6871124a-69ee-4ced-9d72-c454e8998eed service nova] Lock "1879be4c-9226-4c8c-a56c-f8e37398851b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9ea7fe86-ffbe-46c5-b0ce-50c664c1b66e req-6871124a-69ee-4ced-9d72-c454e8998eed service nova] Lock "1879be4c-9226-4c8c-a56c-f8e37398851b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:16 user nova-compute[74850]: DEBUG nova.compute.manager [req-9ea7fe86-ffbe-46c5-b0ce-50c664c1b66e req-6871124a-69ee-4ced-9d72-c454e8998eed service nova] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] No waiting events found dispatching network-vif-plugged-ff543781-9ab0-418a-ab62-1a74ee0ed1a9 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:45:16 user nova-compute[74850]: WARNING nova.compute.manager [req-9ea7fe86-ffbe-46c5-b0ce-50c664c1b66e req-6871124a-69ee-4ced-9d72-c454e8998eed service nova] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Received unexpected event network-vif-plugged-ff543781-9ab0-418a-ab62-1a74ee0ed1a9 for instance with vm_state active and task_state None.
Nov 14 00:45:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Acquiring lock "refresh_cache-4a2881e6-ee6e-4165-a6d9-35fda79c142d" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:45:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Acquired lock "refresh_cache-4a2881e6-ee6e-4165-a6d9-35fda79c142d" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:45:16 user nova-compute[74850]: DEBUG nova.network.neutron [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:45:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.240s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/937d7470-ec86-4972-b975-257d626329dd/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/937d7470-ec86-4972-b975-257d626329dd/disk 1073741824" returned: 0 in 0.076s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.330s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.780s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.compute.manager [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.network.neutron [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.208s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Checking if we can resize image /opt/stack/data/nova/instances/937d7470-ec86-4972-b975-257d626329dd/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937d7470-ec86-4972-b975-257d626329dd/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.compute.manager [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.network.neutron [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 00:45:17 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.compute.manager [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.network.neutron [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Updating instance_info_cache with network_info: [{"id": "4a56ca60-9419-4150-8a41-81d8709e001c", "address": "fa:16:3e:3f:05:00", "network": {"id": "a510ed73-2a44-4945-9e3c-685351d93486", "bridge": "br-int", "label": "tempest-VolumesActionsTest-957592581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8cae3e5d11c40f0b499837464422c86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a56ca60-94", "ovs_interfaceid": "4a56ca60-9419-4150-8a41-81d8709e001c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Releasing lock "refresh_cache-7f1a88ea-83a3-447b-a83d-40b2c1c908f5" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.compute.manager [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Instance network_info: |[{"id": "4a56ca60-9419-4150-8a41-81d8709e001c", "address": "fa:16:3e:3f:05:00", "network": {"id": "a510ed73-2a44-4945-9e3c-685351d93486", "bridge": "br-int", "label": "tempest-VolumesActionsTest-957592581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8cae3e5d11c40f0b499837464422c86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a56ca60-94", "ovs_interfaceid": "4a56ca60-9419-4150-8a41-81d8709e001c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Start _get_guest_xml network_info=[{"id": "4a56ca60-9419-4150-8a41-81d8709e001c", "address": "fa:16:3e:3f:05:00", "network": {"id": "a510ed73-2a44-4945-9e3c-685351d93486", "bridge": "br-int", "label": "tempest-VolumesActionsTest-957592581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8cae3e5d11c40f0b499837464422c86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a56ca60-94", "ovs_interfaceid": "4a56ca60-9419-4150-8a41-81d8709e001c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:45:17 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:45:17 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:45:17 user nova-compute[74850]: INFO nova.virt.block_device [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Booting with volume ef003978-0c16-4a36-b762-c86ac032e85a at /dev/vda
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1568629676',display_name='tempest-VolumesActionsTest-instance-1568629676',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1568629676',id=4,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8cae3e5d11c40f0b499837464422c86',ramdisk_id='',reservation_id='r-0b4jjfsf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-810325091',owner_user_name='tempest-VolumesActionsTest-810325091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:10Z,user_data=None,user_id='895d12a3660d43ffbdbc8cd4d5e1b989',uuid=7f1a88ea-83a3-447b-a83d-40b2c1c908f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a56ca60-9419-4150-8a41-81d8709e001c", "address": "fa:16:3e:3f:05:00", "network": {"id": "a510ed73-2a44-4945-9e3c-685351d93486", "bridge": "br-int", "label": "tempest-VolumesActionsTest-957592581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8cae3e5d11c40f0b499837464422c86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a56ca60-94", "ovs_interfaceid": "4a56ca60-9419-4150-8a41-81d8709e001c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Converting VIF {"id": "4a56ca60-9419-4150-8a41-81d8709e001c", "address": "fa:16:3e:3f:05:00", "network": {"id": "a510ed73-2a44-4945-9e3c-685351d93486", "bridge": "br-int", "label": "tempest-VolumesActionsTest-957592581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8cae3e5d11c40f0b499837464422c86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a56ca60-94", "ovs_interfaceid": "4a56ca60-9419-4150-8a41-81d8709e001c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:05:00,bridge_name='br-int',has_traffic_filtering=True,id=4a56ca60-9419-4150-8a41-81d8709e001c,network=Network(a510ed73-2a44-4945-9e3c-685351d93486),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a56ca60-94') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.objects.instance [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f1a88ea-83a3-447b-a83d-40b2c1c908f5 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.policy [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a609a827db1a4e2ca232e7bc8880ed0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c05ffa95fcf49d6a87d6dad2b3f0983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.compute.manager [req-95877379-2d20-4b64-ae75-04f3162b6672 req-4628875c-0a29-456e-a1a7-a41bb2ee4d62 service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Received event network-vif-plugged-f0de03a3-fd19-4cd1-a408-5168dcf267d7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-95877379-2d20-4b64-ae75-04f3162b6672 req-4628875c-0a29-456e-a1a7-a41bb2ee4d62 service nova] Acquiring lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-95877379-2d20-4b64-ae75-04f3162b6672 req-4628875c-0a29-456e-a1a7-a41bb2ee4d62 service nova] Lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-95877379-2d20-4b64-ae75-04f3162b6672 req-4628875c-0a29-456e-a1a7-a41bb2ee4d62 service nova] Lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.compute.manager [req-95877379-2d20-4b64-ae75-04f3162b6672 req-4628875c-0a29-456e-a1a7-a41bb2ee4d62 service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] No waiting events found dispatching network-vif-plugged-f0de03a3-fd19-4cd1-a408-5168dcf267d7 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:45:17 user nova-compute[74850]: WARNING nova.compute.manager [req-95877379-2d20-4b64-ae75-04f3162b6672 req-4628875c-0a29-456e-a1a7-a41bb2ee4d62 service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Received unexpected event network-vif-plugged-f0de03a3-fd19-4cd1-a408-5168dcf267d7 for instance with vm_state active and task_state None.
Nov 14 00:45:17 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937d7470-ec86-4972-b975-257d626329dd/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.network.neutron [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Successfully updated port: 9df19d5e-989a-48d6-97ce-03b6a897a611 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:45:17 user nova-compute[74850]:   <uuid>7f1a88ea-83a3-447b-a83d-40b2c1c908f5</uuid>
Nov 14 00:45:17 user nova-compute[74850]:   <name>instance-00000004</name>
Nov 14 00:45:17 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:45:17 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:45:17 user nova-compute[74850]:   <metadata>
Nov 14 00:45:17 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:45:17 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:45:17 user nova-compute[74850]:       <nova:name>tempest-VolumesActionsTest-instance-1568629676</nova:name>
Nov 14 00:45:17 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:45:17</nova:creationTime>
Nov 14 00:45:17 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:45:17 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:45:17 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:45:17 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:45:17 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:45:17 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:45:17 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:45:17 user nova-compute[74850]:       <nova:owner>
Nov 14 00:45:17 user nova-compute[74850]:         <nova:user uuid="895d12a3660d43ffbdbc8cd4d5e1b989">tempest-VolumesActionsTest-810325091-project-member</nova:user>
Nov 14 00:45:17 user nova-compute[74850]:         <nova:project uuid="d8cae3e5d11c40f0b499837464422c86">tempest-VolumesActionsTest-810325091</nova:project>
Nov 14 00:45:17 user nova-compute[74850]:       </nova:owner>
Nov 14 00:45:17 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:45:17 user nova-compute[74850]:       <nova:ports>
Nov 14 00:45:17 user nova-compute[74850]:         <nova:port uuid="4a56ca60-9419-4150-8a41-81d8709e001c">
Nov 14 00:45:17 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 00:45:17 user nova-compute[74850]:         </nova:port>
Nov 14 00:45:17 user nova-compute[74850]:       </nova:ports>
Nov 14 00:45:17 user nova-compute[74850]:     </nova:instance>
Nov 14 00:45:17 user nova-compute[74850]:   </metadata>
Nov 14 00:45:17 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:45:17 user nova-compute[74850]:     <system>
Nov 14 00:45:17 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:45:17 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:45:17 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:45:17 user nova-compute[74850]:       <entry name="serial">7f1a88ea-83a3-447b-a83d-40b2c1c908f5</entry>
Nov 14 00:45:17 user nova-compute[74850]:       <entry name="uuid">7f1a88ea-83a3-447b-a83d-40b2c1c908f5</entry>
Nov 14 00:45:17 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:45:17 user nova-compute[74850]:     </system>
Nov 14 00:45:17 user nova-compute[74850]:   </sysinfo>
Nov 14 00:45:17 user nova-compute[74850]:   <os>
Nov 14 00:45:17 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:45:17 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 00:45:17 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:45:17 user nova-compute[74850]:   </os>
Nov 14 00:45:17 user nova-compute[74850]:   <features>
Nov 14 00:45:17 user nova-compute[74850]:     <acpi/>
Nov 14 00:45:17 user nova-compute[74850]:     <apic/>
Nov 14 00:45:17 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:45:17 user nova-compute[74850]:   </features>
Nov 14 00:45:17 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:45:17 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:45:17 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:45:17 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:45:17 user nova-compute[74850]:   </clock>
Nov 14 00:45:17 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:45:17 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:45:17 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:45:17 user nova-compute[74850]:   </cpu>
Nov 14 00:45:17 user nova-compute[74850]:   <devices>
Nov 14 00:45:17 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 00:45:17 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:45:17 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/7f1a88ea-83a3-447b-a83d-40b2c1c908f5/disk"/>
Nov 14 00:45:17 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:45:17 user nova-compute[74850]:     </disk>
Nov 14 00:45:17 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:45:17 user nova-compute[74850]:       <mac address="fa:16:3e:3f:05:00"/>
Nov 14 00:45:17 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:45:17 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:45:17 user nova-compute[74850]:       <target dev="tap4a56ca60-94"/>
Nov 14 00:45:17 user nova-compute[74850]:     </interface>
Nov 14 00:45:17 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:45:17 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/7f1a88ea-83a3-447b-a83d-40b2c1c908f5/console.log" append="off"/>
Nov 14 00:45:17 user nova-compute[74850]:     </serial>
Nov 14 00:45:17 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:45:17 user nova-compute[74850]:     <video>
Nov 14 00:45:17 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:45:17 user nova-compute[74850]:     </video>
Nov 14 00:45:17 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:45:17 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:45:17 user nova-compute[74850]:     </rng>
Nov 14 00:45:17 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:45:17 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:45:17 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:45:17 user nova-compute[74850]:     </memballoon>
Nov 14 00:45:17 user nova-compute[74850]:   </devices>
Nov 14 00:45:17 user nova-compute[74850]: </domain>
Nov 14 00:45:17 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1568629676',display_name='tempest-VolumesActionsTest-instance-1568629676',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1568629676',id=4,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8cae3e5d11c40f0b499837464422c86',ramdisk_id='',reservation_id='r-0b4jjfsf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-810325091',owner_user_name='tempest-VolumesActionsTest-810325091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:10Z,user_data=None,user_id='895d12a3660d43ffbdbc8cd4d5e1b989',uuid=7f1a88ea-83a3-447b-a83d-40b2c1c908f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a56ca60-9419-4150-8a41-81d8709e001c", "address": "fa:16:3e:3f:05:00", "network": {"id": "a510ed73-2a44-4945-9e3c-685351d93486", "bridge": "br-int", "label": "tempest-VolumesActionsTest-957592581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8cae3e5d11c40f0b499837464422c86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a56ca60-94", "ovs_interfaceid": "4a56ca60-9419-4150-8a41-81d8709e001c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Converting VIF {"id": "4a56ca60-9419-4150-8a41-81d8709e001c", "address": "fa:16:3e:3f:05:00", "network": {"id": "a510ed73-2a44-4945-9e3c-685351d93486", "bridge": "br-int", "label": "tempest-VolumesActionsTest-957592581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8cae3e5d11c40f0b499837464422c86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a56ca60-94", "ovs_interfaceid": "4a56ca60-9419-4150-8a41-81d8709e001c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:05:00,bridge_name='br-int',has_traffic_filtering=True,id=4a56ca60-9419-4150-8a41-81d8709e001c,network=Network(a510ed73-2a44-4945-9e3c-685351d93486),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a56ca60-94') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG os_vif [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:05:00,bridge_name='br-int',has_traffic_filtering=True,id=4a56ca60-9419-4150-8a41-81d8709e001c,network=Network(a510ed73-2a44-4945-9e3c-685351d93486),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a56ca60-94') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Cannot resize image /opt/stack/data/nova/instances/937d7470-ec86-4972-b975-257d626329dd/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Ensure instance console log exists: /opt/stack/data/nova/instances/937d7470-ec86-4972-b975-257d626329dd/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Acquiring lock "refresh_cache-28212eec-99be-4171-97ed-7748bbb75c88" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Acquired lock "refresh_cache-28212eec-99be-4171-97ed-7748bbb75c88" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.network.neutron [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b39d9be1-bfe1-5ac5-99c8-e7872a451157', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a56ca60-94, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4a56ca60-94, col_values=(('qos', UUID('5cb375bf-63fe-4435-9853-7376a0b04d22')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4a56ca60-94, col_values=(('external_ids', {'iface-id': '4a56ca60-9419-4150-8a41-81d8709e001c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:05:00', 'vm-uuid': '7f1a88ea-83a3-447b-a83d-40b2c1c908f5'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:17 user nova-compute[74850]: INFO os_vif [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:05:00,bridge_name='br-int',has_traffic_filtering=True,id=4a56ca60-9419-4150-8a41-81d8709e001c,network=Network(a510ed73-2a44-4945-9e3c-685351d93486),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a56ca60-94')
Nov 14 00:45:17 user nova-compute[74850]: DEBUG os_brick.utils [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:45:17 user nova-compute[74850]: INFO oslo.privsep.daemon [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpqax44e2v/privsep.sock']
Nov 14 00:45:17 user sudo[84845]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpqax44e2v/privsep.sock
Nov 14 00:45:17 user sudo[84845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] No VIF found with MAC fa:16:3e:3f:05:00, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.network.neutron [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Successfully created port: 2df12354-6de2-49fd-812e-1354c7c87039 {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:45:17 user nova-compute[74850]: DEBUG nova.network.neutron [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG nova.network.neutron [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Updating instance_info_cache with network_info: [{"id": "f8d36bc2-b85b-4eaf-8c22-e58c9dae360d", "address": "fa:16:3e:65:0b:b4", "network": {"id": "db670808-a8f8-441f-aa30-b55187e39c46", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-972081880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dd0e10c315346cabe45d8cb1596b3dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d36bc2-b8", "ovs_interfaceid": "f8d36bc2-b85b-4eaf-8c22-e58c9dae360d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Releasing lock "refresh_cache-4a2881e6-ee6e-4165-a6d9-35fda79c142d" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG nova.compute.manager [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Instance network_info: |[{"id": "f8d36bc2-b85b-4eaf-8c22-e58c9dae360d", "address": "fa:16:3e:65:0b:b4", "network": {"id": "db670808-a8f8-441f-aa30-b55187e39c46", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-972081880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dd0e10c315346cabe45d8cb1596b3dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d36bc2-b8", "ovs_interfaceid": "f8d36bc2-b85b-4eaf-8c22-e58c9dae360d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Start _get_guest_xml network_info=[{"id": "f8d36bc2-b85b-4eaf-8c22-e58c9dae360d", "address": "fa:16:3e:65:0b:b4", "network": {"id": "db670808-a8f8-441f-aa30-b55187e39c46", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-972081880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dd0e10c315346cabe45d8cb1596b3dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d36bc2-b8", "ovs_interfaceid": "f8d36bc2-b85b-4eaf-8c22-e58c9dae360d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:45:00Z,direct_url=<?>,disk_format='qcow2',id=ed4d3d48-93f7-4f21-b25a-975b83645c87,min_disk=0,min_ram=0,name='',owner='d6366310bc304fcaa3c7c8a3e3215463',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:45:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_name': '/dev/sda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'scsi', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': 'ed4d3d48-93f7-4f21-b25a-975b83645c87'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:45:18 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:45:18 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:45:18 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:45:00Z,direct_url=<?>,disk_format='qcow2',id=ed4d3d48-93f7-4f21-b25a-975b83645c87,min_disk=0,min_ram=0,name='',owner='d6366310bc304fcaa3c7c8a3e3215463',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:45:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1167620568',display_name='tempest-AttachSCSIVolumeTestJSON-server-1167620568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1167620568',id=5,image_ref='ed4d3d48-93f7-4f21-b25a-975b83645c87',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJpJE//2+b9Lwr20uwQ6rghkZwQW/qTLXJVAtl2f1x2vw82BauGLHnV3rYuZw6wqfvi6QHg6rZLvZHGkGbWHtekLKHLMnT/xSi54YLZMks8pJJrQFj0fAMduEVPanSf5YA==',key_name='tempest-keypair-1892965077',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0dd0e10c315346cabe45d8cb1596b3dd',ramdisk_id='',reservation_id='r-5vved0vh',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ed4d3d48-93f7-4f21-b25a-975b83645c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1513679227',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1513679227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8611932bd704d8ea467ee48ba50ce8b',uuid=4a2881e6-ee6e-4165-a6d9-35fda79c142d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8d36bc2-b85b-4eaf-8c22-e58c9dae360d", "address": "fa:16:3e:65:0b:b4", "network": {"id": "db670808-a8f8-441f-aa30-b55187e39c46", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-972081880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dd0e10c315346cabe45d8cb1596b3dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d36bc2-b8", "ovs_interfaceid": "f8d36bc2-b85b-4eaf-8c22-e58c9dae360d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Converting VIF {"id": "f8d36bc2-b85b-4eaf-8c22-e58c9dae360d", "address": "fa:16:3e:65:0b:b4", "network": {"id": "db670808-a8f8-441f-aa30-b55187e39c46", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-972081880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dd0e10c315346cabe45d8cb1596b3dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d36bc2-b8", "ovs_interfaceid": "f8d36bc2-b85b-4eaf-8c22-e58c9dae360d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:0b:b4,bridge_name='br-int',has_traffic_filtering=True,id=f8d36bc2-b85b-4eaf-8c22-e58c9dae360d,network=Network(db670808-a8f8-441f-aa30-b55187e39c46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8d36bc2-b8') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG nova.objects.instance [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a2881e6-ee6e-4165-a6d9-35fda79c142d {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:45:18 user nova-compute[74850]:   <uuid>4a2881e6-ee6e-4165-a6d9-35fda79c142d</uuid>
Nov 14 00:45:18 user nova-compute[74850]:   <name>instance-00000005</name>
Nov 14 00:45:18 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:45:18 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:45:18 user nova-compute[74850]:   <metadata>
Nov 14 00:45:18 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:45:18 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:45:18 user nova-compute[74850]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1167620568</nova:name>
Nov 14 00:45:18 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:45:18</nova:creationTime>
Nov 14 00:45:18 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:45:18 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:45:18 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:45:18 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:45:18 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:45:18 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:45:18 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:45:18 user nova-compute[74850]:       <nova:owner>
Nov 14 00:45:18 user nova-compute[74850]:         <nova:user uuid="c8611932bd704d8ea467ee48ba50ce8b">tempest-AttachSCSIVolumeTestJSON-1513679227-project-member</nova:user>
Nov 14 00:45:18 user nova-compute[74850]:         <nova:project uuid="0dd0e10c315346cabe45d8cb1596b3dd">tempest-AttachSCSIVolumeTestJSON-1513679227</nova:project>
Nov 14 00:45:18 user nova-compute[74850]:       </nova:owner>
Nov 14 00:45:18 user nova-compute[74850]:       <nova:root type="image" uuid="ed4d3d48-93f7-4f21-b25a-975b83645c87"/>
Nov 14 00:45:18 user nova-compute[74850]:       <nova:ports>
Nov 14 00:45:18 user nova-compute[74850]:         <nova:port uuid="f8d36bc2-b85b-4eaf-8c22-e58c9dae360d">
Nov 14 00:45:18 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 00:45:18 user nova-compute[74850]:         </nova:port>
Nov 14 00:45:18 user nova-compute[74850]:       </nova:ports>
Nov 14 00:45:18 user nova-compute[74850]:     </nova:instance>
Nov 14 00:45:18 user nova-compute[74850]:   </metadata>
Nov 14 00:45:18 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:45:18 user nova-compute[74850]:     <system>
Nov 14 00:45:18 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:45:18 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:45:18 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:45:18 user nova-compute[74850]:       <entry name="serial">4a2881e6-ee6e-4165-a6d9-35fda79c142d</entry>
Nov 14 00:45:18 user nova-compute[74850]:       <entry name="uuid">4a2881e6-ee6e-4165-a6d9-35fda79c142d</entry>
Nov 14 00:45:18 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:45:18 user nova-compute[74850]:     </system>
Nov 14 00:45:18 user nova-compute[74850]:   </sysinfo>
Nov 14 00:45:18 user nova-compute[74850]:   <os>
Nov 14 00:45:18 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:45:18 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 00:45:18 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:45:18 user nova-compute[74850]:   </os>
Nov 14 00:45:18 user nova-compute[74850]:   <features>
Nov 14 00:45:18 user nova-compute[74850]:     <acpi/>
Nov 14 00:45:18 user nova-compute[74850]:     <apic/>
Nov 14 00:45:18 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:45:18 user nova-compute[74850]:   </features>
Nov 14 00:45:18 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:45:18 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:45:18 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:45:18 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:45:18 user nova-compute[74850]:   </clock>
Nov 14 00:45:18 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:45:18 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:45:18 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:45:18 user nova-compute[74850]:   </cpu>
Nov 14 00:45:18 user nova-compute[74850]:   <devices>
Nov 14 00:45:18 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 00:45:18 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:45:18 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/4a2881e6-ee6e-4165-a6d9-35fda79c142d/disk"/>
Nov 14 00:45:18 user nova-compute[74850]:       <target dev="sda" bus="scsi"/>
Nov 14 00:45:18 user nova-compute[74850]:       <address type="drive" controller="0" unit="0"/>
Nov 14 00:45:18 user nova-compute[74850]:     </disk>
Nov 14 00:45:18 user nova-compute[74850]:     <disk type="file" device="cdrom">
Nov 14 00:45:18 user nova-compute[74850]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 00:45:18 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/4a2881e6-ee6e-4165-a6d9-35fda79c142d/disk.config"/>
Nov 14 00:45:18 user nova-compute[74850]:       <target dev="sdb" bus="scsi"/>
Nov 14 00:45:18 user nova-compute[74850]:       <address type="drive" controller="0" unit="1"/>
Nov 14 00:45:18 user nova-compute[74850]:     </disk>
Nov 14 00:45:18 user nova-compute[74850]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 14 00:45:18 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:45:18 user nova-compute[74850]:       <mac address="fa:16:3e:65:0b:b4"/>
Nov 14 00:45:18 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:45:18 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:45:18 user nova-compute[74850]:       <target dev="tapf8d36bc2-b8"/>
Nov 14 00:45:18 user nova-compute[74850]:     </interface>
Nov 14 00:45:18 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:45:18 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/4a2881e6-ee6e-4165-a6d9-35fda79c142d/console.log" append="off"/>
Nov 14 00:45:18 user nova-compute[74850]:     </serial>
Nov 14 00:45:18 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:45:18 user nova-compute[74850]:     <video>
Nov 14 00:45:18 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:45:18 user nova-compute[74850]:     </video>
Nov 14 00:45:18 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:45:18 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:45:18 user nova-compute[74850]:     </rng>
Nov 14 00:45:18 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:45:18 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:45:18 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:45:18 user nova-compute[74850]:     </memballoon>
Nov 14 00:45:18 user nova-compute[74850]:   </devices>
Nov 14 00:45:18 user nova-compute[74850]: </domain>
Nov 14 00:45:18 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1167620568',display_name='tempest-AttachSCSIVolumeTestJSON-server-1167620568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1167620568',id=5,image_ref='ed4d3d48-93f7-4f21-b25a-975b83645c87',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJpJE//2+b9Lwr20uwQ6rghkZwQW/qTLXJVAtl2f1x2vw82BauGLHnV3rYuZw6wqfvi6QHg6rZLvZHGkGbWHtekLKHLMnT/xSi54YLZMks8pJJrQFj0fAMduEVPanSf5YA==',key_name='tempest-keypair-1892965077',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0dd0e10c315346cabe45d8cb1596b3dd',ramdisk_id='',reservation_id='r-5vved0vh',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ed4d3d48-93f7-4f21-b25a-975b83645c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1513679227',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1513679227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8611932bd704d8ea467ee48ba50ce8b',uuid=4a2881e6-ee6e-4165-a6d9-35fda79c142d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8d36bc2-b85b-4eaf-8c22-e58c9dae360d", "address": "fa:16:3e:65:0b:b4", "network": {"id": "db670808-a8f8-441f-aa30-b55187e39c46", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-972081880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dd0e10c315346cabe45d8cb1596b3dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d36bc2-b8", "ovs_interfaceid": "f8d36bc2-b85b-4eaf-8c22-e58c9dae360d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Converting VIF {"id": "f8d36bc2-b85b-4eaf-8c22-e58c9dae360d", "address": "fa:16:3e:65:0b:b4", "network": {"id": "db670808-a8f8-441f-aa30-b55187e39c46", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-972081880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dd0e10c315346cabe45d8cb1596b3dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d36bc2-b8", "ovs_interfaceid": "f8d36bc2-b85b-4eaf-8c22-e58c9dae360d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:0b:b4,bridge_name='br-int',has_traffic_filtering=True,id=f8d36bc2-b85b-4eaf-8c22-e58c9dae360d,network=Network(db670808-a8f8-441f-aa30-b55187e39c46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8d36bc2-b8') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG os_vif [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:0b:b4,bridge_name='br-int',has_traffic_filtering=True,id=f8d36bc2-b85b-4eaf-8c22-e58c9dae360d,network=Network(db670808-a8f8-441f-aa30-b55187e39c46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8d36bc2-b8') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f28e2947-738e-5345-8b79-1fe47cd1a837', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8d36bc2-b8, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf8d36bc2-b8, col_values=(('qos', UUID('f0b9ff75-ede3-4085-8e04-d5120d543820')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf8d36bc2-b8, col_values=(('external_ids', {'iface-id': 'f8d36bc2-b85b-4eaf-8c22-e58c9dae360d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:0b:b4', 'vm-uuid': '4a2881e6-ee6e-4165-a6d9-35fda79c142d'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:18 user nova-compute[74850]: INFO os_vif [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:0b:b4,bridge_name='br-int',has_traffic_filtering=True,id=f8d36bc2-b85b-4eaf-8c22-e58c9dae360d,network=Network(db670808-a8f8-441f-aa30-b55187e39c46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8d36bc2-b8')
Nov 14 00:45:18 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] No BDM found with device name sda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:45:18 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] No VIF found with MAC fa:16:3e:65:0b:b4, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:45:18 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Using config drive
Nov 14 00:45:18 user nova-compute[74850]: DEBUG nova.network.neutron [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Updating instance_info_cache with network_info: [{"id": "9df19d5e-989a-48d6-97ce-03b6a897a611", "address": "fa:16:3e:0f:98:91", "network": {"id": "25547f45-3d27-4a3f-b2d2-6f0a0b4ae730", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-464974831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51c848440ceb46dabf1eb8cca6533f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df19d5e-98", "ovs_interfaceid": "9df19d5e-989a-48d6-97ce-03b6a897a611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Releasing lock "refresh_cache-28212eec-99be-4171-97ed-7748bbb75c88" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.compute.manager [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Instance network_info: |[{"id": "9df19d5e-989a-48d6-97ce-03b6a897a611", "address": "fa:16:3e:0f:98:91", "network": {"id": "25547f45-3d27-4a3f-b2d2-6f0a0b4ae730", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-464974831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51c848440ceb46dabf1eb8cca6533f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df19d5e-98", "ovs_interfaceid": "9df19d5e-989a-48d6-97ce-03b6a897a611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Start _get_guest_xml network_info=[{"id": "9df19d5e-989a-48d6-97ce-03b6a897a611", "address": "fa:16:3e:0f:98:91", "network": {"id": "25547f45-3d27-4a3f-b2d2-6f0a0b4ae730", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-464974831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51c848440ceb46dabf1eb8cca6533f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df19d5e-98", "ovs_interfaceid": "9df19d5e-989a-48d6-97ce-03b6a897a611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.compute.manager [req-ea8faa1f-3055-4cb0-94e0-a1279ebdc117 req-7c4f0e2d-209e-4616-8cb7-efe3d646bd6f service nova] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Received event network-vif-plugged-792bf62b-99b4-4d65-a55b-4e97c64eb1c5 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ea8faa1f-3055-4cb0-94e0-a1279ebdc117 req-7c4f0e2d-209e-4616-8cb7-efe3d646bd6f service nova] Acquiring lock "1282f7f3-c81e-4a6e-bd86-42459f49674f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ea8faa1f-3055-4cb0-94e0-a1279ebdc117 req-7c4f0e2d-209e-4616-8cb7-efe3d646bd6f service nova] Lock "1282f7f3-c81e-4a6e-bd86-42459f49674f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ea8faa1f-3055-4cb0-94e0-a1279ebdc117 req-7c4f0e2d-209e-4616-8cb7-efe3d646bd6f service nova] Lock "1282f7f3-c81e-4a6e-bd86-42459f49674f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.compute.manager [req-ea8faa1f-3055-4cb0-94e0-a1279ebdc117 req-7c4f0e2d-209e-4616-8cb7-efe3d646bd6f service nova] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] No waiting events found dispatching network-vif-plugged-792bf62b-99b4-4d65-a55b-4e97c64eb1c5 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:45:19 user nova-compute[74850]: WARNING nova.compute.manager [req-ea8faa1f-3055-4cb0-94e0-a1279ebdc117 req-7c4f0e2d-209e-4616-8cb7-efe3d646bd6f service nova] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Received unexpected event network-vif-plugged-792bf62b-99b4-4d65-a55b-4e97c64eb1c5 for instance with vm_state active and task_state None.
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.compute.manager [req-66ff8e41-e5eb-45da-bb27-2a03a1421b04 req-25b7ffe9-ca70-4dc2-917f-acb4839ed606 service nova] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Received event network-changed-f8d36bc2-b85b-4eaf-8c22-e58c9dae360d {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.compute.manager [req-66ff8e41-e5eb-45da-bb27-2a03a1421b04 req-25b7ffe9-ca70-4dc2-917f-acb4839ed606 service nova] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Refreshing instance network info cache due to event network-changed-f8d36bc2-b85b-4eaf-8c22-e58c9dae360d. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-66ff8e41-e5eb-45da-bb27-2a03a1421b04 req-25b7ffe9-ca70-4dc2-917f-acb4839ed606 service nova] Acquiring lock "refresh_cache-4a2881e6-ee6e-4165-a6d9-35fda79c142d" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-66ff8e41-e5eb-45da-bb27-2a03a1421b04 req-25b7ffe9-ca70-4dc2-917f-acb4839ed606 service nova] Acquired lock "refresh_cache-4a2881e6-ee6e-4165-a6d9-35fda79c142d" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.network.neutron [req-66ff8e41-e5eb-45da-bb27-2a03a1421b04 req-25b7ffe9-ca70-4dc2-917f-acb4839ed606 service nova] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Refreshing network info cache for port f8d36bc2-b85b-4eaf-8c22-e58c9dae360d {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.network.neutron [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Successfully updated port: 2df12354-6de2-49fd-812e-1354c7c87039 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:19 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:45:19 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:45:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Acquiring lock "refresh_cache-937d7470-ec86-4972-b975-257d626329dd" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Acquired lock "refresh_cache-937d7470-ec86-4972-b975-257d626329dd" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.network.neutron [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:45:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1059306291',display_name='tempest-VolumesAdminNegativeTest-server-1059306291',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1059306291',id=6,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhJUU9eZjl3FrozfyRmoCSTjLzncoBh8dvibr45B8DO68emkQD4LZpTdLfE5f44ABqo/F2Rw84fSCrgYdDTjL7If4ziIYk1Fyhlp1w+H6fY55jpuKryvfrOLxVkpt/UGg==',key_name='tempest-keypair-809168273',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51c848440ceb46dabf1eb8cca6533f09',ramdisk_id='',reservation_id='r-54kq7tgh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-43619810',owner_user_name='tempest-VolumesAdminNegativeTest-43619810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cb1b3c8b5c24f399c674f9dde90aadc',uuid=28212eec-99be-4171-97ed-7748bbb75c88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9df19d5e-989a-48d6-97ce-03b6a897a611", "address": "fa:16:3e:0f:98:91", "network": {"id": "25547f45-3d27-4a3f-b2d2-6f0a0b4ae730", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-464974831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51c848440ceb46dabf1eb8cca6533f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df19d5e-98", "ovs_interfaceid": "9df19d5e-989a-48d6-97ce-03b6a897a611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Converting VIF {"id": "9df19d5e-989a-48d6-97ce-03b6a897a611", "address": "fa:16:3e:0f:98:91", "network": {"id": "25547f45-3d27-4a3f-b2d2-6f0a0b4ae730", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-464974831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51c848440ceb46dabf1eb8cca6533f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df19d5e-98", "ovs_interfaceid": "9df19d5e-989a-48d6-97ce-03b6a897a611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:98:91,bridge_name='br-int',has_traffic_filtering=True,id=9df19d5e-989a-48d6-97ce-03b6a897a611,network=Network(25547f45-3d27-4a3f-b2d2-6f0a0b4ae730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df19d5e-98') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.objects.instance [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lazy-loading 'pci_devices' on Instance uuid 28212eec-99be-4171-97ed-7748bbb75c88 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:45:19 user nova-compute[74850]:   <uuid>28212eec-99be-4171-97ed-7748bbb75c88</uuid>
Nov 14 00:45:19 user nova-compute[74850]:   <name>instance-00000006</name>
Nov 14 00:45:19 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:45:19 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:45:19 user nova-compute[74850]:   <metadata>
Nov 14 00:45:19 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:45:19 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:45:19 user nova-compute[74850]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1059306291</nova:name>
Nov 14 00:45:19 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:45:19</nova:creationTime>
Nov 14 00:45:19 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:45:19 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:45:19 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:45:19 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:45:19 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:45:19 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:45:19 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:45:19 user nova-compute[74850]:       <nova:owner>
Nov 14 00:45:19 user nova-compute[74850]:         <nova:user uuid="7cb1b3c8b5c24f399c674f9dde90aadc">tempest-VolumesAdminNegativeTest-43619810-project-member</nova:user>
Nov 14 00:45:19 user nova-compute[74850]:         <nova:project uuid="51c848440ceb46dabf1eb8cca6533f09">tempest-VolumesAdminNegativeTest-43619810</nova:project>
Nov 14 00:45:19 user nova-compute[74850]:       </nova:owner>
Nov 14 00:45:19 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:45:19 user nova-compute[74850]:       <nova:ports>
Nov 14 00:45:19 user nova-compute[74850]:         <nova:port uuid="9df19d5e-989a-48d6-97ce-03b6a897a611">
Nov 14 00:45:19 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 00:45:19 user nova-compute[74850]:         </nova:port>
Nov 14 00:45:19 user nova-compute[74850]:       </nova:ports>
Nov 14 00:45:19 user nova-compute[74850]:     </nova:instance>
Nov 14 00:45:19 user nova-compute[74850]:   </metadata>
Nov 14 00:45:19 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:45:19 user nova-compute[74850]:     <system>
Nov 14 00:45:19 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:45:19 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:45:19 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:45:19 user nova-compute[74850]:       <entry name="serial">28212eec-99be-4171-97ed-7748bbb75c88</entry>
Nov 14 00:45:19 user nova-compute[74850]:       <entry name="uuid">28212eec-99be-4171-97ed-7748bbb75c88</entry>
Nov 14 00:45:19 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:45:19 user nova-compute[74850]:     </system>
Nov 14 00:45:19 user nova-compute[74850]:   </sysinfo>
Nov 14 00:45:19 user nova-compute[74850]:   <os>
Nov 14 00:45:19 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:45:19 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 00:45:19 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:45:19 user nova-compute[74850]:   </os>
Nov 14 00:45:19 user nova-compute[74850]:   <features>
Nov 14 00:45:19 user nova-compute[74850]:     <acpi/>
Nov 14 00:45:19 user nova-compute[74850]:     <apic/>
Nov 14 00:45:19 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:45:19 user nova-compute[74850]:   </features>
Nov 14 00:45:19 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:45:19 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:45:19 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:45:19 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:45:19 user nova-compute[74850]:   </clock>
Nov 14 00:45:19 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:45:19 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:45:19 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:45:19 user nova-compute[74850]:   </cpu>
Nov 14 00:45:19 user nova-compute[74850]:   <devices>
Nov 14 00:45:19 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 00:45:19 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:45:19 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/28212eec-99be-4171-97ed-7748bbb75c88/disk"/>
Nov 14 00:45:19 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:45:19 user nova-compute[74850]:     </disk>
Nov 14 00:45:19 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:45:19 user nova-compute[74850]:       <mac address="fa:16:3e:0f:98:91"/>
Nov 14 00:45:19 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:45:19 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:45:19 user nova-compute[74850]:       <target dev="tap9df19d5e-98"/>
Nov 14 00:45:19 user nova-compute[74850]:     </interface>
Nov 14 00:45:19 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:45:19 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/28212eec-99be-4171-97ed-7748bbb75c88/console.log" append="off"/>
Nov 14 00:45:19 user nova-compute[74850]:     </serial>
Nov 14 00:45:19 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:45:19 user nova-compute[74850]:     <video>
Nov 14 00:45:19 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:45:19 user nova-compute[74850]:     </video>
Nov 14 00:45:19 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:45:19 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:45:19 user nova-compute[74850]:     </rng>
Nov 14 00:45:19 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:45:19 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:45:19 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:45:19 user nova-compute[74850]:     </memballoon>
Nov 14 00:45:19 user nova-compute[74850]:   </devices>
Nov 14 00:45:19 user nova-compute[74850]: </domain>
Nov 14 00:45:19 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:45:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1059306291',display_name='tempest-VolumesAdminNegativeTest-server-1059306291',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1059306291',id=6,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhJUU9eZjl3FrozfyRmoCSTjLzncoBh8dvibr45B8DO68emkQD4LZpTdLfE5f44ABqo/F2Rw84fSCrgYdDTjL7If4ziIYk1Fyhlp1w+H6fY55jpuKryvfrOLxVkpt/UGg==',key_name='tempest-keypair-809168273',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51c848440ceb46dabf1eb8cca6533f09',ramdisk_id='',reservation_id='r-54kq7tgh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-43619810',owner_user_name='tempest-VolumesAdminNegativeTest-43619810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cb1b3c8b5c24f399c674f9dde90aadc',uuid=28212eec-99be-4171-97ed-7748bbb75c88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9df19d5e-989a-48d6-97ce-03b6a897a611", "address": "fa:16:3e:0f:98:91", "network": {"id": "25547f45-3d27-4a3f-b2d2-6f0a0b4ae730", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-464974831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51c848440ceb46dabf1eb8cca6533f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df19d5e-98", "ovs_interfaceid": "9df19d5e-989a-48d6-97ce-03b6a897a611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Converting VIF {"id": "9df19d5e-989a-48d6-97ce-03b6a897a611", "address": "fa:16:3e:0f:98:91", "network": {"id": "25547f45-3d27-4a3f-b2d2-6f0a0b4ae730", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-464974831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51c848440ceb46dabf1eb8cca6533f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df19d5e-98", "ovs_interfaceid": "9df19d5e-989a-48d6-97ce-03b6a897a611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:98:91,bridge_name='br-int',has_traffic_filtering=True,id=9df19d5e-989a-48d6-97ce-03b6a897a611,network=Network(25547f45-3d27-4a3f-b2d2-6f0a0b4ae730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df19d5e-98') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG os_vif [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:98:91,bridge_name='br-int',has_traffic_filtering=True,id=9df19d5e-989a-48d6-97ce-03b6a897a611,network=Network(25547f45-3d27-4a3f-b2d2-6f0a0b4ae730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df19d5e-98') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7bab538c-35f3-5714-9b54-4693e4fdd7dc', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:19 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Creating config drive at /opt/stack/data/nova/instances/4a2881e6-ee6e-4165-a6d9-35fda79c142d/disk.config
Nov 14 00:45:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4a2881e6-ee6e-4165-a6d9-35fda79c142d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpcuqq85fz {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9df19d5e-98, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9df19d5e-98, col_values=(('qos', UUID('6e0601ca-d7e3-4800-ab2a-773312e7991e')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9df19d5e-98, col_values=(('external_ids', {'iface-id': '9df19d5e-989a-48d6-97ce-03b6a897a611', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:98:91', 'vm-uuid': '28212eec-99be-4171-97ed-7748bbb75c88'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.network.neutron [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4a2881e6-ee6e-4165-a6d9-35fda79c142d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpcuqq85fz" returned: 0 in 0.086s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:19 user nova-compute[74850]: INFO os_vif [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:98:91,bridge_name='br-int',has_traffic_filtering=True,id=9df19d5e-989a-48d6-97ce-03b6a897a611,network=Network(25547f45-3d27-4a3f-b2d2-6f0a0b4ae730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df19d5e-98')
Nov 14 00:45:19 user sudo[84845]: pam_unix(sudo:session): session closed for user root
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] No VIF found with MAC fa:16:3e:0f:98:91, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:45:19 user nova-compute[74850]: INFO oslo.privsep.daemon [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Spawned new privsep daemon via rootwrap
Nov 14 00:45:19 user nova-compute[74850]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 00:45:19 user nova-compute[74850]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 00:45:19 user nova-compute[74850]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 14 00:45:19 user nova-compute[74850]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84948
Nov 14 00:45:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abfb8da-e277-464f-8156-4e14f282592e]: (2,) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.compute.manager [req-838a2cbb-6319-4814-b6b5-c9d2032a2b29 req-af81678f-b2d6-4412-8e0f-172e6f7d426d service nova] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Received event network-changed-9df19d5e-989a-48d6-97ce-03b6a897a611 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.compute.manager [req-838a2cbb-6319-4814-b6b5-c9d2032a2b29 req-af81678f-b2d6-4412-8e0f-172e6f7d426d service nova] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Refreshing instance network info cache due to event network-changed-9df19d5e-989a-48d6-97ce-03b6a897a611. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-838a2cbb-6319-4814-b6b5-c9d2032a2b29 req-af81678f-b2d6-4412-8e0f-172e6f7d426d service nova] Acquiring lock "refresh_cache-28212eec-99be-4171-97ed-7748bbb75c88" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-838a2cbb-6319-4814-b6b5-c9d2032a2b29 req-af81678f-b2d6-4412-8e0f-172e6f7d426d service nova] Acquired lock "refresh_cache-28212eec-99be-4171-97ed-7748bbb75c88" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.network.neutron [req-838a2cbb-6319-4814-b6b5-c9d2032a2b29 req-af81678f-b2d6-4412-8e0f-172e6f7d426d service nova] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Refreshing network info cache for port 9df19d5e-989a-48d6-97ce-03b6a897a611 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3d486b-ec41-4681-b3d4-031dcbeeb83e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:19 user nova-compute[74850]: WARNING os_brick.initiator.connectors.nvmeof [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 14 00:45:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a87ac0-72ad-413d-999a-7980a7d2b9dd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab108eb8-dbc3-4d3d-b6c9-3ca8b6ef89c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b87dee-ff2e-400b-92eb-9df3731bd0ba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:45:19 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 00:45:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad156b8a-fd0b-4992-8c1b-bad9b23a5b4d]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG os_brick.utils [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] <== get_connector_properties: return (2258ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Updating existing volume attachment record: 05554ddb-ad19-4174-9567-133b15700abc {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG nova.network.neutron [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Updating instance_info_cache with network_info: [{"id": "2df12354-6de2-49fd-812e-1354c7c87039", "address": "fa:16:3e:4b:c7:91", "network": {"id": "dbe8caa9-0185-44cf-b45e-f5f0c0f3f81c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-413724990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ee2171e47543fa818dc601abc63ea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df12354-6d", "ovs_interfaceid": "2df12354-6de2-49fd-812e-1354c7c87039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG nova.network.neutron [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Successfully created port: 5db497e0-e507-4a13-b0ff-fb4f7608f94d {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Releasing lock "refresh_cache-937d7470-ec86-4972-b975-257d626329dd" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG nova.compute.manager [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Instance network_info: |[{"id": "2df12354-6de2-49fd-812e-1354c7c87039", "address": "fa:16:3e:4b:c7:91", "network": {"id": "dbe8caa9-0185-44cf-b45e-f5f0c0f3f81c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-413724990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ee2171e47543fa818dc601abc63ea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df12354-6d", "ovs_interfaceid": "2df12354-6de2-49fd-812e-1354c7c87039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Start _get_guest_xml network_info=[{"id": "2df12354-6de2-49fd-812e-1354c7c87039", "address": "fa:16:3e:4b:c7:91", "network": {"id": "dbe8caa9-0185-44cf-b45e-f5f0c0f3f81c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-413724990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ee2171e47543fa818dc601abc63ea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df12354-6d", "ovs_interfaceid": "2df12354-6de2-49fd-812e-1354c7c87039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:45:20 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:45:20 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:45:20 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:45:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-752047898',display_name='tempest-TestVolumeSwap-server-752047898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-752047898',id=7,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOoVNvkutJjwmkF9XeKrykcSE5UbP6yiCQ+agx7TDKNjdR1haAqEF0ZS1csyFhoXXvvItY/3Pp3GZEdxrmUjvmyQS9xL6wDMxPNdNfbQ9oXKzoDgh9fMXaR5qjh+qzJqQ==',key_name='tempest-keypair-635174324',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7ee2171e47543fa818dc601abc63ea0',ramdisk_id='',reservation_id='r-05xdstn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1639962610',owner_user_name='tempest-TestVolumeSwap-1639962610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd597d37ed9b48a1bfaa3da62b286ca7',uuid=937d7470-ec86-4972-b975-257d626329dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2df12354-6de2-49fd-812e-1354c7c87039", "address": "fa:16:3e:4b:c7:91", "network": {"id": "dbe8caa9-0185-44cf-b45e-f5f0c0f3f81c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-413724990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ee2171e47543fa818dc601abc63ea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df12354-6d", "ovs_interfaceid": "2df12354-6de2-49fd-812e-1354c7c87039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Converting VIF {"id": "2df12354-6de2-49fd-812e-1354c7c87039", "address": "fa:16:3e:4b:c7:91", "network": {"id": "dbe8caa9-0185-44cf-b45e-f5f0c0f3f81c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-413724990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ee2171e47543fa818dc601abc63ea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df12354-6d", "ovs_interfaceid": "2df12354-6de2-49fd-812e-1354c7c87039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:c7:91,bridge_name='br-int',has_traffic_filtering=True,id=2df12354-6de2-49fd-812e-1354c7c87039,network=Network(dbe8caa9-0185-44cf-b45e-f5f0c0f3f81c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df12354-6d') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG nova.objects.instance [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Lazy-loading 'pci_devices' on Instance uuid 937d7470-ec86-4972-b975-257d626329dd {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG nova.network.neutron [req-838a2cbb-6319-4814-b6b5-c9d2032a2b29 req-af81678f-b2d6-4412-8e0f-172e6f7d426d service nova] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Updated VIF entry in instance network info cache for port 9df19d5e-989a-48d6-97ce-03b6a897a611. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG nova.network.neutron [req-838a2cbb-6319-4814-b6b5-c9d2032a2b29 req-af81678f-b2d6-4412-8e0f-172e6f7d426d service nova] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Updating instance_info_cache with network_info: [{"id": "9df19d5e-989a-48d6-97ce-03b6a897a611", "address": "fa:16:3e:0f:98:91", "network": {"id": "25547f45-3d27-4a3f-b2d2-6f0a0b4ae730", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-464974831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51c848440ceb46dabf1eb8cca6533f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df19d5e-98", "ovs_interfaceid": "9df19d5e-989a-48d6-97ce-03b6a897a611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:45:20 user nova-compute[74850]:   <uuid>937d7470-ec86-4972-b975-257d626329dd</uuid>
Nov 14 00:45:20 user nova-compute[74850]:   <name>instance-00000007</name>
Nov 14 00:45:20 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:45:20 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:45:20 user nova-compute[74850]:   <metadata>
Nov 14 00:45:20 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:45:20 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:45:20 user nova-compute[74850]:       <nova:name>tempest-TestVolumeSwap-server-752047898</nova:name>
Nov 14 00:45:20 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:45:20</nova:creationTime>
Nov 14 00:45:20 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:45:20 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:45:20 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:45:20 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:45:20 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:45:20 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:45:20 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:45:20 user nova-compute[74850]:       <nova:owner>
Nov 14 00:45:20 user nova-compute[74850]:         <nova:user uuid="cd597d37ed9b48a1bfaa3da62b286ca7">tempest-TestVolumeSwap-1639962610-project-member</nova:user>
Nov 14 00:45:20 user nova-compute[74850]:         <nova:project uuid="f7ee2171e47543fa818dc601abc63ea0">tempest-TestVolumeSwap-1639962610</nova:project>
Nov 14 00:45:20 user nova-compute[74850]:       </nova:owner>
Nov 14 00:45:20 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:45:20 user nova-compute[74850]:       <nova:ports>
Nov 14 00:45:20 user nova-compute[74850]:         <nova:port uuid="2df12354-6de2-49fd-812e-1354c7c87039">
Nov 14 00:45:20 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 00:45:20 user nova-compute[74850]:         </nova:port>
Nov 14 00:45:20 user nova-compute[74850]:       </nova:ports>
Nov 14 00:45:20 user nova-compute[74850]:     </nova:instance>
Nov 14 00:45:20 user nova-compute[74850]:   </metadata>
Nov 14 00:45:20 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:45:20 user nova-compute[74850]:     <system>
Nov 14 00:45:20 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:45:20 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:45:20 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:45:20 user nova-compute[74850]:       <entry name="serial">937d7470-ec86-4972-b975-257d626329dd</entry>
Nov 14 00:45:20 user nova-compute[74850]:       <entry name="uuid">937d7470-ec86-4972-b975-257d626329dd</entry>
Nov 14 00:45:20 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:45:20 user nova-compute[74850]:     </system>
Nov 14 00:45:20 user nova-compute[74850]:   </sysinfo>
Nov 14 00:45:20 user nova-compute[74850]:   <os>
Nov 14 00:45:20 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:45:20 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 00:45:20 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:45:20 user nova-compute[74850]:   </os>
Nov 14 00:45:20 user nova-compute[74850]:   <features>
Nov 14 00:45:20 user nova-compute[74850]:     <acpi/>
Nov 14 00:45:20 user nova-compute[74850]:     <apic/>
Nov 14 00:45:20 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:45:20 user nova-compute[74850]:   </features>
Nov 14 00:45:20 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:45:20 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:45:20 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:45:20 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:45:20 user nova-compute[74850]:   </clock>
Nov 14 00:45:20 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:45:20 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:45:20 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:45:20 user nova-compute[74850]:   </cpu>
Nov 14 00:45:20 user nova-compute[74850]:   <devices>
Nov 14 00:45:20 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 00:45:20 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:45:20 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/937d7470-ec86-4972-b975-257d626329dd/disk"/>
Nov 14 00:45:20 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:45:20 user nova-compute[74850]:     </disk>
Nov 14 00:45:20 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:45:20 user nova-compute[74850]:       <mac address="fa:16:3e:4b:c7:91"/>
Nov 14 00:45:20 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:45:20 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:45:20 user nova-compute[74850]:       <target dev="tap2df12354-6d"/>
Nov 14 00:45:20 user nova-compute[74850]:     </interface>
Nov 14 00:45:20 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:45:20 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/937d7470-ec86-4972-b975-257d626329dd/console.log" append="off"/>
Nov 14 00:45:20 user nova-compute[74850]:     </serial>
Nov 14 00:45:20 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:45:20 user nova-compute[74850]:     <video>
Nov 14 00:45:20 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:45:20 user nova-compute[74850]:     </video>
Nov 14 00:45:20 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:45:20 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:45:20 user nova-compute[74850]:     </rng>
Nov 14 00:45:20 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:45:20 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:45:20 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:45:20 user nova-compute[74850]:     </memballoon>
Nov 14 00:45:20 user nova-compute[74850]:   </devices>
Nov 14 00:45:20 user nova-compute[74850]: </domain>
Nov 14 00:45:20 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:45:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-752047898',display_name='tempest-TestVolumeSwap-server-752047898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-752047898',id=7,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOoVNvkutJjwmkF9XeKrykcSE5UbP6yiCQ+agx7TDKNjdR1haAqEF0ZS1csyFhoXXvvItY/3Pp3GZEdxrmUjvmyQS9xL6wDMxPNdNfbQ9oXKzoDgh9fMXaR5qjh+qzJqQ==',key_name='tempest-keypair-635174324',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7ee2171e47543fa818dc601abc63ea0',ramdisk_id='',reservation_id='r-05xdstn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1639962610',owner_user_name='tempest-TestVolumeSwap-1639962610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd597d37ed9b48a1bfaa3da62b286ca7',uuid=937d7470-ec86-4972-b975-257d626329dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2df12354-6de2-49fd-812e-1354c7c87039", "address": "fa:16:3e:4b:c7:91", "network": {"id": "dbe8caa9-0185-44cf-b45e-f5f0c0f3f81c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-413724990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ee2171e47543fa818dc601abc63ea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df12354-6d", "ovs_interfaceid": "2df12354-6de2-49fd-812e-1354c7c87039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Converting VIF {"id": "2df12354-6de2-49fd-812e-1354c7c87039", "address": "fa:16:3e:4b:c7:91", "network": {"id": "dbe8caa9-0185-44cf-b45e-f5f0c0f3f81c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-413724990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ee2171e47543fa818dc601abc63ea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df12354-6d", "ovs_interfaceid": "2df12354-6de2-49fd-812e-1354c7c87039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:c7:91,bridge_name='br-int',has_traffic_filtering=True,id=2df12354-6de2-49fd-812e-1354c7c87039,network=Network(dbe8caa9-0185-44cf-b45e-f5f0c0f3f81c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df12354-6d') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG os_vif [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:c7:91,bridge_name='br-int',has_traffic_filtering=True,id=2df12354-6de2-49fd-812e-1354c7c87039,network=Network(dbe8caa9-0185-44cf-b45e-f5f0c0f3f81c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df12354-6d') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-838a2cbb-6319-4814-b6b5-c9d2032a2b29 req-af81678f-b2d6-4412-8e0f-172e6f7d426d service nova] Releasing lock "refresh_cache-28212eec-99be-4171-97ed-7748bbb75c88" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '286b597f-9654-5e41-a486-c2aa6116dbd4', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2df12354-6d, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2df12354-6d, col_values=(('qos', UUID('a8c71ad8-b6a2-491e-9fe1-47383cc81b1a')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2df12354-6d, col_values=(('external_ids', {'iface-id': '2df12354-6de2-49fd-812e-1354c7c87039', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:c7:91', 'vm-uuid': '937d7470-ec86-4972-b975-257d626329dd'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:20 user nova-compute[74850]: INFO os_vif [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:c7:91,bridge_name='br-int',has_traffic_filtering=True,id=2df12354-6de2-49fd-812e-1354c7c87039,network=Network(dbe8caa9-0185-44cf-b45e-f5f0c0f3f81c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df12354-6d')
Nov 14 00:45:20 user nova-compute[74850]: DEBUG nova.network.neutron [req-66ff8e41-e5eb-45da-bb27-2a03a1421b04 req-25b7ffe9-ca70-4dc2-917f-acb4839ed606 service nova] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Updated VIF entry in instance network info cache for port f8d36bc2-b85b-4eaf-8c22-e58c9dae360d. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG nova.network.neutron [req-66ff8e41-e5eb-45da-bb27-2a03a1421b04 req-25b7ffe9-ca70-4dc2-917f-acb4839ed606 service nova] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Updating instance_info_cache with network_info: [{"id": "f8d36bc2-b85b-4eaf-8c22-e58c9dae360d", "address": "fa:16:3e:65:0b:b4", "network": {"id": "db670808-a8f8-441f-aa30-b55187e39c46", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-972081880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dd0e10c315346cabe45d8cb1596b3dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d36bc2-b8", "ovs_interfaceid": "f8d36bc2-b85b-4eaf-8c22-e58c9dae360d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-66ff8e41-e5eb-45da-bb27-2a03a1421b04 req-25b7ffe9-ca70-4dc2-917f-acb4839ed606 service nova] Releasing lock "refresh_cache-4a2881e6-ee6e-4165-a6d9-35fda79c142d" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:45:20 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] No VIF found with MAC fa:16:3e:4b:c7:91, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:45:21 user nova-compute[74850]: DEBUG nova.compute.manager [req-3b67fea9-eddd-49ad-a621-98e573026001 req-752b2e2a-cefa-41d1-9bef-21969d56e03f service nova] [instance: 937d7470-ec86-4972-b975-257d626329dd] Received event network-changed-2df12354-6de2-49fd-812e-1354c7c87039 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:21 user nova-compute[74850]: DEBUG nova.compute.manager [req-3b67fea9-eddd-49ad-a621-98e573026001 req-752b2e2a-cefa-41d1-9bef-21969d56e03f service nova] [instance: 937d7470-ec86-4972-b975-257d626329dd] Refreshing instance network info cache due to event network-changed-2df12354-6de2-49fd-812e-1354c7c87039. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:45:21 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3b67fea9-eddd-49ad-a621-98e573026001 req-752b2e2a-cefa-41d1-9bef-21969d56e03f service nova] Acquiring lock "refresh_cache-937d7470-ec86-4972-b975-257d626329dd" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:45:21 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3b67fea9-eddd-49ad-a621-98e573026001 req-752b2e2a-cefa-41d1-9bef-21969d56e03f service nova] Acquired lock "refresh_cache-937d7470-ec86-4972-b975-257d626329dd" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:45:21 user nova-compute[74850]: DEBUG nova.network.neutron [req-3b67fea9-eddd-49ad-a621-98e573026001 req-752b2e2a-cefa-41d1-9bef-21969d56e03f service nova] [instance: 937d7470-ec86-4972-b975-257d626329dd] Refreshing network info cache for port 2df12354-6de2-49fd-812e-1354c7c87039 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:45:21 user nova-compute[74850]: DEBUG nova.compute.manager [req-5607f46f-e8c3-44b4-9fe8-1f0dd0b05821 req-fbd75bb3-d5a4-48b9-809a-fcf433ebbe75 service nova] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Received event network-vif-plugged-4a56ca60-9419-4150-8a41-81d8709e001c {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:21 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5607f46f-e8c3-44b4-9fe8-1f0dd0b05821 req-fbd75bb3-d5a4-48b9-809a-fcf433ebbe75 service nova] Acquiring lock "7f1a88ea-83a3-447b-a83d-40b2c1c908f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:21 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5607f46f-e8c3-44b4-9fe8-1f0dd0b05821 req-fbd75bb3-d5a4-48b9-809a-fcf433ebbe75 service nova] Lock "7f1a88ea-83a3-447b-a83d-40b2c1c908f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:21 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5607f46f-e8c3-44b4-9fe8-1f0dd0b05821 req-fbd75bb3-d5a4-48b9-809a-fcf433ebbe75 service nova] Lock "7f1a88ea-83a3-447b-a83d-40b2c1c908f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:21 user nova-compute[74850]: DEBUG nova.compute.manager [req-5607f46f-e8c3-44b4-9fe8-1f0dd0b05821 req-fbd75bb3-d5a4-48b9-809a-fcf433ebbe75 service nova] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] No waiting events found dispatching network-vif-plugged-4a56ca60-9419-4150-8a41-81d8709e001c {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:45:21 user nova-compute[74850]: WARNING nova.compute.manager [req-5607f46f-e8c3-44b4-9fe8-1f0dd0b05821 req-fbd75bb3-d5a4-48b9-809a-fcf433ebbe75 service nova] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Received unexpected event network-vif-plugged-4a56ca60-9419-4150-8a41-81d8709e001c for instance with vm_state building and task_state spawning.
Nov 14 00:45:21 user nova-compute[74850]: DEBUG nova.compute.manager [req-5607f46f-e8c3-44b4-9fe8-1f0dd0b05821 req-fbd75bb3-d5a4-48b9-809a-fcf433ebbe75 service nova] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Received event network-vif-plugged-4a56ca60-9419-4150-8a41-81d8709e001c {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:21 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5607f46f-e8c3-44b4-9fe8-1f0dd0b05821 req-fbd75bb3-d5a4-48b9-809a-fcf433ebbe75 service nova] Acquiring lock "7f1a88ea-83a3-447b-a83d-40b2c1c908f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:21 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5607f46f-e8c3-44b4-9fe8-1f0dd0b05821 req-fbd75bb3-d5a4-48b9-809a-fcf433ebbe75 service nova] Lock "7f1a88ea-83a3-447b-a83d-40b2c1c908f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:21 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5607f46f-e8c3-44b4-9fe8-1f0dd0b05821 req-fbd75bb3-d5a4-48b9-809a-fcf433ebbe75 service nova] Lock "7f1a88ea-83a3-447b-a83d-40b2c1c908f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:21 user nova-compute[74850]: DEBUG nova.compute.manager [req-5607f46f-e8c3-44b4-9fe8-1f0dd0b05821 req-fbd75bb3-d5a4-48b9-809a-fcf433ebbe75 service nova] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] No waiting events found dispatching network-vif-plugged-4a56ca60-9419-4150-8a41-81d8709e001c {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:45:21 user nova-compute[74850]: WARNING nova.compute.manager [req-5607f46f-e8c3-44b4-9fe8-1f0dd0b05821 req-fbd75bb3-d5a4-48b9-809a-fcf433ebbe75 service nova] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Received unexpected event network-vif-plugged-4a56ca60-9419-4150-8a41-81d8709e001c for instance with vm_state building and task_state spawning.
Nov 14 00:45:22 user nova-compute[74850]: DEBUG nova.network.neutron [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Successfully updated port: 5db497e0-e507-4a13-b0ff-fb4f7608f94d {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:45:22 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Acquiring lock "refresh_cache-b54b37bc-8c90-4c48-a943-e489e830b93b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:45:22 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Acquired lock "refresh_cache-b54b37bc-8c90-4c48-a943-e489e830b93b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:45:22 user nova-compute[74850]: DEBUG nova.network.neutron [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:45:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:22 user nova-compute[74850]: DEBUG nova.network.neutron [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:45:22 user nova-compute[74850]: DEBUG nova.network.neutron [req-3b67fea9-eddd-49ad-a621-98e573026001 req-752b2e2a-cefa-41d1-9bef-21969d56e03f service nova] [instance: 937d7470-ec86-4972-b975-257d626329dd] Updated VIF entry in instance network info cache for port 2df12354-6de2-49fd-812e-1354c7c87039. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:45:22 user nova-compute[74850]: DEBUG nova.network.neutron [req-3b67fea9-eddd-49ad-a621-98e573026001 req-752b2e2a-cefa-41d1-9bef-21969d56e03f service nova] [instance: 937d7470-ec86-4972-b975-257d626329dd] Updating instance_info_cache with network_info: [{"id": "2df12354-6de2-49fd-812e-1354c7c87039", "address": "fa:16:3e:4b:c7:91", "network": {"id": "dbe8caa9-0185-44cf-b45e-f5f0c0f3f81c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-413724990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ee2171e47543fa818dc601abc63ea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df12354-6d", "ovs_interfaceid": "2df12354-6de2-49fd-812e-1354c7c87039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:45:22 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3b67fea9-eddd-49ad-a621-98e573026001 req-752b2e2a-cefa-41d1-9bef-21969d56e03f service nova] Releasing lock "refresh_cache-937d7470-ec86-4972-b975-257d626329dd" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:45:22 user nova-compute[74850]: DEBUG nova.compute.manager [req-3b67fea9-eddd-49ad-a621-98e573026001 req-752b2e2a-cefa-41d1-9bef-21969d56e03f service nova] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Received event network-vif-plugged-792bf62b-99b4-4d65-a55b-4e97c64eb1c5 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:22 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3b67fea9-eddd-49ad-a621-98e573026001 req-752b2e2a-cefa-41d1-9bef-21969d56e03f service nova] Acquiring lock "1282f7f3-c81e-4a6e-bd86-42459f49674f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:22 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3b67fea9-eddd-49ad-a621-98e573026001 req-752b2e2a-cefa-41d1-9bef-21969d56e03f service nova] Lock "1282f7f3-c81e-4a6e-bd86-42459f49674f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:22 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3b67fea9-eddd-49ad-a621-98e573026001 req-752b2e2a-cefa-41d1-9bef-21969d56e03f service nova] Lock "1282f7f3-c81e-4a6e-bd86-42459f49674f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:22 user nova-compute[74850]: DEBUG nova.compute.manager [req-3b67fea9-eddd-49ad-a621-98e573026001 req-752b2e2a-cefa-41d1-9bef-21969d56e03f service nova] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] No waiting events found dispatching network-vif-plugged-792bf62b-99b4-4d65-a55b-4e97c64eb1c5 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:45:22 user nova-compute[74850]: WARNING nova.compute.manager [req-3b67fea9-eddd-49ad-a621-98e573026001 req-752b2e2a-cefa-41d1-9bef-21969d56e03f service nova] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Received unexpected event network-vif-plugged-792bf62b-99b4-4d65-a55b-4e97c64eb1c5 for instance with vm_state active and task_state None.
Nov 14 00:45:22 user nova-compute[74850]: DEBUG nova.network.neutron [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Updating instance_info_cache with network_info: [{"id": "5db497e0-e507-4a13-b0ff-fb4f7608f94d", "address": "fa:16:3e:75:22:ea", "network": {"id": "35cab925-9113-4bab-8203-a81035513ed6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036882895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c05ffa95fcf49d6a87d6dad2b3f0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db497e0-e5", "ovs_interfaceid": "5db497e0-e507-4a13-b0ff-fb4f7608f94d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:45:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Releasing lock "refresh_cache-b54b37bc-8c90-4c48-a943-e489e830b93b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:45:23 user nova-compute[74850]: DEBUG nova.compute.manager [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Instance network_info: |[{"id": "5db497e0-e507-4a13-b0ff-fb4f7608f94d", "address": "fa:16:3e:75:22:ea", "network": {"id": "35cab925-9113-4bab-8203-a81035513ed6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036882895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c05ffa95fcf49d6a87d6dad2b3f0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db497e0-e5", "ovs_interfaceid": "5db497e0-e507-4a13-b0ff-fb4f7608f94d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 00:45:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Acquiring lock "faeb3377-d199-472b-9ee2-f504d5ac9ac4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Lock "faeb3377-d199-472b-9ee2-f504d5ac9ac4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:23 user nova-compute[74850]: DEBUG nova.compute.manager [req-816b0c0e-5961-4f6b-b3ee-6cdcc0bb0bd1 req-42609e2d-025f-471b-8e35-ff15e3326441 service nova] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Received event network-changed-5db497e0-e507-4a13-b0ff-fb4f7608f94d {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:23 user nova-compute[74850]: DEBUG nova.compute.manager [req-816b0c0e-5961-4f6b-b3ee-6cdcc0bb0bd1 req-42609e2d-025f-471b-8e35-ff15e3326441 service nova] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Refreshing instance network info cache due to event network-changed-5db497e0-e507-4a13-b0ff-fb4f7608f94d. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:45:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-816b0c0e-5961-4f6b-b3ee-6cdcc0bb0bd1 req-42609e2d-025f-471b-8e35-ff15e3326441 service nova] Acquiring lock "refresh_cache-b54b37bc-8c90-4c48-a943-e489e830b93b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:45:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-816b0c0e-5961-4f6b-b3ee-6cdcc0bb0bd1 req-42609e2d-025f-471b-8e35-ff15e3326441 service nova] Acquired lock "refresh_cache-b54b37bc-8c90-4c48-a943-e489e830b93b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:45:23 user nova-compute[74850]: DEBUG nova.network.neutron [req-816b0c0e-5961-4f6b-b3ee-6cdcc0bb0bd1 req-42609e2d-025f-471b-8e35-ff15e3326441 service nova] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Refreshing network info cache for port 5db497e0-e507-4a13-b0ff-fb4f7608f94d {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:45:23 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 00:45:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:23 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 00:45:23 user nova-compute[74850]: INFO nova.compute.claims [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Claim successful on node user
Nov 14 00:45:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:24 user nova-compute[74850]: DEBUG nova.compute.manager [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:45:24 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 00:45:24 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Instance spawned successfully.
Nov 14 00:45:24 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 00:45:24 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:24 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:24 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:24 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:24 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:24 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:24 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:45:24 user nova-compute[74850]: INFO nova.compute.manager [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Took 14.73 seconds to spawn the instance on the hypervisor.
Nov 14 00:45:24 user nova-compute[74850]: DEBUG nova.compute.manager [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:45:24 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:45:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.908s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:24 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 00:45:24 user nova-compute[74850]: DEBUG nova.network.neutron [req-816b0c0e-5961-4f6b-b3ee-6cdcc0bb0bd1 req-42609e2d-025f-471b-8e35-ff15e3326441 service nova] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Updated VIF entry in instance network info cache for port 5db497e0-e507-4a13-b0ff-fb4f7608f94d. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:45:24 user nova-compute[74850]: DEBUG nova.network.neutron [req-816b0c0e-5961-4f6b-b3ee-6cdcc0bb0bd1 req-42609e2d-025f-471b-8e35-ff15e3326441 service nova] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Updating instance_info_cache with network_info: [{"id": "5db497e0-e507-4a13-b0ff-fb4f7608f94d", "address": "fa:16:3e:75:22:ea", "network": {"id": "35cab925-9113-4bab-8203-a81035513ed6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036882895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c05ffa95fcf49d6a87d6dad2b3f0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db497e0-e5", "ovs_interfaceid": "5db497e0-e507-4a13-b0ff-fb4f7608f94d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:45:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-816b0c0e-5961-4f6b-b3ee-6cdcc0bb0bd1 req-42609e2d-025f-471b-8e35-ff15e3326441 service nova] Releasing lock "refresh_cache-b54b37bc-8c90-4c48-a943-e489e830b93b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:45:24 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 00:45:24 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 00:45:25 user nova-compute[74850]: INFO nova.compute.manager [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Took 16.05 seconds to build instance.
Nov 14 00:45:25 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 00:45:25 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-372ea332-100c-4138-a87e-bd29eddf3213 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Lock "7f1a88ea-83a3-447b-a83d-40b2c1c908f5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.363s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG nova.policy [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2cd9f911e27e4ad398043e232d750aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa47b07cec543abbcfe0c27cb06e591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 00:45:25 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Creating image(s)
Nov 14 00:45:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Acquiring lock "/opt/stack/data/nova/instances/faeb3377-d199-472b-9ee2-f504d5ac9ac4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Lock "/opt/stack/data/nova/instances/faeb3377-d199-472b-9ee2-f504d5ac9ac4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Lock "/opt/stack/data/nova/instances/faeb3377-d199-472b-9ee2-f504d5ac9ac4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.236s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG nova.compute.manager [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 00:45:25 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Creating image(s)
Nov 14 00:45:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Did not create local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Ensure instance console log exists: /opt/stack/data/nova/instances/b54b37bc-8c90-4c48-a943-e489e830b93b/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Start _get_guest_xml network_info=[{"id": "5db497e0-e507-4a13-b0ff-fb4f7608f94d", "address": "fa:16:3e:75:22:ea", "network": {"id": "35cab925-9113-4bab-8203-a81035513ed6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036882895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c05ffa95fcf49d6a87d6dad2b3f0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db497e0-e5", "ovs_interfaceid": "5db497e0-e507-4a13-b0ff-fb4f7608f94d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '05554ddb-ad19-4174-9567-133b15700abc', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lwKDFPxQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b54b37bc-8c90-4c48-a943-e489e830b93b', 'attached_at': '', 'detached_at': '', 'volume_id': 'ef003978-0c16-4a36-b762-c86ac032e85a', 'serial': 'ef003978-0c16-4a36-b762-c86ac032e85a'}, 'volume_type': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:45:25 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:45:25 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:45:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG os_brick.initiator.connector [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Factory for ISCSI on None {{(pid=74850) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.013s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lwKDFPxQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:45:25 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:45:25 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.007s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:45:25 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:45:25 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:45:25 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 00:45:25 user nova-compute[74850]: DEBUG nova.compute.manager [req-66727c73-fc5e-4e37-a382-c839fbb72305 req-b68bf340-7e42-4a54-98ef-66a30030fdef service nova] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Received event network-vif-plugged-f8d36bc2-b85b-4eaf-8c22-e58c9dae360d {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-66727c73-fc5e-4e37-a382-c839fbb72305 req-b68bf340-7e42-4a54-98ef-66a30030fdef service nova] Acquiring lock "4a2881e6-ee6e-4165-a6d9-35fda79c142d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-66727c73-fc5e-4e37-a382-c839fbb72305 req-b68bf340-7e42-4a54-98ef-66a30030fdef service nova] Lock "4a2881e6-ee6e-4165-a6d9-35fda79c142d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-66727c73-fc5e-4e37-a382-c839fbb72305 req-b68bf340-7e42-4a54-98ef-66a30030fdef service nova] Lock "4a2881e6-ee6e-4165-a6d9-35fda79c142d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG nova.compute.manager [req-66727c73-fc5e-4e37-a382-c839fbb72305 req-b68bf340-7e42-4a54-98ef-66a30030fdef service nova] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] No waiting events found dispatching network-vif-plugged-f8d36bc2-b85b-4eaf-8c22-e58c9dae360d {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:45:25 user nova-compute[74850]: WARNING nova.compute.manager [req-66727c73-fc5e-4e37-a382-c839fbb72305 req-b68bf340-7e42-4a54-98ef-66a30030fdef service nova] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Received unexpected event network-vif-plugged-f8d36bc2-b85b-4eaf-8c22-e58c9dae360d for instance with vm_state building and task_state spawning.
Nov 14 00:45:25 user nova-compute[74850]: DEBUG nova.compute.manager [req-66727c73-fc5e-4e37-a382-c839fbb72305 req-b68bf340-7e42-4a54-98ef-66a30030fdef service nova] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Received event network-vif-plugged-f8d36bc2-b85b-4eaf-8c22-e58c9dae360d {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-66727c73-fc5e-4e37-a382-c839fbb72305 req-b68bf340-7e42-4a54-98ef-66a30030fdef service nova] Acquiring lock "4a2881e6-ee6e-4165-a6d9-35fda79c142d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-66727c73-fc5e-4e37-a382-c839fbb72305 req-b68bf340-7e42-4a54-98ef-66a30030fdef service nova] Lock "4a2881e6-ee6e-4165-a6d9-35fda79c142d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-66727c73-fc5e-4e37-a382-c839fbb72305 req-b68bf340-7e42-4a54-98ef-66a30030fdef service nova] Lock "4a2881e6-ee6e-4165-a6d9-35fda79c142d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG nova.compute.manager [req-66727c73-fc5e-4e37-a382-c839fbb72305 req-b68bf340-7e42-4a54-98ef-66a30030fdef service nova] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] No waiting events found dispatching network-vif-plugged-f8d36bc2-b85b-4eaf-8c22-e58c9dae360d {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:45:25 user nova-compute[74850]: WARNING nova.compute.manager [req-66727c73-fc5e-4e37-a382-c839fbb72305 req-b68bf340-7e42-4a54-98ef-66a30030fdef service nova] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Received unexpected event network-vif-plugged-f8d36bc2-b85b-4eaf-8c22-e58c9dae360d for instance with vm_state building and task_state spawning.
Nov 14 00:45:25 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.352s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[56152b4d-f3a3-4131-a270-a68990537f01]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:25 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/faeb3377-d199-472b-9ee2-f504d5ac9ac4/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 00:45:26 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/faeb3377-d199-472b-9ee2-f504d5ac9ac4/disk 1073741824" returned: 0 in 0.054s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.414s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d3ded5-3797-4aae-ac5f-79581fab6d50]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a] added
Nov 14 00:45:26 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[38867893-94c4-4c81-82fa-b1c2e2d19829]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.048s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e045e88f-a614-476e-a7d7-568448778db9]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lwKDFPxQ {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lwKDFPxQ" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[76069e06-6854-4261-b76a-3a5d75b8d872]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lwKDFPxQ'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[545472d6-8da2-4696-9979-d50ea4deea16]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.026s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe64c68-657e-4c78-b1ab-1dd03451e22e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Successfully created port: e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 00:45:26 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 00:45:26 user nova-compute[74850]:  {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:45:26 user nova-compute[74850]: WARNING os_brick.initiator.connectors.iscsi [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 00:45:26 user nova-compute[74850]: 
Nov 14 00:45:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.333s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Checking if we can resize image /opt/stack/data/nova/instances/faeb3377-d199-472b-9ee2-f504d5ac9ac4/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faeb3377-d199-472b-9ee2-f504d5ac9ac4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29a725d-dacb-46c0-8e73-4d3a7434fa66]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a, portal: 172.16.0.220,3260]
Nov 14 00:45:26 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a, portal: 172.16.0.220,3260] successful.
Nov 14 00:45:26 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[62402c90-311e-4a88-822c-d7f6230a7fc0]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7b13eb-71b5-42ee-8aaf-66d2e170b45c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:45:26 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:45:26 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.559s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[45dbf5b6-649a-46dd-aa1c-a5fa552928bd]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lwKDFPxQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faeb3377-d199-472b-9ee2-f504d5ac9ac4/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Cannot resize image /opt/stack/data/nova/instances/faeb3377-d199-472b-9ee2-f504d5ac9ac4/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Ensure instance console log exists: /opt/stack/data/nova/instances/faeb3377-d199-472b-9ee2-f504d5ac9ac4/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.compute.manager [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 00:45:27 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 937d7470-ec86-4972-b975-257d626329dd] Instance spawned successfully.
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.compute.manager [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 00:45:27 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Instance spawned successfully.
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.compute.manager [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 00:45:27 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Instance spawned successfully.
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 00:45:27 user nova-compute[74850]: INFO nova.compute.manager [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Took 10.99 seconds to spawn the instance on the hypervisor.
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.compute.manager [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:27 user nova-compute[74850]: INFO nova.compute.manager [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Took 12.75 seconds to spawn the instance on the hypervisor.
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.compute.manager [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.606s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] <== connect_volume: return (1615ms) {'type': 'block', 'scsi_wwn': '23835333832383165', 'path': '/dev/sdb'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835333832383165', 'path': '/dev/sdb'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 00:45:27 user nova-compute[74850]: INFO nova.compute.manager [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Took 16.03 seconds to spawn the instance on the hypervisor.
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.compute.manager [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:45:27 user nova-compute[74850]: INFO nova.compute.manager [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Took 13.92 seconds to build instance.
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:45:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1407646081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1407646081',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6k6B6AwbocNisCO4Eq2JgavF/MwPMPgsSfJ4CZC+5MU8+G1Higk1jdnJvqwYlgQxsBYLb1AOlev2ixcNIA7eSaJMrT6i+cl48pJKEqDssTEhOLedhY/A00Q2wZRBoCKw==',key_name='tempest-keypair-1347631522',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c05ffa95fcf49d6a87d6dad2b3f0983',ramdisk_id='',reservation_id='r-3ge02sav',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-676489401',owner_user_name='tempest-ServerActionsV293TestJSON-676489401-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a609a827db1a4e2ca232e7bc8880ed0b',uuid=b54b37bc-8c90-4c48-a943-e489e830b93b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5db497e0-e507-4a13-b0ff-fb4f7608f94d", "address": "fa:16:3e:75:22:ea", "network": {"id": "35cab925-9113-4bab-8203-a81035513ed6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036882895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c05ffa95fcf49d6a87d6dad2b3f0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db497e0-e5", "ovs_interfaceid": "5db497e0-e507-4a13-b0ff-fb4f7608f94d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Converting VIF {"id": "5db497e0-e507-4a13-b0ff-fb4f7608f94d", "address": "fa:16:3e:75:22:ea", "network": {"id": "35cab925-9113-4bab-8203-a81035513ed6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036882895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c05ffa95fcf49d6a87d6dad2b3f0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db497e0-e5", "ovs_interfaceid": "5db497e0-e507-4a13-b0ff-fb4f7608f94d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:22:ea,bridge_name='br-int',has_traffic_filtering=True,id=5db497e0-e507-4a13-b0ff-fb4f7608f94d,network=Network(35cab925-9113-4bab-8203-a81035513ed6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db497e0-e5') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.objects.instance [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Lazy-loading 'pci_devices' on Instance uuid b54b37bc-8c90-4c48-a943-e489e830b93b {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:45:27 user nova-compute[74850]:   <uuid>b54b37bc-8c90-4c48-a943-e489e830b93b</uuid>
Nov 14 00:45:27 user nova-compute[74850]:   <name>instance-00000008</name>
Nov 14 00:45:27 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:45:27 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:45:27 user nova-compute[74850]:   <metadata>
Nov 14 00:45:27 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:45:27 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:45:27 user nova-compute[74850]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1407646081</nova:name>
Nov 14 00:45:27 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:45:25</nova:creationTime>
Nov 14 00:45:27 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:45:27 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:45:27 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:45:27 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:45:27 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:45:27 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:45:27 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:45:27 user nova-compute[74850]:       <nova:owner>
Nov 14 00:45:27 user nova-compute[74850]:         <nova:user uuid="a609a827db1a4e2ca232e7bc8880ed0b">tempest-ServerActionsV293TestJSON-676489401-project-member</nova:user>
Nov 14 00:45:27 user nova-compute[74850]:         <nova:project uuid="9c05ffa95fcf49d6a87d6dad2b3f0983">tempest-ServerActionsV293TestJSON-676489401</nova:project>
Nov 14 00:45:27 user nova-compute[74850]:       </nova:owner>
Nov 14 00:45:27 user nova-compute[74850]:       <nova:ports>
Nov 14 00:45:27 user nova-compute[74850]:         <nova:port uuid="5db497e0-e507-4a13-b0ff-fb4f7608f94d">
Nov 14 00:45:27 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 00:45:27 user nova-compute[74850]:         </nova:port>
Nov 14 00:45:27 user nova-compute[74850]:       </nova:ports>
Nov 14 00:45:27 user nova-compute[74850]:     </nova:instance>
Nov 14 00:45:27 user nova-compute[74850]:   </metadata>
Nov 14 00:45:27 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:45:27 user nova-compute[74850]:     <system>
Nov 14 00:45:27 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:45:27 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:45:27 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:45:27 user nova-compute[74850]:       <entry name="serial">b54b37bc-8c90-4c48-a943-e489e830b93b</entry>
Nov 14 00:45:27 user nova-compute[74850]:       <entry name="uuid">b54b37bc-8c90-4c48-a943-e489e830b93b</entry>
Nov 14 00:45:27 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:45:27 user nova-compute[74850]:     </system>
Nov 14 00:45:27 user nova-compute[74850]:   </sysinfo>
Nov 14 00:45:27 user nova-compute[74850]:   <os>
Nov 14 00:45:27 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:45:27 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 00:45:27 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:45:27 user nova-compute[74850]:   </os>
Nov 14 00:45:27 user nova-compute[74850]:   <features>
Nov 14 00:45:27 user nova-compute[74850]:     <acpi/>
Nov 14 00:45:27 user nova-compute[74850]:     <apic/>
Nov 14 00:45:27 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:45:27 user nova-compute[74850]:   </features>
Nov 14 00:45:27 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:45:27 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:45:27 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:45:27 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:45:27 user nova-compute[74850]:   </clock>
Nov 14 00:45:27 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:45:27 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:45:27 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:45:27 user nova-compute[74850]:   </cpu>
Nov 14 00:45:27 user nova-compute[74850]:   <devices>
Nov 14 00:45:27 user nova-compute[74850]:     <disk type="block" device="disk">
Nov 14 00:45:27 user nova-compute[74850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:45:27 user nova-compute[74850]:       <source dev="/dev/sdb"/>
Nov 14 00:45:27 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:45:27 user nova-compute[74850]:       <serial>ef003978-0c16-4a36-b762-c86ac032e85a</serial>
Nov 14 00:45:27 user nova-compute[74850]:     </disk>
Nov 14 00:45:27 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:45:27 user nova-compute[74850]:       <mac address="fa:16:3e:75:22:ea"/>
Nov 14 00:45:27 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:45:27 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:45:27 user nova-compute[74850]:       <target dev="tap5db497e0-e5"/>
Nov 14 00:45:27 user nova-compute[74850]:     </interface>
Nov 14 00:45:27 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:45:27 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/b54b37bc-8c90-4c48-a943-e489e830b93b/console.log" append="off"/>
Nov 14 00:45:27 user nova-compute[74850]:     </serial>
Nov 14 00:45:27 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:45:27 user nova-compute[74850]:     <video>
Nov 14 00:45:27 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:45:27 user nova-compute[74850]:     </video>
Nov 14 00:45:27 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:45:27 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:45:27 user nova-compute[74850]:     </rng>
Nov 14 00:45:27 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:45:27 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:45:27 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:45:27 user nova-compute[74850]:     </memballoon>
Nov 14 00:45:27 user nova-compute[74850]:   </devices>
Nov 14 00:45:27 user nova-compute[74850]: </domain>
Nov 14 00:45:27 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:45:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1407646081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1407646081',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6k6B6AwbocNisCO4Eq2JgavF/MwPMPgsSfJ4CZC+5MU8+G1Higk1jdnJvqwYlgQxsBYLb1AOlev2ixcNIA7eSaJMrT6i+cl48pJKEqDssTEhOLedhY/A00Q2wZRBoCKw==',key_name='tempest-keypair-1347631522',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c05ffa95fcf49d6a87d6dad2b3f0983',ramdisk_id='',reservation_id='r-3ge02sav',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-676489401',owner_user_name='tempest-ServerActionsV293TestJSON-676489401-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a609a827db1a4e2ca232e7bc8880ed0b',uuid=b54b37bc-8c90-4c48-a943-e489e830b93b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5db497e0-e507-4a13-b0ff-fb4f7608f94d", "address": "fa:16:3e:75:22:ea", "network": {"id": "35cab925-9113-4bab-8203-a81035513ed6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036882895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c05ffa95fcf49d6a87d6dad2b3f0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db497e0-e5", "ovs_interfaceid": "5db497e0-e507-4a13-b0ff-fb4f7608f94d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Converting VIF {"id": "5db497e0-e507-4a13-b0ff-fb4f7608f94d", "address": "fa:16:3e:75:22:ea", "network": {"id": "35cab925-9113-4bab-8203-a81035513ed6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036882895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c05ffa95fcf49d6a87d6dad2b3f0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db497e0-e5", "ovs_interfaceid": "5db497e0-e507-4a13-b0ff-fb4f7608f94d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:22:ea,bridge_name='br-int',has_traffic_filtering=True,id=5db497e0-e507-4a13-b0ff-fb4f7608f94d,network=Network(35cab925-9113-4bab-8203-a81035513ed6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db497e0-e5') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG os_vif [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:22:ea,bridge_name='br-int',has_traffic_filtering=True,id=5db497e0-e507-4a13-b0ff-fb4f7608f94d,network=Network(35cab925-9113-4bab-8203-a81035513ed6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db497e0-e5') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:45:27 user nova-compute[74850]: INFO nova.compute.manager [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Took 12.70 seconds to build instance.
Nov 14 00:45:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0a2bfc15-156d-5da6-b83a-c3ac64097f02', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-91b89f29-7388-42ed-a168-b22da48bf5c6 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "28212eec-99be-4171-97ed-7748bbb75c88" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.117s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5db497e0-e5, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5db497e0-e5, col_values=(('qos', UUID('611b58ea-9dd8-419e-99ea-c3fc7da5bee6')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5db497e0-e5, col_values=(('external_ids', {'iface-id': '5db497e0-e507-4a13-b0ff-fb4f7608f94d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:22:ea', 'vm-uuid': 'b54b37bc-8c90-4c48-a943-e489e830b93b'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-d2042b56-063d-4431-a553-a79240d02cd3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Lock "937d7470-ec86-4972-b975-257d626329dd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.013s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:27 user nova-compute[74850]: INFO nova.compute.manager [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Took 17.14 seconds to build instance.
Nov 14 00:45:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:27 user nova-compute[74850]: INFO os_vif [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:22:ea,bridge_name='br-int',has_traffic_filtering=True,id=5db497e0-e507-4a13-b0ff-fb4f7608f94d,network=Network(35cab925-9113-4bab-8203-a81035513ed6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db497e0-e5')
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Successfully updated port: e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f6e3da87-89a0-453d-8936-09e80879f38d tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Lock "4a2881e6-ee6e-4165-a6d9-35fda79c142d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.259s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Acquiring lock "refresh_cache-faeb3377-d199-472b-9ee2-f504d5ac9ac4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Acquired lock "refresh_cache-faeb3377-d199-472b-9ee2-f504d5ac9ac4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] No VIF found with MAC fa:16:3e:75:22:ea, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.compute.manager [req-5bbdfde5-c571-4be7-9a9f-5e5a9c6c3b81 req-f8494709-d9a9-4081-94c4-79399e6f2914 service nova] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Received event network-changed-e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG nova.compute.manager [req-5bbdfde5-c571-4be7-9a9f-5e5a9c6c3b81 req-f8494709-d9a9-4081-94c4-79399e6f2914 service nova] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Refreshing instance network info cache due to event network-changed-e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:45:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5bbdfde5-c571-4be7-9a9f-5e5a9c6c3b81 req-f8494709-d9a9-4081-94c4-79399e6f2914 service nova] Acquiring lock "refresh_cache-faeb3377-d199-472b-9ee2-f504d5ac9ac4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Updating instance_info_cache with network_info: [{"id": "e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa", "address": "fa:16:3e:f4:17:52", "network": {"id": "1e997e66-8753-4b3a-a6c9-26ba2a6152fa", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1625339302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa47b07cec543abbcfe0c27cb06e591", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5356eac-6f", "ovs_interfaceid": "e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Releasing lock "refresh_cache-faeb3377-d199-472b-9ee2-f504d5ac9ac4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Instance network_info: |[{"id": "e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa", "address": "fa:16:3e:f4:17:52", "network": {"id": "1e997e66-8753-4b3a-a6c9-26ba2a6152fa", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1625339302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa47b07cec543abbcfe0c27cb06e591", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5356eac-6f", "ovs_interfaceid": "e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5bbdfde5-c571-4be7-9a9f-5e5a9c6c3b81 req-f8494709-d9a9-4081-94c4-79399e6f2914 service nova] Acquired lock "refresh_cache-faeb3377-d199-472b-9ee2-f504d5ac9ac4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG nova.network.neutron [req-5bbdfde5-c571-4be7-9a9f-5e5a9c6c3b81 req-f8494709-d9a9-4081-94c4-79399e6f2914 service nova] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Refreshing network info cache for port e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Start _get_guest_xml network_info=[{"id": "e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa", "address": "fa:16:3e:f4:17:52", "network": {"id": "1e997e66-8753-4b3a-a6c9-26ba2a6152fa", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1625339302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa47b07cec543abbcfe0c27cb06e591", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5356eac-6f", "ovs_interfaceid": "e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:45:28 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:45:28 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:45:28 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:45:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1939508979',display_name='tempest-VolumesAssistedSnapshotsTest-server-1939508979',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1939508979',id=9,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJfdZqKAE0r0CKH6VGJq2O3BVuRwT7eBQDZQRr4fW2r2oECzghrOS0rMgeQqupLkejkXJbaQ4kamX/1GzsToSACvGpO0QTqrvPPLFtnZ8wuCEEo1wJZ+ov4oDtPOBWilzQ==',key_name='tempest-keypair-87582777',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8aa47b07cec543abbcfe0c27cb06e591',ramdisk_id='',reservation_id='r-xt3d1zsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1054739683',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1054739683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2cd9f911e27e4ad398043e232d750aa9',uuid=faeb3377-d199-472b-9ee2-f504d5ac9ac4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa", "address": "fa:16:3e:f4:17:52", "network": {"id": "1e997e66-8753-4b3a-a6c9-26ba2a6152fa", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1625339302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa47b07cec543abbcfe0c27cb06e591", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5356eac-6f", "ovs_interfaceid": "e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Converting VIF {"id": "e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa", "address": "fa:16:3e:f4:17:52", "network": {"id": "1e997e66-8753-4b3a-a6c9-26ba2a6152fa", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1625339302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa47b07cec543abbcfe0c27cb06e591", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5356eac-6f", "ovs_interfaceid": "e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:17:52,bridge_name='br-int',has_traffic_filtering=True,id=e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa,network=Network(1e997e66-8753-4b3a-a6c9-26ba2a6152fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5356eac-6f') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG nova.objects.instance [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Lazy-loading 'pci_devices' on Instance uuid faeb3377-d199-472b-9ee2-f504d5ac9ac4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:45:28 user nova-compute[74850]:   <uuid>faeb3377-d199-472b-9ee2-f504d5ac9ac4</uuid>
Nov 14 00:45:28 user nova-compute[74850]:   <name>instance-00000009</name>
Nov 14 00:45:28 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:45:28 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:45:28 user nova-compute[74850]:   <metadata>
Nov 14 00:45:28 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:45:28 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:45:28 user nova-compute[74850]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1939508979</nova:name>
Nov 14 00:45:28 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:45:28</nova:creationTime>
Nov 14 00:45:28 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:45:28 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:45:28 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:45:28 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:45:28 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:45:28 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:45:28 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:45:28 user nova-compute[74850]:       <nova:owner>
Nov 14 00:45:28 user nova-compute[74850]:         <nova:user uuid="2cd9f911e27e4ad398043e232d750aa9">tempest-VolumesAssistedSnapshotsTest-1054739683-project-member</nova:user>
Nov 14 00:45:28 user nova-compute[74850]:         <nova:project uuid="8aa47b07cec543abbcfe0c27cb06e591">tempest-VolumesAssistedSnapshotsTest-1054739683</nova:project>
Nov 14 00:45:28 user nova-compute[74850]:       </nova:owner>
Nov 14 00:45:28 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:45:28 user nova-compute[74850]:       <nova:ports>
Nov 14 00:45:28 user nova-compute[74850]:         <nova:port uuid="e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa">
Nov 14 00:45:28 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 00:45:28 user nova-compute[74850]:         </nova:port>
Nov 14 00:45:28 user nova-compute[74850]:       </nova:ports>
Nov 14 00:45:28 user nova-compute[74850]:     </nova:instance>
Nov 14 00:45:28 user nova-compute[74850]:   </metadata>
Nov 14 00:45:28 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:45:28 user nova-compute[74850]:     <system>
Nov 14 00:45:28 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:45:28 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:45:28 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:45:28 user nova-compute[74850]:       <entry name="serial">faeb3377-d199-472b-9ee2-f504d5ac9ac4</entry>
Nov 14 00:45:28 user nova-compute[74850]:       <entry name="uuid">faeb3377-d199-472b-9ee2-f504d5ac9ac4</entry>
Nov 14 00:45:28 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:45:28 user nova-compute[74850]:     </system>
Nov 14 00:45:28 user nova-compute[74850]:   </sysinfo>
Nov 14 00:45:28 user nova-compute[74850]:   <os>
Nov 14 00:45:28 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:45:28 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 00:45:28 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:45:28 user nova-compute[74850]:   </os>
Nov 14 00:45:28 user nova-compute[74850]:   <features>
Nov 14 00:45:28 user nova-compute[74850]:     <acpi/>
Nov 14 00:45:28 user nova-compute[74850]:     <apic/>
Nov 14 00:45:28 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:45:28 user nova-compute[74850]:   </features>
Nov 14 00:45:28 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:45:28 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:45:28 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:45:28 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:45:28 user nova-compute[74850]:   </clock>
Nov 14 00:45:28 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:45:28 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:45:28 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:45:28 user nova-compute[74850]:   </cpu>
Nov 14 00:45:28 user nova-compute[74850]:   <devices>
Nov 14 00:45:28 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 00:45:28 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:45:28 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/faeb3377-d199-472b-9ee2-f504d5ac9ac4/disk"/>
Nov 14 00:45:28 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:45:28 user nova-compute[74850]:     </disk>
Nov 14 00:45:28 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:45:28 user nova-compute[74850]:       <mac address="fa:16:3e:f4:17:52"/>
Nov 14 00:45:28 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:45:28 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:45:28 user nova-compute[74850]:       <target dev="tape5356eac-6f"/>
Nov 14 00:45:28 user nova-compute[74850]:     </interface>
Nov 14 00:45:28 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:45:28 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/faeb3377-d199-472b-9ee2-f504d5ac9ac4/console.log" append="off"/>
Nov 14 00:45:28 user nova-compute[74850]:     </serial>
Nov 14 00:45:28 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:45:28 user nova-compute[74850]:     <video>
Nov 14 00:45:28 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:45:28 user nova-compute[74850]:     </video>
Nov 14 00:45:28 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:45:28 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:45:28 user nova-compute[74850]:     </rng>
Nov 14 00:45:28 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:45:28 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:45:28 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:45:28 user nova-compute[74850]:     </memballoon>
Nov 14 00:45:28 user nova-compute[74850]:   </devices>
Nov 14 00:45:28 user nova-compute[74850]: </domain>
Nov 14 00:45:28 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:45:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1939508979',display_name='tempest-VolumesAssistedSnapshotsTest-server-1939508979',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1939508979',id=9,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJfdZqKAE0r0CKH6VGJq2O3BVuRwT7eBQDZQRr4fW2r2oECzghrOS0rMgeQqupLkejkXJbaQ4kamX/1GzsToSACvGpO0QTqrvPPLFtnZ8wuCEEo1wJZ+ov4oDtPOBWilzQ==',key_name='tempest-keypair-87582777',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8aa47b07cec543abbcfe0c27cb06e591',ramdisk_id='',reservation_id='r-xt3d1zsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1054739683',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1054739683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2cd9f911e27e4ad398043e232d750aa9',uuid=faeb3377-d199-472b-9ee2-f504d5ac9ac4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa", "address": "fa:16:3e:f4:17:52", "network": {"id": "1e997e66-8753-4b3a-a6c9-26ba2a6152fa", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1625339302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa47b07cec543abbcfe0c27cb06e591", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5356eac-6f", "ovs_interfaceid": "e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Converting VIF {"id": "e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa", "address": "fa:16:3e:f4:17:52", "network": {"id": "1e997e66-8753-4b3a-a6c9-26ba2a6152fa", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1625339302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa47b07cec543abbcfe0c27cb06e591", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5356eac-6f", "ovs_interfaceid": "e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:17:52,bridge_name='br-int',has_traffic_filtering=True,id=e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa,network=Network(1e997e66-8753-4b3a-a6c9-26ba2a6152fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5356eac-6f') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG os_vif [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:17:52,bridge_name='br-int',has_traffic_filtering=True,id=e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa,network=Network(1e997e66-8753-4b3a-a6c9-26ba2a6152fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5356eac-6f') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2d3fa0df-dd45-50fa-bd75-6e3facebc868', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape5356eac-6f, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape5356eac-6f, col_values=(('qos', UUID('9545d1bc-76b6-44f6-bf17-669101cb1ef7')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape5356eac-6f, col_values=(('external_ids', {'iface-id': 'e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:17:52', 'vm-uuid': 'faeb3377-d199-472b-9ee2-f504d5ac9ac4'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:28 user nova-compute[74850]: INFO os_vif [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:17:52,bridge_name='br-int',has_traffic_filtering=True,id=e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa,network=Network(1e997e66-8753-4b3a-a6c9-26ba2a6152fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5356eac-6f')
Nov 14 00:45:28 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] No VIF found with MAC fa:16:3e:f4:17:52, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Acquiring lock "92c077bc-31f0-4794-b01e-08204e4301d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Lock "92c077bc-31f0-4794-b01e-08204e4301d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:28 user nova-compute[74850]: DEBUG nova.compute.manager [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 00:45:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:29 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 00:45:29 user nova-compute[74850]: INFO nova.compute.claims [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Claim successful on node user
Nov 14 00:45:29 user nova-compute[74850]: DEBUG nova.network.neutron [req-5bbdfde5-c571-4be7-9a9f-5e5a9c6c3b81 req-f8494709-d9a9-4081-94c4-79399e6f2914 service nova] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Updated VIF entry in instance network info cache for port e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:45:29 user nova-compute[74850]: DEBUG nova.network.neutron [req-5bbdfde5-c571-4be7-9a9f-5e5a9c6c3b81 req-f8494709-d9a9-4081-94c4-79399e6f2914 service nova] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Updating instance_info_cache with network_info: [{"id": "e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa", "address": "fa:16:3e:f4:17:52", "network": {"id": "1e997e66-8753-4b3a-a6c9-26ba2a6152fa", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1625339302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa47b07cec543abbcfe0c27cb06e591", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5356eac-6f", "ovs_interfaceid": "e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:45:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5bbdfde5-c571-4be7-9a9f-5e5a9c6c3b81 req-f8494709-d9a9-4081-94c4-79399e6f2914 service nova] Releasing lock "refresh_cache-faeb3377-d199-472b-9ee2-f504d5ac9ac4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:45:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:30 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:30 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:30 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:45:30 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:45:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.073s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:30 user nova-compute[74850]: DEBUG nova.compute.manager [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 00:45:30 user nova-compute[74850]: DEBUG nova.compute.manager [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 00:45:30 user nova-compute[74850]: DEBUG nova.network.neutron [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 00:45:30 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 00:45:30 user nova-compute[74850]: DEBUG nova.compute.manager [req-4fd9d440-17cd-4294-b89a-7b8119de945d req-f7c16898-0ba7-484f-a6dd-fe8df709ffb6 service nova] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Received event network-vif-plugged-5db497e0-e507-4a13-b0ff-fb4f7608f94d {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-4fd9d440-17cd-4294-b89a-7b8119de945d req-f7c16898-0ba7-484f-a6dd-fe8df709ffb6 service nova] Acquiring lock "b54b37bc-8c90-4c48-a943-e489e830b93b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-4fd9d440-17cd-4294-b89a-7b8119de945d req-f7c16898-0ba7-484f-a6dd-fe8df709ffb6 service nova] Lock "b54b37bc-8c90-4c48-a943-e489e830b93b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-4fd9d440-17cd-4294-b89a-7b8119de945d req-f7c16898-0ba7-484f-a6dd-fe8df709ffb6 service nova] Lock "b54b37bc-8c90-4c48-a943-e489e830b93b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:30 user nova-compute[74850]: DEBUG nova.compute.manager [req-4fd9d440-17cd-4294-b89a-7b8119de945d req-f7c16898-0ba7-484f-a6dd-fe8df709ffb6 service nova] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] No waiting events found dispatching network-vif-plugged-5db497e0-e507-4a13-b0ff-fb4f7608f94d {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:45:30 user nova-compute[74850]: WARNING nova.compute.manager [req-4fd9d440-17cd-4294-b89a-7b8119de945d req-f7c16898-0ba7-484f-a6dd-fe8df709ffb6 service nova] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Received unexpected event network-vif-plugged-5db497e0-e507-4a13-b0ff-fb4f7608f94d for instance with vm_state building and task_state spawning.
Nov 14 00:45:30 user nova-compute[74850]: DEBUG nova.compute.manager [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 00:45:30 user nova-compute[74850]: DEBUG nova.policy [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '59bff1f8623746b082df98f5558a39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63909e1ffa674423bbe253437baf8a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 00:45:30 user nova-compute[74850]: DEBUG nova.compute.manager [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 00:45:30 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 00:45:30 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Creating image(s)
Nov 14 00:45:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Acquiring lock "/opt/stack/data/nova/instances/92c077bc-31f0-4794-b01e-08204e4301d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Lock "/opt/stack/data/nova/instances/92c077bc-31f0-4794-b01e-08204e4301d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Lock "/opt/stack/data/nova/instances/92c077bc-31f0-4794-b01e-08204e4301d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:30 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:30 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.270s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:30 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:30 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.251s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/92c077bc-31f0-4794-b01e-08204e4301d4/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/92c077bc-31f0-4794-b01e-08204e4301d4/disk 1073741824" returned: 0 in 0.091s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.351s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.237s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:31 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Checking if we can resize image /opt/stack/data/nova/instances/92c077bc-31f0-4794-b01e-08204e4301d4/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 00:45:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c077bc-31f0-4794-b01e-08204e4301d4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:31 user nova-compute[74850]: DEBUG nova.network.neutron [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Successfully created port: 56b44336-14e2-4a85-8169-2440ba5be7a3 {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:45:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c077bc-31f0-4794-b01e-08204e4301d4/disk --force-share --output=json" returned: 0 in 0.352s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:31 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Cannot resize image /opt/stack/data/nova/instances/92c077bc-31f0-4794-b01e-08204e4301d4/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 00:45:31 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 00:45:31 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Ensure instance console log exists: /opt/stack/data/nova/instances/92c077bc-31f0-4794-b01e-08204e4301d4/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 00:45:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:32 user nova-compute[74850]: DEBUG nova.compute.manager [req-e920b741-71b6-4ee2-a4ab-926df6110a38 req-1a4be138-12f0-485e-a468-cc2045a4e2af service nova] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Received event network-vif-plugged-5db497e0-e507-4a13-b0ff-fb4f7608f94d {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e920b741-71b6-4ee2-a4ab-926df6110a38 req-1a4be138-12f0-485e-a468-cc2045a4e2af service nova] Acquiring lock "b54b37bc-8c90-4c48-a943-e489e830b93b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e920b741-71b6-4ee2-a4ab-926df6110a38 req-1a4be138-12f0-485e-a468-cc2045a4e2af service nova] Lock "b54b37bc-8c90-4c48-a943-e489e830b93b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e920b741-71b6-4ee2-a4ab-926df6110a38 req-1a4be138-12f0-485e-a468-cc2045a4e2af service nova] Lock "b54b37bc-8c90-4c48-a943-e489e830b93b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:32 user nova-compute[74850]: DEBUG nova.compute.manager [req-e920b741-71b6-4ee2-a4ab-926df6110a38 req-1a4be138-12f0-485e-a468-cc2045a4e2af service nova] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] No waiting events found dispatching network-vif-plugged-5db497e0-e507-4a13-b0ff-fb4f7608f94d {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:45:32 user nova-compute[74850]: WARNING nova.compute.manager [req-e920b741-71b6-4ee2-a4ab-926df6110a38 req-1a4be138-12f0-485e-a468-cc2045a4e2af service nova] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Received unexpected event network-vif-plugged-5db497e0-e507-4a13-b0ff-fb4f7608f94d for instance with vm_state building and task_state spawning.
Nov 14 00:45:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:32 user nova-compute[74850]: DEBUG nova.network.neutron [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Successfully updated port: 56b44336-14e2-4a85-8169-2440ba5be7a3 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:45:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Acquiring lock "refresh_cache-92c077bc-31f0-4794-b01e-08204e4301d4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:45:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Acquired lock "refresh_cache-92c077bc-31f0-4794-b01e-08204e4301d4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:45:32 user nova-compute[74850]: DEBUG nova.network.neutron [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:45:32 user nova-compute[74850]: DEBUG nova.network.neutron [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG nova.network.neutron [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Updating instance_info_cache with network_info: [{"id": "56b44336-14e2-4a85-8169-2440ba5be7a3", "address": "fa:16:3e:8f:7d:4d", "network": {"id": "866703c2-2e61-4b23-8605-393efcefa615", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1265400193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63909e1ffa674423bbe253437baf8a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b44336-14", "ovs_interfaceid": "56b44336-14e2-4a85-8169-2440ba5be7a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Releasing lock "refresh_cache-92c077bc-31f0-4794-b01e-08204e4301d4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG nova.compute.manager [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Instance network_info: |[{"id": "56b44336-14e2-4a85-8169-2440ba5be7a3", "address": "fa:16:3e:8f:7d:4d", "network": {"id": "866703c2-2e61-4b23-8605-393efcefa615", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1265400193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63909e1ffa674423bbe253437baf8a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b44336-14", "ovs_interfaceid": "56b44336-14e2-4a85-8169-2440ba5be7a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Start _get_guest_xml network_info=[{"id": "56b44336-14e2-4a85-8169-2440ba5be7a3", "address": "fa:16:3e:8f:7d:4d", "network": {"id": "866703c2-2e61-4b23-8605-393efcefa615", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1265400193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63909e1ffa674423bbe253437baf8a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b44336-14", "ovs_interfaceid": "56b44336-14e2-4a85-8169-2440ba5be7a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:45:33 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:45:33 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:45:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:45:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-797201859',display_name='tempest-VolumesActionsTest-instance-797201859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-797201859',id=10,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63909e1ffa674423bbe253437baf8a4d',ramdisk_id='',reservation_id='r-o5dcsyqq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-629891446',owner_user_name='tempest-VolumesActionsTest-629891446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:31Z,user_data=None,user_id='59bff1f8623746b082df98f5558a39c4',uuid=92c077bc-31f0-4794-b01e-08204e4301d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56b44336-14e2-4a85-8169-2440ba5be7a3", "address": "fa:16:3e:8f:7d:4d", "network": {"id": "866703c2-2e61-4b23-8605-393efcefa615", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1265400193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63909e1ffa674423bbe253437baf8a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b44336-14", "ovs_interfaceid": "56b44336-14e2-4a85-8169-2440ba5be7a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Converting VIF {"id": "56b44336-14e2-4a85-8169-2440ba5be7a3", "address": "fa:16:3e:8f:7d:4d", "network": {"id": "866703c2-2e61-4b23-8605-393efcefa615", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1265400193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63909e1ffa674423bbe253437baf8a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b44336-14", "ovs_interfaceid": "56b44336-14e2-4a85-8169-2440ba5be7a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:7d:4d,bridge_name='br-int',has_traffic_filtering=True,id=56b44336-14e2-4a85-8169-2440ba5be7a3,network=Network(866703c2-2e61-4b23-8605-393efcefa615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56b44336-14') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG nova.objects.instance [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Lazy-loading 'pci_devices' on Instance uuid 92c077bc-31f0-4794-b01e-08204e4301d4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:45:33 user nova-compute[74850]:   <uuid>92c077bc-31f0-4794-b01e-08204e4301d4</uuid>
Nov 14 00:45:33 user nova-compute[74850]:   <name>instance-0000000a</name>
Nov 14 00:45:33 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:45:33 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:45:33 user nova-compute[74850]:   <metadata>
Nov 14 00:45:33 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:45:33 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:45:33 user nova-compute[74850]:       <nova:name>tempest-VolumesActionsTest-instance-797201859</nova:name>
Nov 14 00:45:33 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:45:33</nova:creationTime>
Nov 14 00:45:33 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:45:33 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:45:33 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:45:33 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:45:33 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:45:33 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:45:33 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:45:33 user nova-compute[74850]:       <nova:owner>
Nov 14 00:45:33 user nova-compute[74850]:         <nova:user uuid="59bff1f8623746b082df98f5558a39c4">tempest-VolumesActionsTest-629891446-project-member</nova:user>
Nov 14 00:45:33 user nova-compute[74850]:         <nova:project uuid="63909e1ffa674423bbe253437baf8a4d">tempest-VolumesActionsTest-629891446</nova:project>
Nov 14 00:45:33 user nova-compute[74850]:       </nova:owner>
Nov 14 00:45:33 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:45:33 user nova-compute[74850]:       <nova:ports>
Nov 14 00:45:33 user nova-compute[74850]:         <nova:port uuid="56b44336-14e2-4a85-8169-2440ba5be7a3">
Nov 14 00:45:33 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 00:45:33 user nova-compute[74850]:         </nova:port>
Nov 14 00:45:33 user nova-compute[74850]:       </nova:ports>
Nov 14 00:45:33 user nova-compute[74850]:     </nova:instance>
Nov 14 00:45:33 user nova-compute[74850]:   </metadata>
Nov 14 00:45:33 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:45:33 user nova-compute[74850]:     <system>
Nov 14 00:45:33 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:45:33 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:45:33 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:45:33 user nova-compute[74850]:       <entry name="serial">92c077bc-31f0-4794-b01e-08204e4301d4</entry>
Nov 14 00:45:33 user nova-compute[74850]:       <entry name="uuid">92c077bc-31f0-4794-b01e-08204e4301d4</entry>
Nov 14 00:45:33 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:45:33 user nova-compute[74850]:     </system>
Nov 14 00:45:33 user nova-compute[74850]:   </sysinfo>
Nov 14 00:45:33 user nova-compute[74850]:   <os>
Nov 14 00:45:33 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:45:33 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 00:45:33 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:45:33 user nova-compute[74850]:   </os>
Nov 14 00:45:33 user nova-compute[74850]:   <features>
Nov 14 00:45:33 user nova-compute[74850]:     <acpi/>
Nov 14 00:45:33 user nova-compute[74850]:     <apic/>
Nov 14 00:45:33 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:45:33 user nova-compute[74850]:   </features>
Nov 14 00:45:33 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:45:33 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:45:33 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:45:33 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:45:33 user nova-compute[74850]:   </clock>
Nov 14 00:45:33 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:45:33 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:45:33 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:45:33 user nova-compute[74850]:   </cpu>
Nov 14 00:45:33 user nova-compute[74850]:   <devices>
Nov 14 00:45:33 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 00:45:33 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:45:33 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/92c077bc-31f0-4794-b01e-08204e4301d4/disk"/>
Nov 14 00:45:33 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:45:33 user nova-compute[74850]:     </disk>
Nov 14 00:45:33 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:45:33 user nova-compute[74850]:       <mac address="fa:16:3e:8f:7d:4d"/>
Nov 14 00:45:33 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:45:33 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:45:33 user nova-compute[74850]:       <target dev="tap56b44336-14"/>
Nov 14 00:45:33 user nova-compute[74850]:     </interface>
Nov 14 00:45:33 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:45:33 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/92c077bc-31f0-4794-b01e-08204e4301d4/console.log" append="off"/>
Nov 14 00:45:33 user nova-compute[74850]:     </serial>
Nov 14 00:45:33 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:45:33 user nova-compute[74850]:     <video>
Nov 14 00:45:33 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:45:33 user nova-compute[74850]:     </video>
Nov 14 00:45:33 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:45:33 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:45:33 user nova-compute[74850]:     </rng>
Nov 14 00:45:33 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:45:33 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:45:33 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:45:33 user nova-compute[74850]:     </memballoon>
Nov 14 00:45:33 user nova-compute[74850]:   </devices>
Nov 14 00:45:33 user nova-compute[74850]: </domain>
Nov 14 00:45:33 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:45:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-797201859',display_name='tempest-VolumesActionsTest-instance-797201859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-797201859',id=10,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63909e1ffa674423bbe253437baf8a4d',ramdisk_id='',reservation_id='r-o5dcsyqq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-629891446',owner_user_name='tempest-VolumesActionsTest-629891446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:31Z,user_data=None,user_id='59bff1f8623746b082df98f5558a39c4',uuid=92c077bc-31f0-4794-b01e-08204e4301d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56b44336-14e2-4a85-8169-2440ba5be7a3", "address": "fa:16:3e:8f:7d:4d", "network": {"id": "866703c2-2e61-4b23-8605-393efcefa615", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1265400193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63909e1ffa674423bbe253437baf8a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b44336-14", "ovs_interfaceid": "56b44336-14e2-4a85-8169-2440ba5be7a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Converting VIF {"id": "56b44336-14e2-4a85-8169-2440ba5be7a3", "address": "fa:16:3e:8f:7d:4d", "network": {"id": "866703c2-2e61-4b23-8605-393efcefa615", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1265400193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63909e1ffa674423bbe253437baf8a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b44336-14", "ovs_interfaceid": "56b44336-14e2-4a85-8169-2440ba5be7a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:7d:4d,bridge_name='br-int',has_traffic_filtering=True,id=56b44336-14e2-4a85-8169-2440ba5be7a3,network=Network(866703c2-2e61-4b23-8605-393efcefa615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56b44336-14') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG os_vif [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:7d:4d,bridge_name='br-int',has_traffic_filtering=True,id=56b44336-14e2-4a85-8169-2440ba5be7a3,network=Network(866703c2-2e61-4b23-8605-393efcefa615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56b44336-14') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e69d65b9-8743-5a25-95b2-748daf7e9a61', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56b44336-14, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap56b44336-14, col_values=(('qos', UUID('85bdbeeb-ebb9-48c6-9d58-d49541fd63a2')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap56b44336-14, col_values=(('external_ids', {'iface-id': '56b44336-14e2-4a85-8169-2440ba5be7a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:7d:4d', 'vm-uuid': '92c077bc-31f0-4794-b01e-08204e4301d4'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:33 user nova-compute[74850]: INFO os_vif [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:7d:4d,bridge_name='br-int',has_traffic_filtering=True,id=56b44336-14e2-4a85-8169-2440ba5be7a3,network=Network(866703c2-2e61-4b23-8605-393efcefa615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56b44336-14')
Nov 14 00:45:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:45:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] No VIF found with MAC fa:16:3e:8f:7d:4d, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:45:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:34 user nova-compute[74850]: DEBUG nova.compute.manager [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:45:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 00:45:34 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:45:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 00:45:34 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Instance spawned successfully.
Nov 14 00:45:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 00:45:34 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Instance spawned successfully.
Nov 14 00:45:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 00:45:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:34 user nova-compute[74850]: INFO nova.compute.manager [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Took 9.47 seconds to spawn the instance on the hypervisor.
Nov 14 00:45:34 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:45:34 user nova-compute[74850]: INFO nova.compute.manager [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Took 9.24 seconds to spawn the instance on the hypervisor.
Nov 14 00:45:34 user nova-compute[74850]: DEBUG nova.compute.manager [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:45:35 user nova-compute[74850]: INFO nova.compute.manager [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Took 11.17 seconds to build instance.
Nov 14 00:45:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4e6c023f-1995-4dd7-9267-46627d5fd593 tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Lock "faeb3377-d199-472b-9ee2-f504d5ac9ac4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.347s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:35 user nova-compute[74850]: INFO nova.compute.manager [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Took 18.84 seconds to build instance.
Nov 14 00:45:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-51e05473-24c5-4225-a358-418bbd199753 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Lock "b54b37bc-8c90-4c48-a943-e489e830b93b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.074s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:36 user nova-compute[74850]: DEBUG nova.compute.manager [req-a46fbdc8-675e-4ae1-956c-bc028c8765ab req-825c8af7-d6d5-44b3-b17e-c81d1546ea36 service nova] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Received event network-changed-56b44336-14e2-4a85-8169-2440ba5be7a3 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:36 user nova-compute[74850]: DEBUG nova.compute.manager [req-a46fbdc8-675e-4ae1-956c-bc028c8765ab req-825c8af7-d6d5-44b3-b17e-c81d1546ea36 service nova] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Refreshing instance network info cache due to event network-changed-56b44336-14e2-4a85-8169-2440ba5be7a3. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:45:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a46fbdc8-675e-4ae1-956c-bc028c8765ab req-825c8af7-d6d5-44b3-b17e-c81d1546ea36 service nova] Acquiring lock "refresh_cache-92c077bc-31f0-4794-b01e-08204e4301d4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:45:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a46fbdc8-675e-4ae1-956c-bc028c8765ab req-825c8af7-d6d5-44b3-b17e-c81d1546ea36 service nova] Acquired lock "refresh_cache-92c077bc-31f0-4794-b01e-08204e4301d4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:45:36 user nova-compute[74850]: DEBUG nova.network.neutron [req-a46fbdc8-675e-4ae1-956c-bc028c8765ab req-825c8af7-d6d5-44b3-b17e-c81d1546ea36 service nova] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Refreshing network info cache for port 56b44336-14e2-4a85-8169-2440ba5be7a3 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:45:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:37 user nova-compute[74850]: DEBUG nova.compute.manager [req-e725f65a-4135-4d26-9f62-b5b282a918d4 req-fbd9969d-1b25-4239-a1bf-6be72cd45b6c service nova] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Received event network-vif-plugged-9df19d5e-989a-48d6-97ce-03b6a897a611 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e725f65a-4135-4d26-9f62-b5b282a918d4 req-fbd9969d-1b25-4239-a1bf-6be72cd45b6c service nova] Acquiring lock "28212eec-99be-4171-97ed-7748bbb75c88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e725f65a-4135-4d26-9f62-b5b282a918d4 req-fbd9969d-1b25-4239-a1bf-6be72cd45b6c service nova] Lock "28212eec-99be-4171-97ed-7748bbb75c88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e725f65a-4135-4d26-9f62-b5b282a918d4 req-fbd9969d-1b25-4239-a1bf-6be72cd45b6c service nova] Lock "28212eec-99be-4171-97ed-7748bbb75c88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:37 user nova-compute[74850]: DEBUG nova.compute.manager [req-e725f65a-4135-4d26-9f62-b5b282a918d4 req-fbd9969d-1b25-4239-a1bf-6be72cd45b6c service nova] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] No waiting events found dispatching network-vif-plugged-9df19d5e-989a-48d6-97ce-03b6a897a611 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:45:37 user nova-compute[74850]: WARNING nova.compute.manager [req-e725f65a-4135-4d26-9f62-b5b282a918d4 req-fbd9969d-1b25-4239-a1bf-6be72cd45b6c service nova] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Received unexpected event network-vif-plugged-9df19d5e-989a-48d6-97ce-03b6a897a611 for instance with vm_state active and task_state None.
Nov 14 00:45:37 user nova-compute[74850]: DEBUG nova.network.neutron [req-a46fbdc8-675e-4ae1-956c-bc028c8765ab req-825c8af7-d6d5-44b3-b17e-c81d1546ea36 service nova] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Updated VIF entry in instance network info cache for port 56b44336-14e2-4a85-8169-2440ba5be7a3. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:45:37 user nova-compute[74850]: DEBUG nova.network.neutron [req-a46fbdc8-675e-4ae1-956c-bc028c8765ab req-825c8af7-d6d5-44b3-b17e-c81d1546ea36 service nova] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Updating instance_info_cache with network_info: [{"id": "56b44336-14e2-4a85-8169-2440ba5be7a3", "address": "fa:16:3e:8f:7d:4d", "network": {"id": "866703c2-2e61-4b23-8605-393efcefa615", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1265400193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63909e1ffa674423bbe253437baf8a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b44336-14", "ovs_interfaceid": "56b44336-14e2-4a85-8169-2440ba5be7a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:45:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a46fbdc8-675e-4ae1-956c-bc028c8765ab req-825c8af7-d6d5-44b3-b17e-c81d1546ea36 service nova] Releasing lock "refresh_cache-92c077bc-31f0-4794-b01e-08204e4301d4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:45:37 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:45:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:37 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 00:45:38 user nova-compute[74850]: DEBUG nova.compute.manager [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:45:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 00:45:38 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Instance spawned successfully.
Nov 14 00:45:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 00:45:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:45:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Acquiring lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:38 user nova-compute[74850]: DEBUG nova.compute.manager [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 00:45:38 user nova-compute[74850]: INFO nova.compute.manager [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Took 7.60 seconds to spawn the instance on the hypervisor.
Nov 14 00:45:38 user nova-compute[74850]: DEBUG nova.compute.manager [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:45:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:38 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 00:45:38 user nova-compute[74850]: INFO nova.compute.claims [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Claim successful on node user
Nov 14 00:45:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937d7470-ec86-4972-b975-257d626329dd/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:38 user nova-compute[74850]: INFO nova.compute.manager [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Took 9.64 seconds to build instance.
Nov 14 00:45:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-df89837c-0174-4302-a2c1-b121dcd2fab3 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Lock "92c077bc-31f0-4794-b01e-08204e4301d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.948s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937d7470-ec86-4972-b975-257d626329dd/disk --force-share --output=json" returned: 0 in 0.416s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937d7470-ec86-4972-b975-257d626329dd/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:39 user nova-compute[74850]: DEBUG nova.compute.manager [req-21b8f9df-2501-4ceb-b805-be5963c59ad3 req-27ee7c36-a48f-49b4-b29d-d8185fe3c67e service nova] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Received event network-vif-plugged-9df19d5e-989a-48d6-97ce-03b6a897a611 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-21b8f9df-2501-4ceb-b805-be5963c59ad3 req-27ee7c36-a48f-49b4-b29d-d8185fe3c67e service nova] Acquiring lock "28212eec-99be-4171-97ed-7748bbb75c88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-21b8f9df-2501-4ceb-b805-be5963c59ad3 req-27ee7c36-a48f-49b4-b29d-d8185fe3c67e service nova] Lock "28212eec-99be-4171-97ed-7748bbb75c88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-21b8f9df-2501-4ceb-b805-be5963c59ad3 req-27ee7c36-a48f-49b4-b29d-d8185fe3c67e service nova] Lock "28212eec-99be-4171-97ed-7748bbb75c88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:39 user nova-compute[74850]: DEBUG nova.compute.manager [req-21b8f9df-2501-4ceb-b805-be5963c59ad3 req-27ee7c36-a48f-49b4-b29d-d8185fe3c67e service nova] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] No waiting events found dispatching network-vif-plugged-9df19d5e-989a-48d6-97ce-03b6a897a611 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:45:39 user nova-compute[74850]: WARNING nova.compute.manager [req-21b8f9df-2501-4ceb-b805-be5963c59ad3 req-27ee7c36-a48f-49b4-b29d-d8185fe3c67e service nova] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Received unexpected event network-vif-plugged-9df19d5e-989a-48d6-97ce-03b6a897a611 for instance with vm_state active and task_state None.
Nov 14 00:45:39 user nova-compute[74850]: DEBUG nova.compute.manager [req-21b8f9df-2501-4ceb-b805-be5963c59ad3 req-27ee7c36-a48f-49b4-b29d-d8185fe3c67e service nova] [instance: 937d7470-ec86-4972-b975-257d626329dd] Received event network-vif-plugged-2df12354-6de2-49fd-812e-1354c7c87039 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-21b8f9df-2501-4ceb-b805-be5963c59ad3 req-27ee7c36-a48f-49b4-b29d-d8185fe3c67e service nova] Acquiring lock "937d7470-ec86-4972-b975-257d626329dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-21b8f9df-2501-4ceb-b805-be5963c59ad3 req-27ee7c36-a48f-49b4-b29d-d8185fe3c67e service nova] Lock "937d7470-ec86-4972-b975-257d626329dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-21b8f9df-2501-4ceb-b805-be5963c59ad3 req-27ee7c36-a48f-49b4-b29d-d8185fe3c67e service nova] Lock "937d7470-ec86-4972-b975-257d626329dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:39 user nova-compute[74850]: DEBUG nova.compute.manager [req-21b8f9df-2501-4ceb-b805-be5963c59ad3 req-27ee7c36-a48f-49b4-b29d-d8185fe3c67e service nova] [instance: 937d7470-ec86-4972-b975-257d626329dd] No waiting events found dispatching network-vif-plugged-2df12354-6de2-49fd-812e-1354c7c87039 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:45:39 user nova-compute[74850]: WARNING nova.compute.manager [req-21b8f9df-2501-4ceb-b805-be5963c59ad3 req-27ee7c36-a48f-49b4-b29d-d8185fe3c67e service nova] [instance: 937d7470-ec86-4972-b975-257d626329dd] Received unexpected event network-vif-plugged-2df12354-6de2-49fd-812e-1354c7c87039 for instance with vm_state active and task_state None.
Nov 14 00:45:39 user nova-compute[74850]: DEBUG nova.compute.manager [req-21b8f9df-2501-4ceb-b805-be5963c59ad3 req-27ee7c36-a48f-49b4-b29d-d8185fe3c67e service nova] [instance: 937d7470-ec86-4972-b975-257d626329dd] Received event network-vif-plugged-2df12354-6de2-49fd-812e-1354c7c87039 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-21b8f9df-2501-4ceb-b805-be5963c59ad3 req-27ee7c36-a48f-49b4-b29d-d8185fe3c67e service nova] Acquiring lock "937d7470-ec86-4972-b975-257d626329dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-21b8f9df-2501-4ceb-b805-be5963c59ad3 req-27ee7c36-a48f-49b4-b29d-d8185fe3c67e service nova] Lock "937d7470-ec86-4972-b975-257d626329dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.012s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-21b8f9df-2501-4ceb-b805-be5963c59ad3 req-27ee7c36-a48f-49b4-b29d-d8185fe3c67e service nova] Lock "937d7470-ec86-4972-b975-257d626329dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:39 user nova-compute[74850]: DEBUG nova.compute.manager [req-21b8f9df-2501-4ceb-b805-be5963c59ad3 req-27ee7c36-a48f-49b4-b29d-d8185fe3c67e service nova] [instance: 937d7470-ec86-4972-b975-257d626329dd] No waiting events found dispatching network-vif-plugged-2df12354-6de2-49fd-812e-1354c7c87039 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:45:39 user nova-compute[74850]: WARNING nova.compute.manager [req-21b8f9df-2501-4ceb-b805-be5963c59ad3 req-27ee7c36-a48f-49b4-b29d-d8185fe3c67e service nova] [instance: 937d7470-ec86-4972-b975-257d626329dd] Received unexpected event network-vif-plugged-2df12354-6de2-49fd-812e-1354c7c87039 for instance with vm_state active and task_state None.
Nov 14 00:45:39 user nova-compute[74850]: DEBUG nova.compute.manager [req-21b8f9df-2501-4ceb-b805-be5963c59ad3 req-27ee7c36-a48f-49b4-b29d-d8185fe3c67e service nova] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Received event network-vif-plugged-56b44336-14e2-4a85-8169-2440ba5be7a3 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-21b8f9df-2501-4ceb-b805-be5963c59ad3 req-27ee7c36-a48f-49b4-b29d-d8185fe3c67e service nova] Acquiring lock "92c077bc-31f0-4794-b01e-08204e4301d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-21b8f9df-2501-4ceb-b805-be5963c59ad3 req-27ee7c36-a48f-49b4-b29d-d8185fe3c67e service nova] Lock "92c077bc-31f0-4794-b01e-08204e4301d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-21b8f9df-2501-4ceb-b805-be5963c59ad3 req-27ee7c36-a48f-49b4-b29d-d8185fe3c67e service nova] Lock "92c077bc-31f0-4794-b01e-08204e4301d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:39 user nova-compute[74850]: DEBUG nova.compute.manager [req-21b8f9df-2501-4ceb-b805-be5963c59ad3 req-27ee7c36-a48f-49b4-b29d-d8185fe3c67e service nova] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] No waiting events found dispatching network-vif-plugged-56b44336-14e2-4a85-8169-2440ba5be7a3 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:45:39 user nova-compute[74850]: WARNING nova.compute.manager [req-21b8f9df-2501-4ceb-b805-be5963c59ad3 req-27ee7c36-a48f-49b4-b29d-d8185fe3c67e service nova] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Received unexpected event network-vif-plugged-56b44336-14e2-4a85-8169-2440ba5be7a3 for instance with vm_state active and task_state None.
Nov 14 00:45:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937d7470-ec86-4972-b975-257d626329dd/disk --force-share --output=json" returned: 0 in 0.396s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28212eec-99be-4171-97ed-7748bbb75c88/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:39 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:45:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28212eec-99be-4171-97ed-7748bbb75c88/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28212eec-99be-4171-97ed-7748bbb75c88/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:39 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:45:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.441s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:39 user nova-compute[74850]: DEBUG nova.compute.manager [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 00:45:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28212eec-99be-4171-97ed-7748bbb75c88/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f1a88ea-83a3-447b-a83d-40b2c1c908f5/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:40 user nova-compute[74850]: DEBUG nova.compute.manager [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 00:45:40 user nova-compute[74850]: DEBUG nova.network.neutron [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 00:45:40 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 00:45:40 user nova-compute[74850]: DEBUG nova.compute.manager [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 00:45:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f1a88ea-83a3-447b-a83d-40b2c1c908f5/disk --force-share --output=json" returned: 0 in 0.310s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f1a88ea-83a3-447b-a83d-40b2c1c908f5/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:40 user nova-compute[74850]: INFO nova.virt.block_device [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Booting with volume 866aee5f-8ea9-4a58-a6ee-1a4aee92f606 at /dev/vda
Nov 14 00:45:40 user nova-compute[74850]: DEBUG nova.policy [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb387c6b56014059a5ce18ffe642c3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f380efb37074b3399411fafb1deaa00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 00:45:40 user nova-compute[74850]: DEBUG os_brick.utils [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:45:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:40 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[290d7543-c5ae-4f07-a446-acc53fc64b78]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:40 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c6cfe3-4b97-478a-8681-6452568a8bbd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:40 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[23933a85-6ce9-4092-a913-3b477dd79f00]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:40 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9e6b82-cf48-4e8c-acd5-e48d89f4fc5f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:45:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f1a88ea-83a3-447b-a83d-40b2c1c908f5/disk --force-share --output=json" returned: 0 in 0.333s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 00:45:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:45:40 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 00:45:40 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5161d4a-c48a-4154-9283-8cb64c2211b4]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 00:45:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 00:45:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 00:45:40 user nova-compute[74850]: DEBUG os_brick.utils [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:45:40 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Updating existing volume attachment record: 6a5c685d-201e-49bb-a3fe-ee9894af63f2 {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 00:45:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1282f7f3-c81e-4a6e-bd86-42459f49674f/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1282f7f3-c81e-4a6e-bd86-42459f49674f/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1282f7f3-c81e-4a6e-bd86-42459f49674f/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1282f7f3-c81e-4a6e-bd86-42459f49674f/disk --force-share --output=json" returned: 0 in 0.361s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:41 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:45:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:41 user nova-compute[74850]: DEBUG nova.compute.manager [req-12db0ab8-f26c-40ed-bc04-62dd6fbe5c04 req-ddf2acc4-afce-4d31-a387-bcd1b7707f20 service nova] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Received event network-vif-plugged-56b44336-14e2-4a85-8169-2440ba5be7a3 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-12db0ab8-f26c-40ed-bc04-62dd6fbe5c04 req-ddf2acc4-afce-4d31-a387-bcd1b7707f20 service nova] Acquiring lock "92c077bc-31f0-4794-b01e-08204e4301d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-12db0ab8-f26c-40ed-bc04-62dd6fbe5c04 req-ddf2acc4-afce-4d31-a387-bcd1b7707f20 service nova] Lock "92c077bc-31f0-4794-b01e-08204e4301d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-12db0ab8-f26c-40ed-bc04-62dd6fbe5c04 req-ddf2acc4-afce-4d31-a387-bcd1b7707f20 service nova] Lock "92c077bc-31f0-4794-b01e-08204e4301d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:41 user nova-compute[74850]: DEBUG nova.compute.manager [req-12db0ab8-f26c-40ed-bc04-62dd6fbe5c04 req-ddf2acc4-afce-4d31-a387-bcd1b7707f20 service nova] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] No waiting events found dispatching network-vif-plugged-56b44336-14e2-4a85-8169-2440ba5be7a3 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:45:41 user nova-compute[74850]: WARNING nova.compute.manager [req-12db0ab8-f26c-40ed-bc04-62dd6fbe5c04 req-ddf2acc4-afce-4d31-a387-bcd1b7707f20 service nova] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Received unexpected event network-vif-plugged-56b44336-14e2-4a85-8169-2440ba5be7a3 for instance with vm_state active and task_state None.
Nov 14 00:45:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faeb3377-d199-472b-9ee2-f504d5ac9ac4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:42 user nova-compute[74850]: DEBUG nova.network.neutron [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Successfully created port: 04f4b3e3-634c-4285-b389-785cff1205ea {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:45:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faeb3377-d199-472b-9ee2-f504d5ac9ac4/disk --force-share --output=json" returned: 0 in 0.329s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faeb3377-d199-472b-9ee2-f504d5ac9ac4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Acquiring lock "cc072036-25dc-48a8-b430-5a2655fb473a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Lock "cc072036-25dc-48a8-b430-5a2655fb473a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.011s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:42 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 00:45:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faeb3377-d199-472b-9ee2-f504d5ac9ac4/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c077bc-31f0-4794-b01e-08204e4301d4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:42 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 00:45:42 user nova-compute[74850]: INFO nova.compute.claims [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Claim successful on node user
Nov 14 00:45:42 user nova-compute[74850]: DEBUG nova.network.neutron [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Successfully created port: ab41a728-624a-46a0-9fd6-0268c0b35f55 {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:45:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c077bc-31f0-4794-b01e-08204e4301d4/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c077bc-31f0-4794-b01e-08204e4301d4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c077bc-31f0-4794-b01e-08204e4301d4/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2881e6-ee6e-4165-a6d9-35fda79c142d/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:43 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2881e6-ee6e-4165-a6d9-35fda79c142d/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2881e6-ee6e-4165-a6d9-35fda79c142d/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:43 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:45:43 user nova-compute[74850]: DEBUG nova.network.neutron [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Successfully created port: 091cb215-5fc9-4eb5-9aca-0751d5e41ea4 {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:45:43 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:45:43 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.860s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:43 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 00:45:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2881e6-ee6e-4165-a6d9-35fda79c142d/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:43 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 00:45:43 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 00:45:43 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 00:45:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:44 user nova-compute[74850]: DEBUG nova.policy [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c75e4b6218c34ff98d528512b4b2d825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11a9473df4d4f11ac696ce90dfe7dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 00:45:44 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 00:45:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG nova.network.neutron [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Successfully created port: 5fdd3936-9253-49a5-9f2d-6c2fdce456ea {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:45:45 user nova-compute[74850]: INFO nova.virt.block_device [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Booting with volume 0445ff3f-e6a1-42c9-8615-6a1dedd73f9c at /dev/vda
Nov 14 00:45:45 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:45:45 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:45:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=7753MB free_disk=25.626224517822266GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG os_brick.utils [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[82064c1b-f2aa-45e1-949d-abadcb0bce61]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2e5db1-51df-4da3-a3e4-5ed257711f22]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[384698f7-fdb3-492d-928d-be618897ec13]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93cff05-74da-449d-a8d7-2b45b687d32c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:45:45 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 00:45:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a0cd43-b277-471b-b13e-9f254c558616]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG os_brick.utils [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Updating existing volume attachment record: e2e56d7a-7219-4547-96bb-f79b58143b9b {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance a70d0196-f90e-47c4-be67-bf7ef4c3d8c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 1282f7f3-c81e-4a6e-bd86-42459f49674f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 1879be4c-9226-4c8c-a56c-f8e37398851b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 7f1a88ea-83a3-447b-a83d-40b2c1c908f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 4a2881e6-ee6e-4165-a6d9-35fda79c142d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 28212eec-99be-4171-97ed-7748bbb75c88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 937d7470-ec86-4972-b975-257d626329dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance b54b37bc-8c90-4c48-a943-e489e830b93b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance faeb3377-d199-472b-9ee2-f504d5ac9ac4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 92c077bc-31f0-4794-b01e-08204e4301d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 7b1dc486-c6b5-4518-8da5-6042c97cbe55 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance cc072036-25dc-48a8-b430-5a2655fb473a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Successfully created port: 9a03ed99-51c7-49e9-abbb-dc338dd795ff {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:45:45 user nova-compute[74850]: DEBUG nova.network.neutron [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Successfully created port: dff8eb7c-ea5d-459e-a836-440097829dfd {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:45:46 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:45:46 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:45:46 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 00:45:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.153s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:46 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:45:46 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Cleaning up deleted instances {{(pid=74850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 00:45:46 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] There are 0 instances to clean {{(pid=74850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 00:45:46 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:45:46 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74850) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 00:45:46 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Successfully created port: 447494fb-fc40-41f9-94d9-d1c39434a22d {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:45:46 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:45:46 user nova-compute[74850]: DEBUG nova.network.neutron [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Successfully updated port: 04f4b3e3-634c-4285-b389-785cff1205ea {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:45:46 user nova-compute[74850]: DEBUG nova.compute.manager [req-f8d6fc1e-db4e-495f-91da-ebf51be4dd3a req-5c718876-29c0-4350-b956-9913abc410c8 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-changed-04f4b3e3-634c-4285-b389-785cff1205ea {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:46 user nova-compute[74850]: DEBUG nova.compute.manager [req-f8d6fc1e-db4e-495f-91da-ebf51be4dd3a req-5c718876-29c0-4350-b956-9913abc410c8 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Refreshing instance network info cache due to event network-changed-04f4b3e3-634c-4285-b389-785cff1205ea. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:45:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f8d6fc1e-db4e-495f-91da-ebf51be4dd3a req-5c718876-29c0-4350-b956-9913abc410c8 service nova] Acquiring lock "refresh_cache-7b1dc486-c6b5-4518-8da5-6042c97cbe55" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:45:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f8d6fc1e-db4e-495f-91da-ebf51be4dd3a req-5c718876-29c0-4350-b956-9913abc410c8 service nova] Acquired lock "refresh_cache-7b1dc486-c6b5-4518-8da5-6042c97cbe55" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:45:46 user nova-compute[74850]: DEBUG nova.network.neutron [req-f8d6fc1e-db4e-495f-91da-ebf51be4dd3a req-5c718876-29c0-4350-b956-9913abc410c8 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Refreshing network info cache for port 04f4b3e3-634c-4285-b389-785cff1205ea {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:45:46 user nova-compute[74850]: DEBUG nova.network.neutron [req-f8d6fc1e-db4e-495f-91da-ebf51be4dd3a req-5c718876-29c0-4350-b956-9913abc410c8 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:45:47 user nova-compute[74850]: DEBUG nova.network.neutron [req-f8d6fc1e-db4e-495f-91da-ebf51be4dd3a req-5c718876-29c0-4350-b956-9913abc410c8 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:45:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f8d6fc1e-db4e-495f-91da-ebf51be4dd3a req-5c718876-29c0-4350-b956-9913abc410c8 service nova] Releasing lock "refresh_cache-7b1dc486-c6b5-4518-8da5-6042c97cbe55" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:45:47 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Successfully created port: 70f458ad-d5db-47a5-9ab1-b776a8fdbb98 {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:45:47 user nova-compute[74850]: DEBUG nova.compute.manager [req-4c75bab0-23cb-4dc0-ab63-7008e004a55f req-849c9f25-6ab5-403b-90fb-9b6c2696ffad service nova] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Received event network-vif-plugged-e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-4c75bab0-23cb-4dc0-ab63-7008e004a55f req-849c9f25-6ab5-403b-90fb-9b6c2696ffad service nova] Acquiring lock "faeb3377-d199-472b-9ee2-f504d5ac9ac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-4c75bab0-23cb-4dc0-ab63-7008e004a55f req-849c9f25-6ab5-403b-90fb-9b6c2696ffad service nova] Lock "faeb3377-d199-472b-9ee2-f504d5ac9ac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-4c75bab0-23cb-4dc0-ab63-7008e004a55f req-849c9f25-6ab5-403b-90fb-9b6c2696ffad service nova] Lock "faeb3377-d199-472b-9ee2-f504d5ac9ac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:47 user nova-compute[74850]: DEBUG nova.compute.manager [req-4c75bab0-23cb-4dc0-ab63-7008e004a55f req-849c9f25-6ab5-403b-90fb-9b6c2696ffad service nova] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] No waiting events found dispatching network-vif-plugged-e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:45:47 user nova-compute[74850]: WARNING nova.compute.manager [req-4c75bab0-23cb-4dc0-ab63-7008e004a55f req-849c9f25-6ab5-403b-90fb-9b6c2696ffad service nova] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Received unexpected event network-vif-plugged-e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa for instance with vm_state active and task_state None.
Nov 14 00:45:47 user nova-compute[74850]: DEBUG nova.network.neutron [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Successfully updated port: 78e098ef-09f4-4007-9e14-ebff143a4ba1 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:45:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:48 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Successfully created port: 457e3066-b6bf-4d67-9c40-d1437ef901a3 {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:45:48 user nova-compute[74850]: DEBUG nova.compute.manager [req-c80e155b-a60c-4359-bff6-bf5ad0ab3945 req-9dc25a2b-6598-46f7-8eab-0a711be7ce9b service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-changed-78e098ef-09f4-4007-9e14-ebff143a4ba1 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:48 user nova-compute[74850]: DEBUG nova.compute.manager [req-c80e155b-a60c-4359-bff6-bf5ad0ab3945 req-9dc25a2b-6598-46f7-8eab-0a711be7ce9b service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Refreshing instance network info cache due to event network-changed-78e098ef-09f4-4007-9e14-ebff143a4ba1. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:45:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c80e155b-a60c-4359-bff6-bf5ad0ab3945 req-9dc25a2b-6598-46f7-8eab-0a711be7ce9b service nova] Acquiring lock "refresh_cache-7b1dc486-c6b5-4518-8da5-6042c97cbe55" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:45:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c80e155b-a60c-4359-bff6-bf5ad0ab3945 req-9dc25a2b-6598-46f7-8eab-0a711be7ce9b service nova] Acquired lock "refresh_cache-7b1dc486-c6b5-4518-8da5-6042c97cbe55" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:45:48 user nova-compute[74850]: DEBUG nova.network.neutron [req-c80e155b-a60c-4359-bff6-bf5ad0ab3945 req-9dc25a2b-6598-46f7-8eab-0a711be7ce9b service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Refreshing network info cache for port 78e098ef-09f4-4007-9e14-ebff143a4ba1 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:45:48 user nova-compute[74850]: DEBUG nova.network.neutron [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Successfully updated port: 0bbb73c1-6eda-416d-a9c8-6592c2abbea4 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:45:48 user nova-compute[74850]: DEBUG nova.network.neutron [req-c80e155b-a60c-4359-bff6-bf5ad0ab3945 req-9dc25a2b-6598-46f7-8eab-0a711be7ce9b service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:45:48 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Successfully created port: 14239fc2-af2c-4d50-9f58-9758fe0f1221 {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:45:49 user nova-compute[74850]: DEBUG nova.network.neutron [req-c80e155b-a60c-4359-bff6-bf5ad0ab3945 req-9dc25a2b-6598-46f7-8eab-0a711be7ce9b service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:45:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c80e155b-a60c-4359-bff6-bf5ad0ab3945 req-9dc25a2b-6598-46f7-8eab-0a711be7ce9b service nova] Releasing lock "refresh_cache-7b1dc486-c6b5-4518-8da5-6042c97cbe55" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:45:49 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:45:49 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:45:49 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 00:45:49 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Rebuilding the list of instances to heal {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 00:45:49 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Skipping network cache update for instance because it is Building. {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 00:45:49 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Skipping network cache update for instance because it is Building. {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 00:45:49 user nova-compute[74850]: DEBUG nova.compute.manager [req-ef5722f3-e27b-4421-8100-c320a7d2c772 req-84ad07ac-2825-4b7b-b7dd-2a8aea8a1b2d service nova] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Received event network-vif-plugged-e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ef5722f3-e27b-4421-8100-c320a7d2c772 req-84ad07ac-2825-4b7b-b7dd-2a8aea8a1b2d service nova] Acquiring lock "faeb3377-d199-472b-9ee2-f504d5ac9ac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:45:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ef5722f3-e27b-4421-8100-c320a7d2c772 req-84ad07ac-2825-4b7b-b7dd-2a8aea8a1b2d service nova] Lock "faeb3377-d199-472b-9ee2-f504d5ac9ac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:45:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ef5722f3-e27b-4421-8100-c320a7d2c772 req-84ad07ac-2825-4b7b-b7dd-2a8aea8a1b2d service nova] Lock "faeb3377-d199-472b-9ee2-f504d5ac9ac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:45:49 user nova-compute[74850]: DEBUG nova.compute.manager [req-ef5722f3-e27b-4421-8100-c320a7d2c772 req-84ad07ac-2825-4b7b-b7dd-2a8aea8a1b2d service nova] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] No waiting events found dispatching network-vif-plugged-e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:45:49 user nova-compute[74850]: WARNING nova.compute.manager [req-ef5722f3-e27b-4421-8100-c320a7d2c772 req-84ad07ac-2825-4b7b-b7dd-2a8aea8a1b2d service nova] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Received unexpected event network-vif-plugged-e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa for instance with vm_state active and task_state None.
Nov 14 00:45:49 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Successfully updated port: 9a03ed99-51c7-49e9-abbb-dc338dd795ff {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:45:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "refresh_cache-a70d0196-f90e-47c4-be67-bf7ef4c3d8c4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:45:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquired lock "refresh_cache-a70d0196-f90e-47c4-be67-bf7ef4c3d8c4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:45:49 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Forcefully refreshing network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 00:45:49 user nova-compute[74850]: DEBUG nova.objects.instance [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lazy-loading 'info_cache' on Instance uuid a70d0196-f90e-47c4-be67-bf7ef4c3d8c4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:45:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:49 user nova-compute[74850]: DEBUG nova.network.neutron [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Successfully updated port: ab41a728-624a-46a0-9fd6-0268c0b35f55 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:45:50 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Updating instance_info_cache with network_info: [{"id": "f0de03a3-fd19-4cd1-a408-5168dcf267d7", "address": "fa:16:3e:44:d7:64", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0de03a3-fd", "ovs_interfaceid": "f0de03a3-fd19-4cd1-a408-5168dcf267d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:45:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Releasing lock "refresh_cache-a70d0196-f90e-47c4-be67-bf7ef4c3d8c4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:45:50 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Updated the network info_cache for instance {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 00:45:50 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:45:50 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:45:50 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:45:50 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:45:50 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:45:50 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:45:50 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 00:45:50 user nova-compute[74850]: DEBUG nova.network.neutron [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Successfully updated port: 091cb215-5fc9-4eb5-9aca-0751d5e41ea4 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:45:50 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Successfully updated port: 3b861886-0054-400a-b163-35945d498927 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:45:50 user nova-compute[74850]: DEBUG nova.compute.manager [req-dcb587c4-b50d-4003-9d19-4c17041e787f req-63e7e7fa-6a97-43cd-994b-ce2b86d4444f service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-changed-3b861886-0054-400a-b163-35945d498927 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:50 user nova-compute[74850]: DEBUG nova.compute.manager [req-dcb587c4-b50d-4003-9d19-4c17041e787f req-63e7e7fa-6a97-43cd-994b-ce2b86d4444f service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Refreshing instance network info cache due to event network-changed-3b861886-0054-400a-b163-35945d498927. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:45:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-dcb587c4-b50d-4003-9d19-4c17041e787f req-63e7e7fa-6a97-43cd-994b-ce2b86d4444f service nova] Acquiring lock "refresh_cache-cc072036-25dc-48a8-b430-5a2655fb473a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:45:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-dcb587c4-b50d-4003-9d19-4c17041e787f req-63e7e7fa-6a97-43cd-994b-ce2b86d4444f service nova] Acquired lock "refresh_cache-cc072036-25dc-48a8-b430-5a2655fb473a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:45:50 user nova-compute[74850]: DEBUG nova.network.neutron [req-dcb587c4-b50d-4003-9d19-4c17041e787f req-63e7e7fa-6a97-43cd-994b-ce2b86d4444f service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Refreshing network info cache for port 3b861886-0054-400a-b163-35945d498927 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:45:50 user nova-compute[74850]: DEBUG nova.network.neutron [req-dcb587c4-b50d-4003-9d19-4c17041e787f req-63e7e7fa-6a97-43cd-994b-ce2b86d4444f service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:45:50 user nova-compute[74850]: DEBUG nova.compute.manager [req-3e0af207-8709-4d14-bf99-a48f93c90f6e req-59f68f87-967d-426c-b104-f9d4e0aa3238 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-changed-0bbb73c1-6eda-416d-a9c8-6592c2abbea4 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:50 user nova-compute[74850]: DEBUG nova.compute.manager [req-3e0af207-8709-4d14-bf99-a48f93c90f6e req-59f68f87-967d-426c-b104-f9d4e0aa3238 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Refreshing instance network info cache due to event network-changed-0bbb73c1-6eda-416d-a9c8-6592c2abbea4. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:45:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3e0af207-8709-4d14-bf99-a48f93c90f6e req-59f68f87-967d-426c-b104-f9d4e0aa3238 service nova] Acquiring lock "refresh_cache-7b1dc486-c6b5-4518-8da5-6042c97cbe55" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:45:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3e0af207-8709-4d14-bf99-a48f93c90f6e req-59f68f87-967d-426c-b104-f9d4e0aa3238 service nova] Acquired lock "refresh_cache-7b1dc486-c6b5-4518-8da5-6042c97cbe55" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:45:50 user nova-compute[74850]: DEBUG nova.network.neutron [req-3e0af207-8709-4d14-bf99-a48f93c90f6e req-59f68f87-967d-426c-b104-f9d4e0aa3238 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Refreshing network info cache for port 0bbb73c1-6eda-416d-a9c8-6592c2abbea4 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:45:51 user nova-compute[74850]: DEBUG nova.network.neutron [req-3e0af207-8709-4d14-bf99-a48f93c90f6e req-59f68f87-967d-426c-b104-f9d4e0aa3238 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:45:51 user nova-compute[74850]: DEBUG nova.network.neutron [req-dcb587c4-b50d-4003-9d19-4c17041e787f req-63e7e7fa-6a97-43cd-994b-ce2b86d4444f service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:45:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-dcb587c4-b50d-4003-9d19-4c17041e787f req-63e7e7fa-6a97-43cd-994b-ce2b86d4444f service nova] Releasing lock "refresh_cache-cc072036-25dc-48a8-b430-5a2655fb473a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:45:51 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Successfully updated port: 381f68d0-96e0-404e-93e6-d166732e2df8 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:45:51 user nova-compute[74850]: DEBUG nova.compute.manager [req-817c12e6-ae1b-4458-a8d6-4f96ce70e0b6 req-e225315c-38f3-4b6d-ae42-bd431a29b3b0 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-changed-9a03ed99-51c7-49e9-abbb-dc338dd795ff {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:51 user nova-compute[74850]: DEBUG nova.compute.manager [req-817c12e6-ae1b-4458-a8d6-4f96ce70e0b6 req-e225315c-38f3-4b6d-ae42-bd431a29b3b0 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Refreshing instance network info cache due to event network-changed-9a03ed99-51c7-49e9-abbb-dc338dd795ff. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:45:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-817c12e6-ae1b-4458-a8d6-4f96ce70e0b6 req-e225315c-38f3-4b6d-ae42-bd431a29b3b0 service nova] Acquiring lock "refresh_cache-cc072036-25dc-48a8-b430-5a2655fb473a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:45:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-817c12e6-ae1b-4458-a8d6-4f96ce70e0b6 req-e225315c-38f3-4b6d-ae42-bd431a29b3b0 service nova] Acquired lock "refresh_cache-cc072036-25dc-48a8-b430-5a2655fb473a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:45:51 user nova-compute[74850]: DEBUG nova.network.neutron [req-817c12e6-ae1b-4458-a8d6-4f96ce70e0b6 req-e225315c-38f3-4b6d-ae42-bd431a29b3b0 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Refreshing network info cache for port 9a03ed99-51c7-49e9-abbb-dc338dd795ff {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:45:51 user nova-compute[74850]: DEBUG nova.network.neutron [req-817c12e6-ae1b-4458-a8d6-4f96ce70e0b6 req-e225315c-38f3-4b6d-ae42-bd431a29b3b0 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:45:51 user nova-compute[74850]: INFO nova.virt.block_device [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Booting with volume 9283b1c4-11f9-41e1-986e-7141d0774fec at /dev/vdb
Nov 14 00:45:51 user nova-compute[74850]: DEBUG nova.network.neutron [req-3e0af207-8709-4d14-bf99-a48f93c90f6e req-59f68f87-967d-426c-b104-f9d4e0aa3238 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:45:51 user nova-compute[74850]: INFO nova.virt.block_device [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Booting with volume 97af5108-d8a8-4d51-9924-995dc5855ef8 at /dev/vdb
Nov 14 00:45:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3e0af207-8709-4d14-bf99-a48f93c90f6e req-59f68f87-967d-426c-b104-f9d4e0aa3238 service nova] Releasing lock "refresh_cache-7b1dc486-c6b5-4518-8da5-6042c97cbe55" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:45:51 user nova-compute[74850]: DEBUG nova.compute.manager [req-3e0af207-8709-4d14-bf99-a48f93c90f6e req-59f68f87-967d-426c-b104-f9d4e0aa3238 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-changed-ab41a728-624a-46a0-9fd6-0268c0b35f55 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:51 user nova-compute[74850]: DEBUG nova.compute.manager [req-3e0af207-8709-4d14-bf99-a48f93c90f6e req-59f68f87-967d-426c-b104-f9d4e0aa3238 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Refreshing instance network info cache due to event network-changed-ab41a728-624a-46a0-9fd6-0268c0b35f55. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:45:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3e0af207-8709-4d14-bf99-a48f93c90f6e req-59f68f87-967d-426c-b104-f9d4e0aa3238 service nova] Acquiring lock "refresh_cache-7b1dc486-c6b5-4518-8da5-6042c97cbe55" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:45:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3e0af207-8709-4d14-bf99-a48f93c90f6e req-59f68f87-967d-426c-b104-f9d4e0aa3238 service nova] Acquired lock "refresh_cache-7b1dc486-c6b5-4518-8da5-6042c97cbe55" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:45:51 user nova-compute[74850]: DEBUG nova.network.neutron [req-3e0af207-8709-4d14-bf99-a48f93c90f6e req-59f68f87-967d-426c-b104-f9d4e0aa3238 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Refreshing network info cache for port ab41a728-624a-46a0-9fd6-0268c0b35f55 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:45:51 user nova-compute[74850]: DEBUG os_brick.utils [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:45:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:51 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[676f9db1-9996-4391-97bd-dec17bca7344]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:51 user nova-compute[74850]: DEBUG os_brick.utils [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:45:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:51 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa278d42-e31c-4f1b-9eae-70989350e2d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.032s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:51 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6981fafc-241d-43ad-946c-56f06df4ffd4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:51 user nova-compute[74850]: DEBUG nova.network.neutron [req-817c12e6-ae1b-4458-a8d6-4f96ce70e0b6 req-e225315c-38f3-4b6d-ae42-bd431a29b3b0 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:45:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.047s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:51 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd165ba-6e7c-47b1-8167-0debfe9b9764]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:51 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[de632c50-7ff8-4511-94e3-90352c106412]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.059s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[81190ebd-2450-4c7f-92cb-94b916e613d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-817c12e6-ae1b-4458-a8d6-4f96ce70e0b6 req-e225315c-38f3-4b6d-ae42-bd431a29b3b0 service nova] Releasing lock "refresh_cache-cc072036-25dc-48a8-b430-5a2655fb473a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecef8eb6-41a0-448c-9ae5-dfe59519da49]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a017e6a8-5994-4b27-baac-07a20168811f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:45:52 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 00:45:52 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa865db2-150c-49c1-b0c6-b1ff54131649]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG nova.network.neutron [req-3e0af207-8709-4d14-bf99-a48f93c90f6e req-59f68f87-967d-426c-b104-f9d4e0aa3238 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG os_brick.utils [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] <== get_connector_properties: return (256ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Updating existing volume attachment record: 41117d1d-5736-4027-a756-c9ea1dd2a043 {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:45:52 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 00:45:52 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3845d2a-2708-4f63-a99f-6a141389f687]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG os_brick.utils [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] <== get_connector_properties: return (252ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Updating existing volume attachment record: 236d0160-5535-4187-a1ae-2d77970a0dc3 {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG nova.network.neutron [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Successfully updated port: 5fdd3936-9253-49a5-9f2d-6c2fdce456ea {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG nova.network.neutron [req-3e0af207-8709-4d14-bf99-a48f93c90f6e req-59f68f87-967d-426c-b104-f9d4e0aa3238 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3e0af207-8709-4d14-bf99-a48f93c90f6e req-59f68f87-967d-426c-b104-f9d4e0aa3238 service nova] Releasing lock "refresh_cache-7b1dc486-c6b5-4518-8da5-6042c97cbe55" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG nova.compute.manager [req-3e0af207-8709-4d14-bf99-a48f93c90f6e req-59f68f87-967d-426c-b104-f9d4e0aa3238 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-changed-091cb215-5fc9-4eb5-9aca-0751d5e41ea4 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG nova.compute.manager [req-3e0af207-8709-4d14-bf99-a48f93c90f6e req-59f68f87-967d-426c-b104-f9d4e0aa3238 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Refreshing instance network info cache due to event network-changed-091cb215-5fc9-4eb5-9aca-0751d5e41ea4. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3e0af207-8709-4d14-bf99-a48f93c90f6e req-59f68f87-967d-426c-b104-f9d4e0aa3238 service nova] Acquiring lock "refresh_cache-7b1dc486-c6b5-4518-8da5-6042c97cbe55" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3e0af207-8709-4d14-bf99-a48f93c90f6e req-59f68f87-967d-426c-b104-f9d4e0aa3238 service nova] Acquired lock "refresh_cache-7b1dc486-c6b5-4518-8da5-6042c97cbe55" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG nova.network.neutron [req-3e0af207-8709-4d14-bf99-a48f93c90f6e req-59f68f87-967d-426c-b104-f9d4e0aa3238 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Refreshing network info cache for port 091cb215-5fc9-4eb5-9aca-0751d5e41ea4 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Successfully updated port: 447494fb-fc40-41f9-94d9-d1c39434a22d {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG nova.network.neutron [req-3e0af207-8709-4d14-bf99-a48f93c90f6e req-59f68f87-967d-426c-b104-f9d4e0aa3238 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG nova.compute.manager [req-abd12aba-2496-4902-9e2e-bb03d6111c12 req-c83d56dc-b151-4e63-bfdd-e27315355ee5 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-changed-381f68d0-96e0-404e-93e6-d166732e2df8 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG nova.compute.manager [req-abd12aba-2496-4902-9e2e-bb03d6111c12 req-c83d56dc-b151-4e63-bfdd-e27315355ee5 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Refreshing instance network info cache due to event network-changed-381f68d0-96e0-404e-93e6-d166732e2df8. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-abd12aba-2496-4902-9e2e-bb03d6111c12 req-c83d56dc-b151-4e63-bfdd-e27315355ee5 service nova] Acquiring lock "refresh_cache-cc072036-25dc-48a8-b430-5a2655fb473a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-abd12aba-2496-4902-9e2e-bb03d6111c12 req-c83d56dc-b151-4e63-bfdd-e27315355ee5 service nova] Acquired lock "refresh_cache-cc072036-25dc-48a8-b430-5a2655fb473a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG nova.network.neutron [req-abd12aba-2496-4902-9e2e-bb03d6111c12 req-c83d56dc-b151-4e63-bfdd-e27315355ee5 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Refreshing network info cache for port 381f68d0-96e0-404e-93e6-d166732e2df8 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:45:52 user nova-compute[74850]: DEBUG nova.network.neutron [req-abd12aba-2496-4902-9e2e-bb03d6111c12 req-c83d56dc-b151-4e63-bfdd-e27315355ee5 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:45:53 user nova-compute[74850]: DEBUG nova.network.neutron [req-abd12aba-2496-4902-9e2e-bb03d6111c12 req-c83d56dc-b151-4e63-bfdd-e27315355ee5 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:45:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-abd12aba-2496-4902-9e2e-bb03d6111c12 req-c83d56dc-b151-4e63-bfdd-e27315355ee5 service nova] Releasing lock "refresh_cache-cc072036-25dc-48a8-b430-5a2655fb473a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:45:53 user nova-compute[74850]: DEBUG nova.compute.manager [req-abd12aba-2496-4902-9e2e-bb03d6111c12 req-c83d56dc-b151-4e63-bfdd-e27315355ee5 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-changed-447494fb-fc40-41f9-94d9-d1c39434a22d {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:53 user nova-compute[74850]: DEBUG nova.compute.manager [req-abd12aba-2496-4902-9e2e-bb03d6111c12 req-c83d56dc-b151-4e63-bfdd-e27315355ee5 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Refreshing instance network info cache due to event network-changed-447494fb-fc40-41f9-94d9-d1c39434a22d. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:45:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-abd12aba-2496-4902-9e2e-bb03d6111c12 req-c83d56dc-b151-4e63-bfdd-e27315355ee5 service nova] Acquiring lock "refresh_cache-cc072036-25dc-48a8-b430-5a2655fb473a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:45:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-abd12aba-2496-4902-9e2e-bb03d6111c12 req-c83d56dc-b151-4e63-bfdd-e27315355ee5 service nova] Acquired lock "refresh_cache-cc072036-25dc-48a8-b430-5a2655fb473a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:45:53 user nova-compute[74850]: DEBUG nova.network.neutron [req-abd12aba-2496-4902-9e2e-bb03d6111c12 req-c83d56dc-b151-4e63-bfdd-e27315355ee5 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Refreshing network info cache for port 447494fb-fc40-41f9-94d9-d1c39434a22d {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:45:53 user nova-compute[74850]: DEBUG nova.compute.manager [req-5a003e28-3c26-4dc9-8d50-d4cbecb3ac0a req-f040312f-73ee-4240-9b66-8230fbe989b8 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-changed-5fdd3936-9253-49a5-9f2d-6c2fdce456ea {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:53 user nova-compute[74850]: DEBUG nova.compute.manager [req-5a003e28-3c26-4dc9-8d50-d4cbecb3ac0a req-f040312f-73ee-4240-9b66-8230fbe989b8 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Refreshing instance network info cache due to event network-changed-5fdd3936-9253-49a5-9f2d-6c2fdce456ea. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:45:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5a003e28-3c26-4dc9-8d50-d4cbecb3ac0a req-f040312f-73ee-4240-9b66-8230fbe989b8 service nova] Acquiring lock "refresh_cache-7b1dc486-c6b5-4518-8da5-6042c97cbe55" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:45:53 user nova-compute[74850]: DEBUG nova.network.neutron [req-abd12aba-2496-4902-9e2e-bb03d6111c12 req-c83d56dc-b151-4e63-bfdd-e27315355ee5 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:45:53 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Successfully updated port: 70f458ad-d5db-47a5-9ab1-b776a8fdbb98 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:45:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:53 user nova-compute[74850]: DEBUG nova.network.neutron [req-3e0af207-8709-4d14-bf99-a48f93c90f6e req-59f68f87-967d-426c-b104-f9d4e0aa3238 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:45:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3e0af207-8709-4d14-bf99-a48f93c90f6e req-59f68f87-967d-426c-b104-f9d4e0aa3238 service nova] Releasing lock "refresh_cache-7b1dc486-c6b5-4518-8da5-6042c97cbe55" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:45:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5a003e28-3c26-4dc9-8d50-d4cbecb3ac0a req-f040312f-73ee-4240-9b66-8230fbe989b8 service nova] Acquired lock "refresh_cache-7b1dc486-c6b5-4518-8da5-6042c97cbe55" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:45:53 user nova-compute[74850]: DEBUG nova.network.neutron [req-5a003e28-3c26-4dc9-8d50-d4cbecb3ac0a req-f040312f-73ee-4240-9b66-8230fbe989b8 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Refreshing network info cache for port 5fdd3936-9253-49a5-9f2d-6c2fdce456ea {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:45:53 user nova-compute[74850]: DEBUG nova.network.neutron [req-abd12aba-2496-4902-9e2e-bb03d6111c12 req-c83d56dc-b151-4e63-bfdd-e27315355ee5 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:45:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-abd12aba-2496-4902-9e2e-bb03d6111c12 req-c83d56dc-b151-4e63-bfdd-e27315355ee5 service nova] Releasing lock "refresh_cache-cc072036-25dc-48a8-b430-5a2655fb473a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:45:53 user nova-compute[74850]: DEBUG nova.network.neutron [req-5a003e28-3c26-4dc9-8d50-d4cbecb3ac0a req-f040312f-73ee-4240-9b66-8230fbe989b8 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:45:53 user nova-compute[74850]: DEBUG nova.network.neutron [req-5a003e28-3c26-4dc9-8d50-d4cbecb3ac0a req-f040312f-73ee-4240-9b66-8230fbe989b8 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:45:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5a003e28-3c26-4dc9-8d50-d4cbecb3ac0a req-f040312f-73ee-4240-9b66-8230fbe989b8 service nova] Releasing lock "refresh_cache-7b1dc486-c6b5-4518-8da5-6042c97cbe55" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:45:53 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Successfully updated port: 457e3066-b6bf-4d67-9c40-d1437ef901a3 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:45:53 user nova-compute[74850]: DEBUG nova.network.neutron [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Successfully updated port: dff8eb7c-ea5d-459e-a836-440097829dfd {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:45:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Acquiring lock "refresh_cache-7b1dc486-c6b5-4518-8da5-6042c97cbe55" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:45:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Acquired lock "refresh_cache-7b1dc486-c6b5-4518-8da5-6042c97cbe55" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:45:53 user nova-compute[74850]: DEBUG nova.network.neutron [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:45:54 user nova-compute[74850]: DEBUG nova.network.neutron [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:45:54 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Successfully updated port: 14239fc2-af2c-4d50-9f58-9758fe0f1221 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:45:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Acquiring lock "refresh_cache-cc072036-25dc-48a8-b430-5a2655fb473a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:45:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Acquired lock "refresh_cache-cc072036-25dc-48a8-b430-5a2655fb473a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:45:54 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:45:54 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:54 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:45:54 user nova-compute[74850]: DEBUG nova.compute.manager [req-3c87c017-d576-404a-8d9f-d2cc601260f8 req-11f45d6d-dc56-4152-86a9-6cbcc34c9596 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-changed-70f458ad-d5db-47a5-9ab1-b776a8fdbb98 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:54 user nova-compute[74850]: DEBUG nova.compute.manager [req-3c87c017-d576-404a-8d9f-d2cc601260f8 req-11f45d6d-dc56-4152-86a9-6cbcc34c9596 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Refreshing instance network info cache due to event network-changed-70f458ad-d5db-47a5-9ab1-b776a8fdbb98. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:45:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3c87c017-d576-404a-8d9f-d2cc601260f8 req-11f45d6d-dc56-4152-86a9-6cbcc34c9596 service nova] Acquiring lock "refresh_cache-cc072036-25dc-48a8-b430-5a2655fb473a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:45:55 user nova-compute[74850]: DEBUG nova.compute.manager [req-8657e99b-d3c3-4b01-93a6-c09392d38c1a req-8ac6a280-0e65-4dea-b76d-db788500409a service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-changed-dff8eb7c-ea5d-459e-a836-440097829dfd {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:55 user nova-compute[74850]: DEBUG nova.compute.manager [req-8657e99b-d3c3-4b01-93a6-c09392d38c1a req-8ac6a280-0e65-4dea-b76d-db788500409a service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Refreshing instance network info cache due to event network-changed-dff8eb7c-ea5d-459e-a836-440097829dfd. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:45:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-8657e99b-d3c3-4b01-93a6-c09392d38c1a req-8ac6a280-0e65-4dea-b76d-db788500409a service nova] Acquiring lock "refresh_cache-7b1dc486-c6b5-4518-8da5-6042c97cbe55" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:45:56 user nova-compute[74850]: DEBUG nova.network.neutron [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Updating instance_info_cache with network_info: [{"id": "04f4b3e3-634c-4285-b389-785cff1205ea", "address": "fa:16:3e:c0:42:3b", "network": {"id": "7b7555f1-01f5-4ec4-a537-8dba31d7bcc0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1180089476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f4b3e3-63", "ovs_interfaceid": "04f4b3e3-634c-4285-b389-785cff1205ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78e098ef-09f4-4007-9e14-ebff143a4ba1", "address": "fa:16:3e:92:05:67", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78e098ef-09", "ovs_interfaceid": "78e098ef-09f4-4007-9e14-ebff143a4ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0bbb73c1-6eda-416d-a9c8-6592c2abbea4", "address": "fa:16:3e:e8:f0:5f", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbb73c1-6e", "ovs_interfaceid": "0bbb73c1-6eda-416d-a9c8-6592c2abbea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ab41a728-624a-46a0-9fd6-0268c0b35f55", "address": "fa:16:3e:f1:76:22", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab41a728-62", "ovs_interfaceid": "ab41a728-624a-46a0-9fd6-0268c0b35f55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "091cb215-5fc9-4eb5-9aca-0751d5e41ea4", "address": "fa:16:3e:1f:ed:c6", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091cb215-5f", "ovs_interfaceid": "091cb215-5fc9-4eb5-9aca-0751d5e41ea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5fdd3936-9253-49a5-9f2d-6c2fdce456ea", "address": "fa:16:3e:e3:e9:a7", "network": {"id": "947450c5-5cd3-4c59-89ef-c5ac64194c29", "bridge": "br-int", "label": "tempest-device-tagging-net2-516735970", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdd3936-92", "ovs_interfaceid": "5fdd3936-9253-49a5-9f2d-6c2fdce456ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dff8eb7c-ea5d-459e-a836-440097829dfd", "address": "fa:16:3e:61:a0:19", "network": {"id": "947450c5-5cd3-4c59-89ef-c5ac64194c29", "bridge": "br-int", "label": "tempest-device-tagging-net2-516735970", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff8eb7c-ea", "ovs_interfaceid": "dff8eb7c-ea5d-459e-a836-440097829dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:45:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Releasing lock "refresh_cache-7b1dc486-c6b5-4518-8da5-6042c97cbe55" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:45:56 user nova-compute[74850]: DEBUG nova.compute.manager [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Instance network_info: |[{"id": "04f4b3e3-634c-4285-b389-785cff1205ea", "address": "fa:16:3e:c0:42:3b", "network": {"id": "7b7555f1-01f5-4ec4-a537-8dba31d7bcc0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1180089476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f4b3e3-63", "ovs_interfaceid": "04f4b3e3-634c-4285-b389-785cff1205ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78e098ef-09f4-4007-9e14-ebff143a4ba1", "address": "fa:16:3e:92:05:67", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78e098ef-09", "ovs_interfaceid": "78e098ef-09f4-4007-9e14-ebff143a4ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0bbb73c1-6eda-416d-a9c8-6592c2abbea4", "address": "fa:16:3e:e8:f0:5f", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbb73c1-6e", "ovs_interfaceid": "0bbb73c1-6eda-416d-a9c8-6592c2abbea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ab41a728-624a-46a0-9fd6-0268c0b35f55", "address": "fa:16:3e:f1:76:22", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab41a728-62", "ovs_interfaceid": "ab41a728-624a-46a0-9fd6-0268c0b35f55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "091cb215-5fc9-4eb5-9aca-0751d5e41ea4", "address": "fa:16:3e:1f:ed:c6", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091cb215-5f", "ovs_interfaceid": "091cb215-5fc9-4eb5-9aca-0751d5e41ea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5fdd3936-9253-49a5-9f2d-6c2fdce456ea", "address": "fa:16:3e:e3:e9:a7", "network": {"id": "947450c5-5cd3-4c59-89ef-c5ac64194c29", "bridge": "br-int", "label": "tempest-device-tagging-net2-516735970", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdd3936-92", "ovs_interfaceid": "5fdd3936-9253-49a5-9f2d-6c2fdce456ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dff8eb7c-ea5d-459e-a836-440097829dfd", "address": "fa:16:3e:61:a0:19", "network": {"id": "947450c5-5cd3-4c59-89ef-c5ac64194c29", "bridge": "br-int", "label": "tempest-device-tagging-net2-516735970", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff8eb7c-ea", "ovs_interfaceid": "dff8eb7c-ea5d-459e-a836-440097829dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 00:45:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-8657e99b-d3c3-4b01-93a6-c09392d38c1a req-8ac6a280-0e65-4dea-b76d-db788500409a service nova] Acquired lock "refresh_cache-7b1dc486-c6b5-4518-8da5-6042c97cbe55" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:45:56 user nova-compute[74850]: DEBUG nova.network.neutron [req-8657e99b-d3c3-4b01-93a6-c09392d38c1a req-8ac6a280-0e65-4dea-b76d-db788500409a service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Refreshing network info cache for port dff8eb7c-ea5d-459e-a836-440097829dfd {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:45:56 user nova-compute[74850]: DEBUG nova.network.neutron [req-8657e99b-d3c3-4b01-93a6-c09392d38c1a req-8ac6a280-0e65-4dea-b76d-db788500409a service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Updated VIF entry in instance network info cache for port dff8eb7c-ea5d-459e-a836-440097829dfd. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:45:56 user nova-compute[74850]: DEBUG nova.network.neutron [req-8657e99b-d3c3-4b01-93a6-c09392d38c1a req-8ac6a280-0e65-4dea-b76d-db788500409a service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Updating instance_info_cache with network_info: [{"id": "04f4b3e3-634c-4285-b389-785cff1205ea", "address": "fa:16:3e:c0:42:3b", "network": {"id": "7b7555f1-01f5-4ec4-a537-8dba31d7bcc0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1180089476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f4b3e3-63", "ovs_interfaceid": "04f4b3e3-634c-4285-b389-785cff1205ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78e098ef-09f4-4007-9e14-ebff143a4ba1", "address": "fa:16:3e:92:05:67", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78e098ef-09", "ovs_interfaceid": "78e098ef-09f4-4007-9e14-ebff143a4ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0bbb73c1-6eda-416d-a9c8-6592c2abbea4", "address": "fa:16:3e:e8:f0:5f", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbb73c1-6e", "ovs_interfaceid": "0bbb73c1-6eda-416d-a9c8-6592c2abbea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ab41a728-624a-46a0-9fd6-0268c0b35f55", "address": "fa:16:3e:f1:76:22", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab41a728-62", "ovs_interfaceid": "ab41a728-624a-46a0-9fd6-0268c0b35f55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "091cb215-5fc9-4eb5-9aca-0751d5e41ea4", "address": "fa:16:3e:1f:ed:c6", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091cb215-5f", "ovs_interfaceid": "091cb215-5fc9-4eb5-9aca-0751d5e41ea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5fdd3936-9253-49a5-9f2d-6c2fdce456ea", "address": "fa:16:3e:e3:e9:a7", "network": {"id": "947450c5-5cd3-4c59-89ef-c5ac64194c29", "bridge": "br-int", "label": "tempest-device-tagging-net2-516735970", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdd3936-92", "ovs_interfaceid": "5fdd3936-9253-49a5-9f2d-6c2fdce456ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dff8eb7c-ea5d-459e-a836-440097829dfd", "address": "fa:16:3e:61:a0:19", "network": {"id": "947450c5-5cd3-4c59-89ef-c5ac64194c29", "bridge": "br-int", "label": "tempest-device-tagging-net2-516735970", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff8eb7c-ea", "ovs_interfaceid": "dff8eb7c-ea5d-459e-a836-440097829dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:45:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-8657e99b-d3c3-4b01-93a6-c09392d38c1a req-8ac6a280-0e65-4dea-b76d-db788500409a service nova] Releasing lock "refresh_cache-7b1dc486-c6b5-4518-8da5-6042c97cbe55" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:45:56 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Updating instance_info_cache with network_info: [{"id": "9a03ed99-51c7-49e9-abbb-dc338dd795ff", "address": "fa:16:3e:3b:53:d5", "network": {"id": "9ebba924-fce1-4de9-9859-4be03c6c5bd6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-873499233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a03ed99-51", "ovs_interfaceid": "9a03ed99-51c7-49e9-abbb-dc338dd795ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3b861886-0054-400a-b163-35945d498927", "address": "fa:16:3e:19:40:aa", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b861886-00", "ovs_interfaceid": "3b861886-0054-400a-b163-35945d498927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "381f68d0-96e0-404e-93e6-d166732e2df8", "address": "fa:16:3e:41:e5:08", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap381f68d0-96", "ovs_interfaceid": "381f68d0-96e0-404e-93e6-d166732e2df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "447494fb-fc40-41f9-94d9-d1c39434a22d", "address": "fa:16:3e:87:3d:45", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap447494fb-fc", "ovs_interfaceid": "447494fb-fc40-41f9-94d9-d1c39434a22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "70f458ad-d5db-47a5-9ab1-b776a8fdbb98", "address": "fa:16:3e:96:01:0a", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f458ad-d5", "ovs_interfaceid": "70f458ad-d5db-47a5-9ab1-b776a8fdbb98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "457e3066-b6bf-4d67-9c40-d1437ef901a3", "address": "fa:16:3e:dd:36:d4", "network": {"id": "b5892a30-40d5-4832-bb6b-b8a7f20106b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-725774050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457e3066-b6", "ovs_interfaceid": "457e3066-b6bf-4d67-9c40-d1437ef901a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14239fc2-af2c-4d50-9f58-9758fe0f1221", "address": "fa:16:3e:66:d7:47", "network": {"id": "b5892a30-40d5-4832-bb6b-b8a7f20106b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-725774050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14239fc2-af", "ovs_interfaceid": "14239fc2-af2c-4d50-9f58-9758fe0f1221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:45:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Releasing lock "refresh_cache-cc072036-25dc-48a8-b430-5a2655fb473a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:45:56 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Instance network_info: |[{"id": "9a03ed99-51c7-49e9-abbb-dc338dd795ff", "address": "fa:16:3e:3b:53:d5", "network": {"id": "9ebba924-fce1-4de9-9859-4be03c6c5bd6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-873499233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a03ed99-51", "ovs_interfaceid": "9a03ed99-51c7-49e9-abbb-dc338dd795ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3b861886-0054-400a-b163-35945d498927", "address": "fa:16:3e:19:40:aa", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b861886-00", "ovs_interfaceid": "3b861886-0054-400a-b163-35945d498927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "381f68d0-96e0-404e-93e6-d166732e2df8", "address": "fa:16:3e:41:e5:08", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap381f68d0-96", "ovs_interfaceid": "381f68d0-96e0-404e-93e6-d166732e2df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "447494fb-fc40-41f9-94d9-d1c39434a22d", "address": "fa:16:3e:87:3d:45", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap447494fb-fc", "ovs_interfaceid": "447494fb-fc40-41f9-94d9-d1c39434a22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "70f458ad-d5db-47a5-9ab1-b776a8fdbb98", "address": "fa:16:3e:96:01:0a", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f458ad-d5", "ovs_interfaceid": "70f458ad-d5db-47a5-9ab1-b776a8fdbb98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "457e3066-b6bf-4d67-9c40-d1437ef901a3", "address": "fa:16:3e:dd:36:d4", "network": {"id": "b5892a30-40d5-4832-bb6b-b8a7f20106b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-725774050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457e3066-b6", "ovs_interfaceid": "457e3066-b6bf-4d67-9c40-d1437ef901a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14239fc2-af2c-4d50-9f58-9758fe0f1221", "address": "fa:16:3e:66:d7:47", "network": {"id": "b5892a30-40d5-4832-bb6b-b8a7f20106b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-725774050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14239fc2-af", "ovs_interfaceid": "14239fc2-af2c-4d50-9f58-9758fe0f1221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 00:45:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3c87c017-d576-404a-8d9f-d2cc601260f8 req-11f45d6d-dc56-4152-86a9-6cbcc34c9596 service nova] Acquired lock "refresh_cache-cc072036-25dc-48a8-b430-5a2655fb473a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:45:56 user nova-compute[74850]: DEBUG nova.network.neutron [req-3c87c017-d576-404a-8d9f-d2cc601260f8 req-11f45d6d-dc56-4152-86a9-6cbcc34c9596 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Refreshing network info cache for port 70f458ad-d5db-47a5-9ab1-b776a8fdbb98 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:45:57 user nova-compute[74850]: INFO nova.virt.block_device [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Booting with volume e372017c-0803-4c15-98aa-3a64b9277732 at /dev/vdc
Nov 14 00:45:57 user nova-compute[74850]: DEBUG os_brick.utils [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[497c73bf-2226-4808-9a20-258fab7b1e07]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f24f89-3ff2-4d5c-af53-f7feb8a1c411]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5136ec86-dc48-4a20-9ef6-97f4a2200b45]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[de48e973-2e44-4dbb-8920-9fd65c329553]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:45:57 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 00:45:57 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[70545aff-b2bf-400a-a5ba-9c0ec3eb8d75]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG os_brick.utils [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Updating existing volume attachment record: f886138b-88a8-419a-8ba8-00b10a14f3d1 {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG nova.network.neutron [req-3c87c017-d576-404a-8d9f-d2cc601260f8 req-11f45d6d-dc56-4152-86a9-6cbcc34c9596 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Updated VIF entry in instance network info cache for port 70f458ad-d5db-47a5-9ab1-b776a8fdbb98. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG nova.network.neutron [req-3c87c017-d576-404a-8d9f-d2cc601260f8 req-11f45d6d-dc56-4152-86a9-6cbcc34c9596 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Updating instance_info_cache with network_info: [{"id": "9a03ed99-51c7-49e9-abbb-dc338dd795ff", "address": "fa:16:3e:3b:53:d5", "network": {"id": "9ebba924-fce1-4de9-9859-4be03c6c5bd6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-873499233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a03ed99-51", "ovs_interfaceid": "9a03ed99-51c7-49e9-abbb-dc338dd795ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3b861886-0054-400a-b163-35945d498927", "address": "fa:16:3e:19:40:aa", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b861886-00", "ovs_interfaceid": "3b861886-0054-400a-b163-35945d498927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "381f68d0-96e0-404e-93e6-d166732e2df8", "address": "fa:16:3e:41:e5:08", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap381f68d0-96", "ovs_interfaceid": "381f68d0-96e0-404e-93e6-d166732e2df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "447494fb-fc40-41f9-94d9-d1c39434a22d", "address": "fa:16:3e:87:3d:45", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap447494fb-fc", "ovs_interfaceid": "447494fb-fc40-41f9-94d9-d1c39434a22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "70f458ad-d5db-47a5-9ab1-b776a8fdbb98", "address": "fa:16:3e:96:01:0a", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f458ad-d5", "ovs_interfaceid": "70f458ad-d5db-47a5-9ab1-b776a8fdbb98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "457e3066-b6bf-4d67-9c40-d1437ef901a3", "address": "fa:16:3e:dd:36:d4", "network": {"id": "b5892a30-40d5-4832-bb6b-b8a7f20106b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-725774050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457e3066-b6", "ovs_interfaceid": "457e3066-b6bf-4d67-9c40-d1437ef901a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14239fc2-af2c-4d50-9f58-9758fe0f1221", "address": "fa:16:3e:66:d7:47", "network": {"id": "b5892a30-40d5-4832-bb6b-b8a7f20106b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-725774050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14239fc2-af", "ovs_interfaceid": "14239fc2-af2c-4d50-9f58-9758fe0f1221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3c87c017-d576-404a-8d9f-d2cc601260f8 req-11f45d6d-dc56-4152-86a9-6cbcc34c9596 service nova] Releasing lock "refresh_cache-cc072036-25dc-48a8-b430-5a2655fb473a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG nova.compute.manager [req-3c87c017-d576-404a-8d9f-d2cc601260f8 req-11f45d6d-dc56-4152-86a9-6cbcc34c9596 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-changed-457e3066-b6bf-4d67-9c40-d1437ef901a3 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG nova.compute.manager [req-3c87c017-d576-404a-8d9f-d2cc601260f8 req-11f45d6d-dc56-4152-86a9-6cbcc34c9596 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Refreshing instance network info cache due to event network-changed-457e3066-b6bf-4d67-9c40-d1437ef901a3. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3c87c017-d576-404a-8d9f-d2cc601260f8 req-11f45d6d-dc56-4152-86a9-6cbcc34c9596 service nova] Acquiring lock "refresh_cache-cc072036-25dc-48a8-b430-5a2655fb473a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3c87c017-d576-404a-8d9f-d2cc601260f8 req-11f45d6d-dc56-4152-86a9-6cbcc34c9596 service nova] Acquired lock "refresh_cache-cc072036-25dc-48a8-b430-5a2655fb473a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG nova.network.neutron [req-3c87c017-d576-404a-8d9f-d2cc601260f8 req-11f45d6d-dc56-4152-86a9-6cbcc34c9596 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Refreshing network info cache for port 457e3066-b6bf-4d67-9c40-d1437ef901a3 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:45:57 user nova-compute[74850]: INFO nova.virt.block_device [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Booting with volume 12497dec-be59-409e-8653-a094b2ef1c83 at /dev/vdc
Nov 14 00:45:57 user nova-compute[74850]: DEBUG os_brick.utils [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[862cfe14-2012-476b-a1c9-ffd84134bf17]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[63416619-fcd5-49a4-a180-6a45f022c069]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b30655e-d0e8-43a8-95d4-6286b85daa95]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bae8393-4b70-460a-8c51-63bbf6f8d374]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:45:57 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 00:45:57 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f726cd-8ba2-4091-b8a1-b3a775ecc69f]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG os_brick.utils [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Updating existing volume attachment record: 61a65cc6-7ac4-4930-9ee9-d0e2a20886e5 {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG nova.network.neutron [req-3c87c017-d576-404a-8d9f-d2cc601260f8 req-11f45d6d-dc56-4152-86a9-6cbcc34c9596 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Updated VIF entry in instance network info cache for port 457e3066-b6bf-4d67-9c40-d1437ef901a3. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG nova.network.neutron [req-3c87c017-d576-404a-8d9f-d2cc601260f8 req-11f45d6d-dc56-4152-86a9-6cbcc34c9596 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Updating instance_info_cache with network_info: [{"id": "9a03ed99-51c7-49e9-abbb-dc338dd795ff", "address": "fa:16:3e:3b:53:d5", "network": {"id": "9ebba924-fce1-4de9-9859-4be03c6c5bd6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-873499233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a03ed99-51", "ovs_interfaceid": "9a03ed99-51c7-49e9-abbb-dc338dd795ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3b861886-0054-400a-b163-35945d498927", "address": "fa:16:3e:19:40:aa", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b861886-00", "ovs_interfaceid": "3b861886-0054-400a-b163-35945d498927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "381f68d0-96e0-404e-93e6-d166732e2df8", "address": "fa:16:3e:41:e5:08", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap381f68d0-96", "ovs_interfaceid": "381f68d0-96e0-404e-93e6-d166732e2df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "447494fb-fc40-41f9-94d9-d1c39434a22d", "address": "fa:16:3e:87:3d:45", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap447494fb-fc", "ovs_interfaceid": "447494fb-fc40-41f9-94d9-d1c39434a22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "70f458ad-d5db-47a5-9ab1-b776a8fdbb98", "address": "fa:16:3e:96:01:0a", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f458ad-d5", "ovs_interfaceid": "70f458ad-d5db-47a5-9ab1-b776a8fdbb98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "457e3066-b6bf-4d67-9c40-d1437ef901a3", "address": "fa:16:3e:dd:36:d4", "network": {"id": "b5892a30-40d5-4832-bb6b-b8a7f20106b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-725774050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457e3066-b6", "ovs_interfaceid": "457e3066-b6bf-4d67-9c40-d1437ef901a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14239fc2-af2c-4d50-9f58-9758fe0f1221", "address": "fa:16:3e:66:d7:47", "network": {"id": "b5892a30-40d5-4832-bb6b-b8a7f20106b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-725774050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14239fc2-af", "ovs_interfaceid": "14239fc2-af2c-4d50-9f58-9758fe0f1221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3c87c017-d576-404a-8d9f-d2cc601260f8 req-11f45d6d-dc56-4152-86a9-6cbcc34c9596 service nova] Releasing lock "refresh_cache-cc072036-25dc-48a8-b430-5a2655fb473a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG nova.compute.manager [req-3c87c017-d576-404a-8d9f-d2cc601260f8 req-11f45d6d-dc56-4152-86a9-6cbcc34c9596 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-changed-14239fc2-af2c-4d50-9f58-9758fe0f1221 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG nova.compute.manager [req-3c87c017-d576-404a-8d9f-d2cc601260f8 req-11f45d6d-dc56-4152-86a9-6cbcc34c9596 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Refreshing instance network info cache due to event network-changed-14239fc2-af2c-4d50-9f58-9758fe0f1221. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3c87c017-d576-404a-8d9f-d2cc601260f8 req-11f45d6d-dc56-4152-86a9-6cbcc34c9596 service nova] Acquiring lock "refresh_cache-cc072036-25dc-48a8-b430-5a2655fb473a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3c87c017-d576-404a-8d9f-d2cc601260f8 req-11f45d6d-dc56-4152-86a9-6cbcc34c9596 service nova] Acquired lock "refresh_cache-cc072036-25dc-48a8-b430-5a2655fb473a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:45:57 user nova-compute[74850]: DEBUG nova.network.neutron [req-3c87c017-d576-404a-8d9f-d2cc601260f8 req-11f45d6d-dc56-4152-86a9-6cbcc34c9596 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Refreshing network info cache for port 14239fc2-af2c-4d50-9f58-9758fe0f1221 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:45:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:45:58 user nova-compute[74850]: DEBUG nova.network.neutron [req-3c87c017-d576-404a-8d9f-d2cc601260f8 req-11f45d6d-dc56-4152-86a9-6cbcc34c9596 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Updated VIF entry in instance network info cache for port 14239fc2-af2c-4d50-9f58-9758fe0f1221. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:45:58 user nova-compute[74850]: DEBUG nova.network.neutron [req-3c87c017-d576-404a-8d9f-d2cc601260f8 req-11f45d6d-dc56-4152-86a9-6cbcc34c9596 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Updating instance_info_cache with network_info: [{"id": "9a03ed99-51c7-49e9-abbb-dc338dd795ff", "address": "fa:16:3e:3b:53:d5", "network": {"id": "9ebba924-fce1-4de9-9859-4be03c6c5bd6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-873499233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a03ed99-51", "ovs_interfaceid": "9a03ed99-51c7-49e9-abbb-dc338dd795ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3b861886-0054-400a-b163-35945d498927", "address": "fa:16:3e:19:40:aa", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b861886-00", "ovs_interfaceid": "3b861886-0054-400a-b163-35945d498927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "381f68d0-96e0-404e-93e6-d166732e2df8", "address": "fa:16:3e:41:e5:08", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap381f68d0-96", "ovs_interfaceid": "381f68d0-96e0-404e-93e6-d166732e2df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "447494fb-fc40-41f9-94d9-d1c39434a22d", "address": "fa:16:3e:87:3d:45", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap447494fb-fc", "ovs_interfaceid": "447494fb-fc40-41f9-94d9-d1c39434a22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "70f458ad-d5db-47a5-9ab1-b776a8fdbb98", "address": "fa:16:3e:96:01:0a", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f458ad-d5", "ovs_interfaceid": "70f458ad-d5db-47a5-9ab1-b776a8fdbb98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "457e3066-b6bf-4d67-9c40-d1437ef901a3", "address": "fa:16:3e:dd:36:d4", "network": {"id": "b5892a30-40d5-4832-bb6b-b8a7f20106b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-725774050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457e3066-b6", "ovs_interfaceid": "457e3066-b6bf-4d67-9c40-d1437ef901a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14239fc2-af2c-4d50-9f58-9758fe0f1221", "address": "fa:16:3e:66:d7:47", "network": {"id": "b5892a30-40d5-4832-bb6b-b8a7f20106b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-725774050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14239fc2-af", "ovs_interfaceid": "14239fc2-af2c-4d50-9f58-9758fe0f1221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:45:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3c87c017-d576-404a-8d9f-d2cc601260f8 req-11f45d6d-dc56-4152-86a9-6cbcc34c9596 service nova] Releasing lock "refresh_cache-cc072036-25dc-48a8-b430-5a2655fb473a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:45:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 00:46:02 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Creating image(s)
Nov 14 00:46:02 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Did not create local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Ensure instance console log exists: /opt/stack/data/nova/instances/cc072036-25dc-48a8-b430-5a2655fb473a/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Start _get_guest_xml network_info=[{"id": "9a03ed99-51c7-49e9-abbb-dc338dd795ff", "address": "fa:16:3e:3b:53:d5", "network": {"id": "9ebba924-fce1-4de9-9859-4be03c6c5bd6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-873499233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a03ed99-51", "ovs_interfaceid": "9a03ed99-51c7-49e9-abbb-dc338dd795ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3b861886-0054-400a-b163-35945d498927", "address": "fa:16:3e:19:40:aa", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b861886-00", "ovs_interfaceid": "3b861886-0054-400a-b163-35945d498927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "381f68d0-96e0-404e-93e6-d166732e2df8", "address": "fa:16:3e:41:e5:08", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap381f68d0-96", "ovs_interfaceid": "381f68d0-96e0-404e-93e6-d166732e2df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "447494fb-fc40-41f9-94d9-d1c39434a22d", "address": "fa:16:3e:87:3d:45", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap447494fb-fc", "ovs_interfaceid": "447494fb-fc40-41f9-94d9-d1c39434a22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "70f458ad-d5db-47a5-9ab1-b776a8fdbb98", "address": "fa:16:3e:96:01:0a", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f458ad-d5", "ovs_interfaceid": "70f458ad-d5db-47a5-9ab1-b776a8fdbb98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "457e3066-b6bf-4d67-9c40-d1437ef901a3", "address": "fa:16:3e:dd:36:d4", "network": {"id": "b5892a30-40d5-4832-bb6b-b8a7f20106b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-725774050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457e3066-b6", "ovs_interfaceid": "457e3066-b6bf-4d67-9c40-d1437ef901a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14239fc2-af2c-4d50-9f58-9758fe0f1221", "address": "fa:16:3e:66:d7:47", "network": {"id": "b5892a30-40d5-4832-bb6b-b8a7f20106b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-725774050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14239fc2-af", "ovs_interfaceid": "14239fc2-af2c-4d50-9f58-9758fe0f1221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e2e56d7a-7219-4547-96bb-f79b58143b9b', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yXAhsIuZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cc072036-25dc-48a8-b430-5a2655fb473a', 'attached_at': '', 'detached_at': '', 'volume_id': '0445ff3f-e6a1-42c9-8615-6a1dedd73f9c', 'serial': '0445ff3f-e6a1-42c9-8615-6a1dedd73f9c'}, 'volume_type': None}, {'attachment_id': '236d0160-5535-4187-a1ae-2d77970a0dc3', 'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lIdOTxVJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cc072036-25dc-48a8-b430-5a2655fb473a', 'attached_at': '', 'detached_at': '', 'volume_id': '97af5108-d8a8-4d51-9924-995dc5855ef8', 'serial': '97af5108-d8a8-4d51-9924-995dc5855ef8'}, 'volume_type': None}, {'attachment_id': 'f886138b-88a8-419a-8ba8-00b10a14f3d1', 'guest_format': None, 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPwzaCbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cc072036-25dc-48a8-b430-5a2655fb473a', 'attached_at': '', 'detached_at': '', 'volume_id': 'e372017c-0803-4c15-98aa-3a64b9277732', 'serial': 'e372017c-0803-4c15-98aa-3a64b9277732'}, 'volume_type': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:46:02 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:46:02 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:46:02 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yXAhsIuZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:46:02 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:46:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:46:02 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:46:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:46:02 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 00:46:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c -p 172.16.0.220:3260" returned: 21 in 0.034s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b425314-6477-4a7a-ba40-51e9538b8873]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 00:46:02 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce433b9b-bc2d-471f-a782-1e2655e667a5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c] added
Nov 14 00:46:02 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f752f5-c90d-4c54-8df2-b1eafb6c5b42]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d7b740-fb7e-481e-bb5b-6e0bc867883e]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yXAhsIuZ {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yXAhsIuZ" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c339e865-2363-4a8d-856a-c9e001bf5952]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yXAhsIuZ'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3123a1f-695b-401c-8de3-a83ba83c9ddf]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[218efb0f-83b9-498f-9d29-10c4490fa996]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:46:02 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:46:02 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a7d771-40f6-486b-9b71-fa0e4dc020e2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c, portal: 172.16.0.220,3260]
Nov 14 00:46:02 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c, portal: 172.16.0.220,3260] successful.
Nov 14 00:46:02 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc39959-0f4f-4167-86ec-3e86184f7c7c]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d921cce-2ef6-47fc-9743-69a6ad43e632]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:46:02 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:46:02 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:46:02 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:46:02 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b5b4f3-97bf-4d11-b673-34ca8605d2e2]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:46:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yXAhsIuZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG nova.compute.manager [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 00:46:03 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Creating image(s)
Nov 14 00:46:03 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Did not create local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Ensure instance console log exists: /opt/stack/data/nova/instances/7b1dc486-c6b5-4518-8da5-6042c97cbe55/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Start _get_guest_xml network_info=[{"id": "04f4b3e3-634c-4285-b389-785cff1205ea", "address": "fa:16:3e:c0:42:3b", "network": {"id": "7b7555f1-01f5-4ec4-a537-8dba31d7bcc0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1180089476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f4b3e3-63", "ovs_interfaceid": "04f4b3e3-634c-4285-b389-785cff1205ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78e098ef-09f4-4007-9e14-ebff143a4ba1", "address": "fa:16:3e:92:05:67", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78e098ef-09", "ovs_interfaceid": "78e098ef-09f4-4007-9e14-ebff143a4ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0bbb73c1-6eda-416d-a9c8-6592c2abbea4", "address": "fa:16:3e:e8:f0:5f", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbb73c1-6e", "ovs_interfaceid": "0bbb73c1-6eda-416d-a9c8-6592c2abbea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ab41a728-624a-46a0-9fd6-0268c0b35f55", "address": "fa:16:3e:f1:76:22", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab41a728-62", "ovs_interfaceid": "ab41a728-624a-46a0-9fd6-0268c0b35f55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "091cb215-5fc9-4eb5-9aca-0751d5e41ea4", "address": "fa:16:3e:1f:ed:c6", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091cb215-5f", "ovs_interfaceid": "091cb215-5fc9-4eb5-9aca-0751d5e41ea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5fdd3936-9253-49a5-9f2d-6c2fdce456ea", "address": "fa:16:3e:e3:e9:a7", "network": {"id": "947450c5-5cd3-4c59-89ef-c5ac64194c29", "bridge": "br-int", "label": "tempest-device-tagging-net2-516735970", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdd3936-92", "ovs_interfaceid": "5fdd3936-9253-49a5-9f2d-6c2fdce456ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dff8eb7c-ea5d-459e-a836-440097829dfd", "address": "fa:16:3e:61:a0:19", "network": {"id": "947450c5-5cd3-4c59-89ef-c5ac64194c29", "bridge": "br-int", "label": "tempest-device-tagging-net2-516735970", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff8eb7c-ea", "ovs_interfaceid": "dff8eb7c-ea5d-459e-a836-440097829dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6a5c685d-201e-49bb-a3fe-ee9894af63f2', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDxXVrwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7b1dc486-c6b5-4518-8da5-6042c97cbe55', 'attached_at': '', 'detached_at': '', 'volume_id': '866aee5f-8ea9-4a58-a6ee-1a4aee92f606', 'serial': '866aee5f-8ea9-4a58-a6ee-1a4aee92f606'}, 'volume_type': None}, {'attachment_id': '41117d1d-5736-4027-a756-c9ea1dd2a043', 'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yFQngRwq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7b1dc486-c6b5-4518-8da5-6042c97cbe55', 'attached_at': '', 'detached_at': '', 'volume_id': '9283b1c4-11f9-41e1-986e-7141d0774fec', 'serial': '9283b1c4-11f9-41e1-986e-7141d0774fec'}, 'volume_type': None}, {'attachment_id': '61a65cc6-7ac4-4930-9ee9-d0e2a20886e5', 'guest_format': None, 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GHgSFWfn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7b1dc486-c6b5-4518-8da5-6042c97cbe55', 'attached_at': '', 'detached_at': '', 'volume_id': '12497dec-be59-409e-8653-a094b2ef1c83', 'serial': '12497dec-be59-409e-8653-a094b2ef1c83'}, 'volume_type': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:46:03 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:46:03 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:46:03 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDxXVrwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:46:03 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:46:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23366343763313866', 'path': '/dev/sdc'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366343763313866', 'path': '/dev/sdc'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.395s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:46:03 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:46:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:46:03 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 00:46:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2243929-4a3e-428b-8f5e-6ea20afd2bdd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 00:46:03 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lIdOTxVJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:46:03 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:46:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e283e72b-2cf4-4a4b-8adf-abdb2cd825a7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606] added
Nov 14 00:46:03 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fe5356-7c71-4c9e-bf67-03a00ae1d974]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb4d004-7051-4ab2-bd69-8d2a1c67dcdb]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qDxXVrwI {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qDxXVrwI" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[556339e8-8c32-46c4-8b82-6940e822dae7]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qDxXVrwI'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[136224f2-7573-4e4c-8931-4a858ddba4fa]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ecabb4-9133-4783-84c0-97616c228a14]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:46:03 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:46:03 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:46:03 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:46:03 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[01206eb7-744f-46f7-9ca6-088613f78e44]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606, portal: 172.16.0.220,3260]
Nov 14 00:46:03 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606, portal: 172.16.0.220,3260] successful.
Nov 14 00:46:03 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca7884a-a241-41c2-92eb-893b161554ac]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a05ec38-f175-4237-87f8-e34a206581a3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:46:03 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:46:03 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:46:03 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:46:03 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:46:03 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:46:03 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3131803b-b5a0-4bb0-bedc-c238e7fcc9ba]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:46:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDxXVrwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 00:46:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:46:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] <== connect_volume: return (1682ms) {'type': 'block', 'scsi_wwn': '26364313462613832', 'path': '/dev/sdd'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:46:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364313462613832', 'path': '/dev/sdd'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 00:46:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.261s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:46:04 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:46:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:46:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:46:04 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 00:46:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 00:46:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yFQngRwq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:46:04 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:46:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:46:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:04 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a7fe72-78f8-4d5e-b342-0f334faf3cc7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 00:46:04 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:04 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d29945-409b-4236-adff-4b5d76d9d4b5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8] added
Nov 14 00:46:04 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:04 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3aebff-b1a2-41d3-858d-7784485f28fc]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:04 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[277ec639-75f7-4577-a4ef-4ca455edcf47]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lIdOTxVJ {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lIdOTxVJ" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:04 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8c7083-94ec-49c7-9f19-b06389c0b061]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lIdOTxVJ'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:04 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b31f277-2de9-4807-b0f0-32c4a2b6bb96]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:04 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc908e4-fea8-4304-af14-cfacc02b3f5d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:46:04 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:46:04 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:46:04 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:46:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:46:04 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:46:04 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:46:04 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:46:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:05 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[550bb4ac-4216-4713-9778-e92c74b300b9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8, portal: 172.16.0.220,3260]
Nov 14 00:46:05 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8, portal: 172.16.0.220,3260] successful.
Nov 14 00:46:05 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:05 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fc994e-9b56-45b4-ad66-8b66b78b3d46]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:05 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8cb24e-e9d9-49ce-ad00-18b766118223]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:46:05 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:46:05 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:46:05 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:46:05 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:46:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:46:05 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:46:05 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:46:05 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:46:05 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:46:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:46:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 00:46:05 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 00:46:05 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 00:46:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:05 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af61174-1d67-4408-9bac-c062f397371f]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:05 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: None {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lIdOTxVJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] <== connect_volume: return (2584ms) {'type': 'block', 'scsi_wwn': '23034316261646139', 'path': '/dev/sde'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034316261646139', 'path': '/dev/sde'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.295s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:46:06 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:46:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:46:06 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 00:46:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c05000-a5f9-42a0-8553-f4a7e07398b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 00:46:06 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPwzaCbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:46:06 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:46:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56d40c3-bf74-41c3-bb5f-d1817d919b29]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec] added
Nov 14 00:46:06 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7cc4edf-5c06-49b5-b1c1-238ac5445e79]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db36561-0efd-41a4-a4b5-d3229ca233d8]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yFQngRwq {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yFQngRwq" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6c0602-439c-4cb4-9c82-a9ab81864604]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yFQngRwq'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57ba1c7-86cc-4b0e-902f-d7ec054ae581]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0905be-89e2-4566-a853-f8b86d13e377]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:46:06 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:46:06 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:46:06 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:46:06 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:46:06 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:46:06 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:46:06 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:46:06 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcc8177-6b75-4456-9308-901ac2c25c89]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec, portal: 172.16.0.220,3260]
Nov 14 00:46:06 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec, portal: 172.16.0.220,3260] successful.
Nov 14 00:46:06 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[090c2fba-1e44-437d-9bfc-7378e0d29645]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6abb49-ba85-4842-a9c3-bc68c3f489de]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:46:06 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:46:06 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:46:06 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:46:06 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:46:06 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:46:06 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:46:06 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:46:06 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:46:06 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:46:06 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eeb3717-3c3c-4b19-901a-d7b5bbb09fb3]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:46:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yFQngRwq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] <== connect_volume: return (2595ms) {'type': 'block', 'scsi_wwn': '26639633932333366', 'path': '/dev/sdf'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639633932333366', 'path': '/dev/sdf'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.273s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:46:07 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:46:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:46:07 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 00:46:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GHgSFWfn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:46:07 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:46:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6f7612-d59f-43fb-b1fd-c1282d1090e7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 00:46:07 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2149510-8d5d-46a2-8d18-78051a194611]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732] added
Nov 14 00:46:07 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9496453f-8b4e-435c-8842-05f5cc4bab41]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50b8f63-f807-461e-8f70-3ac914507e97]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jPwzaCbT {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jPwzaCbT" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[00044ce0-8cb9-4d03-a0a1-1015d481ac46]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jPwzaCbT'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce938d85-cfca-4b28-a166-0e2cf5ff0ef1]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[97447026-8a8b-4dbd-9e43-0f3667fcaa47]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:46:07 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:46:07 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:46:07 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:46:07 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:46:07 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:46:07 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:46:07 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:46:07 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:46:07 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:46:07 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0066a102-ade4-46a3-870f-2bfc369f14ff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732, portal: 172.16.0.220,3260]
Nov 14 00:46:07 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732, portal: 172.16.0.220,3260] successful.
Nov 14 00:46:07 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e69986-3482-4e7d-9d83-7a55bc1c07f2]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b455a4c5-9bb7-477a-90cb-18c314b6e955]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:46:07 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:46:07 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:46:07 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:46:07 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:46:07 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:46:07 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:46:07 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:46:07 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:46:07 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:46:07 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:46:07 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:46:07 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b841b2e-72ff-4173-aa23-0c6b37db979c]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:46:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPwzaCbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] <== connect_volume: return (2608ms) {'type': 'block', 'scsi_wwn': '26331633061613239', 'path': '/dev/sdg'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331633061613239', 'path': '/dev/sdg'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.307s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:46:08 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:46:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:46:08 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 00:46:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bda1ecc-a76e-4b8d-86c2-19c96ab1e091]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 00:46:08 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500911426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500911426',id=12,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvUEeAUQLsXKl6m7NjNtE2ef2Weqmtoygn4z0iXpTrZKHLLVGmVbBND3rGgVzIxdNW/D9ndUeJzkE9PknlgrHFaaNshkRa/weDto/3TT+c3YiufBTSs5ncIjQtIYYNX4w==',key_name='tempest-keypair-637099234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c11a9473df4d4f11ac696ce90dfe7dff',ramdisk_id='',reservation_id='r-ci1qk04z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-132442839',owner_user_name='tempest-TaggedBootDevicesTest_v242-132442839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c75e4b6218c34ff98d528512b4b2d825',uuid=cc072036-25dc-48a8-b430-5a2655fb473a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a03ed99-51c7-49e9-abbb-dc338dd795ff", "address": "fa:16:3e:3b:53:d5", "network": {"id": "9ebba924-fce1-4de9-9859-4be03c6c5bd6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-873499233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a03ed99-51", "ovs_interfaceid": "9a03ed99-51c7-49e9-abbb-dc338dd795ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converting VIF {"id": "9a03ed99-51c7-49e9-abbb-dc338dd795ff", "address": "fa:16:3e:3b:53:d5", "network": {"id": "9ebba924-fce1-4de9-9859-4be03c6c5bd6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-873499233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a03ed99-51", "ovs_interfaceid": "9a03ed99-51c7-49e9-abbb-dc338dd795ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:53:d5,bridge_name='br-int',has_traffic_filtering=True,id=9a03ed99-51c7-49e9-abbb-dc338dd795ff,network=Network(9ebba924-fce1-4de9-9859-4be03c6c5bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a03ed99-51') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500911426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500911426',id=12,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvUEeAUQLsXKl6m7NjNtE2ef2Weqmtoygn4z0iXpTrZKHLLVGmVbBND3rGgVzIxdNW/D9ndUeJzkE9PknlgrHFaaNshkRa/weDto/3TT+c3YiufBTSs5ncIjQtIYYNX4w==',key_name='tempest-keypair-637099234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c11a9473df4d4f11ac696ce90dfe7dff',ramdisk_id='',reservation_id='r-ci1qk04z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-132442839',owner_user_name='tempest-TaggedBootDevicesTest_v242-132442839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c75e4b6218c34ff98d528512b4b2d825',uuid=cc072036-25dc-48a8-b430-5a2655fb473a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b861886-0054-400a-b163-35945d498927", "address": "fa:16:3e:19:40:aa", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b861886-00", "ovs_interfaceid": "3b861886-0054-400a-b163-35945d498927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converting VIF {"id": "3b861886-0054-400a-b163-35945d498927", "address": "fa:16:3e:19:40:aa", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b861886-00", "ovs_interfaceid": "3b861886-0054-400a-b163-35945d498927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:40:aa,bridge_name='br-int',has_traffic_filtering=True,id=3b861886-0054-400a-b163-35945d498927,network=Network(6638fd71-589d-4917-8925-96a0fd255c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3b861886-00') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500911426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500911426',id=12,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvUEeAUQLsXKl6m7NjNtE2ef2Weqmtoygn4z0iXpTrZKHLLVGmVbBND3rGgVzIxdNW/D9ndUeJzkE9PknlgrHFaaNshkRa/weDto/3TT+c3YiufBTSs5ncIjQtIYYNX4w==',key_name='tempest-keypair-637099234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c11a9473df4d4f11ac696ce90dfe7dff',ramdisk_id='',reservation_id='r-ci1qk04z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-132442839',owner_user_name='tempest-TaggedBootDevicesTest_v242-132442839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c75e4b6218c34ff98d528512b4b2d825',uuid=cc072036-25dc-48a8-b430-5a2655fb473a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "381f68d0-96e0-404e-93e6-d166732e2df8", "address": "fa:16:3e:41:e5:08", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap381f68d0-96", "ovs_interfaceid": "381f68d0-96e0-404e-93e6-d166732e2df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converting VIF {"id": "381f68d0-96e0-404e-93e6-d166732e2df8", "address": "fa:16:3e:41:e5:08", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap381f68d0-96", "ovs_interfaceid": "381f68d0-96e0-404e-93e6-d166732e2df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:e5:08,bridge_name='br-int',has_traffic_filtering=True,id=381f68d0-96e0-404e-93e6-d166732e2df8,network=Network(6638fd71-589d-4917-8925-96a0fd255c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap381f68d0-96') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500911426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500911426',id=12,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvUEeAUQLsXKl6m7NjNtE2ef2Weqmtoygn4z0iXpTrZKHLLVGmVbBND3rGgVzIxdNW/D9ndUeJzkE9PknlgrHFaaNshkRa/weDto/3TT+c3YiufBTSs5ncIjQtIYYNX4w==',key_name='tempest-keypair-637099234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c11a9473df4d4f11ac696ce90dfe7dff',ramdisk_id='',reservation_id='r-ci1qk04z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-132442839',owner_user_name='tempest-TaggedBootDevicesTest_v242-132442839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c75e4b6218c34ff98d528512b4b2d825',uuid=cc072036-25dc-48a8-b430-5a2655fb473a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "447494fb-fc40-41f9-94d9-d1c39434a22d", "address": "fa:16:3e:87:3d:45", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap447494fb-fc", "ovs_interfaceid": "447494fb-fc40-41f9-94d9-d1c39434a22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converting VIF {"id": "447494fb-fc40-41f9-94d9-d1c39434a22d", "address": "fa:16:3e:87:3d:45", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap447494fb-fc", "ovs_interfaceid": "447494fb-fc40-41f9-94d9-d1c39434a22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:3d:45,bridge_name='br-int',has_traffic_filtering=True,id=447494fb-fc40-41f9-94d9-d1c39434a22d,network=Network(6638fd71-589d-4917-8925-96a0fd255c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap447494fb-fc') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500911426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500911426',id=12,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvUEeAUQLsXKl6m7NjNtE2ef2Weqmtoygn4z0iXpTrZKHLLVGmVbBND3rGgVzIxdNW/D9ndUeJzkE9PknlgrHFaaNshkRa/weDto/3TT+c3YiufBTSs5ncIjQtIYYNX4w==',key_name='tempest-keypair-637099234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c11a9473df4d4f11ac696ce90dfe7dff',ramdisk_id='',reservation_id='r-ci1qk04z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-132442839',owner_user_name='tempest-TaggedBootDevicesTest_v242-132442839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c75e4b6218c34ff98d528512b4b2d825',uuid=cc072036-25dc-48a8-b430-5a2655fb473a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70f458ad-d5db-47a5-9ab1-b776a8fdbb98", "address": "fa:16:3e:96:01:0a", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f458ad-d5", "ovs_interfaceid": "70f458ad-d5db-47a5-9ab1-b776a8fdbb98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converting VIF {"id": "70f458ad-d5db-47a5-9ab1-b776a8fdbb98", "address": "fa:16:3e:96:01:0a", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f458ad-d5", "ovs_interfaceid": "70f458ad-d5db-47a5-9ab1-b776a8fdbb98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:01:0a,bridge_name='br-int',has_traffic_filtering=True,id=70f458ad-d5db-47a5-9ab1-b776a8fdbb98,network=Network(6638fd71-589d-4917-8925-96a0fd255c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70f458ad-d5') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500911426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500911426',id=12,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvUEeAUQLsXKl6m7NjNtE2ef2Weqmtoygn4z0iXpTrZKHLLVGmVbBND3rGgVzIxdNW/D9ndUeJzkE9PknlgrHFaaNshkRa/weDto/3TT+c3YiufBTSs5ncIjQtIYYNX4w==',key_name='tempest-keypair-637099234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c11a9473df4d4f11ac696ce90dfe7dff',ramdisk_id='',reservation_id='r-ci1qk04z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-132442839',owner_user_name='tempest-TaggedBootDevicesTest_v242-132442839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c75e4b6218c34ff98d528512b4b2d825',uuid=cc072036-25dc-48a8-b430-5a2655fb473a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "457e3066-b6bf-4d67-9c40-d1437ef901a3", "address": "fa:16:3e:dd:36:d4", "network": {"id": "b5892a30-40d5-4832-bb6b-b8a7f20106b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-725774050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457e3066-b6", "ovs_interfaceid": "457e3066-b6bf-4d67-9c40-d1437ef901a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converting VIF {"id": "457e3066-b6bf-4d67-9c40-d1437ef901a3", "address": "fa:16:3e:dd:36:d4", "network": {"id": "b5892a30-40d5-4832-bb6b-b8a7f20106b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-725774050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457e3066-b6", "ovs_interfaceid": "457e3066-b6bf-4d67-9c40-d1437ef901a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:36:d4,bridge_name='br-int',has_traffic_filtering=True,id=457e3066-b6bf-4d67-9c40-d1437ef901a3,network=Network(b5892a30-40d5-4832-bb6b-b8a7f20106b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457e3066-b6') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500911426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500911426',id=12,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvUEeAUQLsXKl6m7NjNtE2ef2Weqmtoygn4z0iXpTrZKHLLVGmVbBND3rGgVzIxdNW/D9ndUeJzkE9PknlgrHFaaNshkRa/weDto/3TT+c3YiufBTSs5ncIjQtIYYNX4w==',key_name='tempest-keypair-637099234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c11a9473df4d4f11ac696ce90dfe7dff',ramdisk_id='',reservation_id='r-ci1qk04z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-132442839',owner_user_name='tempest-TaggedBootDevicesTest_v242-132442839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c75e4b6218c34ff98d528512b4b2d825',uuid=cc072036-25dc-48a8-b430-5a2655fb473a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14239fc2-af2c-4d50-9f58-9758fe0f1221", "address": "fa:16:3e:66:d7:47", "network": {"id": "b5892a30-40d5-4832-bb6b-b8a7f20106b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-725774050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14239fc2-af", "ovs_interfaceid": "14239fc2-af2c-4d50-9f58-9758fe0f1221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converting VIF {"id": "14239fc2-af2c-4d50-9f58-9758fe0f1221", "address": "fa:16:3e:66:d7:47", "network": {"id": "b5892a30-40d5-4832-bb6b-b8a7f20106b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-725774050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14239fc2-af", "ovs_interfaceid": "14239fc2-af2c-4d50-9f58-9758fe0f1221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:d7:47,bridge_name='br-int',has_traffic_filtering=True,id=14239fc2-af2c-4d50-9f58-9758fe0f1221,network=Network(b5892a30-40d5-4832-bb6b-b8a7f20106b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14239fc2-af') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG nova.objects.instance [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Lazy-loading 'pci_devices' on Instance uuid cc072036-25dc-48a8-b430-5a2655fb473a {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[203cdb94-837b-46be-88cd-cad43a051a4e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83] added
Nov 14 00:46:08 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:46:08 user nova-compute[74850]:   <uuid>cc072036-25dc-48a8-b430-5a2655fb473a</uuid>
Nov 14 00:46:08 user nova-compute[74850]:   <name>instance-0000000c</name>
Nov 14 00:46:08 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:46:08 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:46:08 user nova-compute[74850]:   <metadata>
Nov 14 00:46:08 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:46:08 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:46:08 user nova-compute[74850]:       <nova:name>tempest-device-tagging-server-500911426</nova:name>
Nov 14 00:46:08 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:46:02</nova:creationTime>
Nov 14 00:46:08 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:46:08 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:46:08 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:46:08 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:46:08 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:46:08 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:46:08 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:46:08 user nova-compute[74850]:       <nova:owner>
Nov 14 00:46:08 user nova-compute[74850]:         <nova:user uuid="c75e4b6218c34ff98d528512b4b2d825">tempest-TaggedBootDevicesTest_v242-132442839-project-member</nova:user>
Nov 14 00:46:08 user nova-compute[74850]:         <nova:project uuid="c11a9473df4d4f11ac696ce90dfe7dff">tempest-TaggedBootDevicesTest_v242-132442839</nova:project>
Nov 14 00:46:08 user nova-compute[74850]:       </nova:owner>
Nov 14 00:46:08 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:46:08 user nova-compute[74850]:       <nova:ports>
Nov 14 00:46:08 user nova-compute[74850]:         <nova:port uuid="9a03ed99-51c7-49e9-abbb-dc338dd795ff">
Nov 14 00:46:08 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 00:46:08 user nova-compute[74850]:         </nova:port>
Nov 14 00:46:08 user nova-compute[74850]:         <nova:port uuid="3b861886-0054-400a-b163-35945d498927">
Nov 14 00:46:08 user nova-compute[74850]:           <nova:ip type="fixed" address="10.1.1.253" ipVersion="4"/>
Nov 14 00:46:08 user nova-compute[74850]:         </nova:port>
Nov 14 00:46:08 user nova-compute[74850]:         <nova:port uuid="381f68d0-96e0-404e-93e6-d166732e2df8">
Nov 14 00:46:08 user nova-compute[74850]:           <nova:ip type="fixed" address="10.1.1.124" ipVersion="4"/>
Nov 14 00:46:08 user nova-compute[74850]:         </nova:port>
Nov 14 00:46:08 user nova-compute[74850]:         <nova:port uuid="447494fb-fc40-41f9-94d9-d1c39434a22d">
Nov 14 00:46:08 user nova-compute[74850]:           <nova:ip type="fixed" address="10.1.1.48" ipVersion="4"/>
Nov 14 00:46:08 user nova-compute[74850]:         </nova:port>
Nov 14 00:46:08 user nova-compute[74850]:         <nova:port uuid="70f458ad-d5db-47a5-9ab1-b776a8fdbb98">
Nov 14 00:46:08 user nova-compute[74850]:           <nova:ip type="fixed" address="10.1.1.233" ipVersion="4"/>
Nov 14 00:46:08 user nova-compute[74850]:         </nova:port>
Nov 14 00:46:08 user nova-compute[74850]:         <nova:port uuid="457e3066-b6bf-4d67-9c40-d1437ef901a3">
Nov 14 00:46:08 user nova-compute[74850]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 14 00:46:08 user nova-compute[74850]:         </nova:port>
Nov 14 00:46:08 user nova-compute[74850]:         <nova:port uuid="14239fc2-af2c-4d50-9f58-9758fe0f1221">
Nov 14 00:46:08 user nova-compute[74850]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 14 00:46:08 user nova-compute[74850]:         </nova:port>
Nov 14 00:46:08 user nova-compute[74850]:       </nova:ports>
Nov 14 00:46:08 user nova-compute[74850]:     </nova:instance>
Nov 14 00:46:08 user nova-compute[74850]:   </metadata>
Nov 14 00:46:08 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:46:08 user nova-compute[74850]:     <system>
Nov 14 00:46:08 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:46:08 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:46:08 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:46:08 user nova-compute[74850]:       <entry name="serial">cc072036-25dc-48a8-b430-5a2655fb473a</entry>
Nov 14 00:46:08 user nova-compute[74850]:       <entry name="uuid">cc072036-25dc-48a8-b430-5a2655fb473a</entry>
Nov 14 00:46:08 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:46:08 user nova-compute[74850]:     </system>
Nov 14 00:46:08 user nova-compute[74850]:   </sysinfo>
Nov 14 00:46:08 user nova-compute[74850]:   <os>
Nov 14 00:46:08 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:46:08 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 00:46:08 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:46:08 user nova-compute[74850]:   </os>
Nov 14 00:46:08 user nova-compute[74850]:   <features>
Nov 14 00:46:08 user nova-compute[74850]:     <acpi/>
Nov 14 00:46:08 user nova-compute[74850]:     <apic/>
Nov 14 00:46:08 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:46:08 user nova-compute[74850]:   </features>
Nov 14 00:46:08 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:46:08 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:46:08 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:46:08 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:46:08 user nova-compute[74850]:   </clock>
Nov 14 00:46:08 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:46:08 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:46:08 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:46:08 user nova-compute[74850]:   </cpu>
Nov 14 00:46:08 user nova-compute[74850]:   <devices>
Nov 14 00:46:08 user nova-compute[74850]:     <disk type="file" device="cdrom">
Nov 14 00:46:08 user nova-compute[74850]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 00:46:08 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/cc072036-25dc-48a8-b430-5a2655fb473a/disk.config"/>
Nov 14 00:46:08 user nova-compute[74850]:       <target dev="hda" bus="ide"/>
Nov 14 00:46:08 user nova-compute[74850]:     </disk>
Nov 14 00:46:08 user nova-compute[74850]:     <disk type="block" device="disk">
Nov 14 00:46:08 user nova-compute[74850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:46:08 user nova-compute[74850]:       <source dev="/dev/sdc"/>
Nov 14 00:46:08 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:46:08 user nova-compute[74850]:       <serial>0445ff3f-e6a1-42c9-8615-6a1dedd73f9c</serial>
Nov 14 00:46:08 user nova-compute[74850]:     </disk>
Nov 14 00:46:08 user nova-compute[74850]:     <disk type="block" device="disk">
Nov 14 00:46:08 user nova-compute[74850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:46:08 user nova-compute[74850]:       <source dev="/dev/sde"/>
Nov 14 00:46:08 user nova-compute[74850]:       <target dev="vdb" bus="virtio"/>
Nov 14 00:46:08 user nova-compute[74850]:       <serial>97af5108-d8a8-4d51-9924-995dc5855ef8</serial>
Nov 14 00:46:08 user nova-compute[74850]:     </disk>
Nov 14 00:46:08 user nova-compute[74850]:     <disk type="block" device="disk">
Nov 14 00:46:08 user nova-compute[74850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:46:08 user nova-compute[74850]:       <source dev="/dev/sdg"/>
Nov 14 00:46:08 user nova-compute[74850]:       <target dev="vdc" bus="virtio"/>
Nov 14 00:46:08 user nova-compute[74850]:       <serial>e372017c-0803-4c15-98aa-3a64b9277732</serial>
Nov 14 00:46:08 user nova-compute[74850]:     </disk>
Nov 14 00:46:08 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:46:08 user nova-compute[74850]:       <mac address="fa:16:3e:3b:53:d5"/>
Nov 14 00:46:08 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:46:08 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:46:08 user nova-compute[74850]:       <target dev="tap9a03ed99-51"/>
Nov 14 00:46:08 user nova-compute[74850]:     </interface>
Nov 14 00:46:08 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:46:08 user nova-compute[74850]:       <mac address="fa:16:3e:19:40:aa"/>
Nov 14 00:46:08 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:46:08 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:46:08 user nova-compute[74850]:       <target dev="tap3b861886-00"/>
Nov 14 00:46:08 user nova-compute[74850]:     </interface>
Nov 14 00:46:08 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:46:08 user nova-compute[74850]:       <mac address="fa:16:3e:41:e5:08"/>
Nov 14 00:46:08 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:46:08 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:46:08 user nova-compute[74850]:       <target dev="tap381f68d0-96"/>
Nov 14 00:46:08 user nova-compute[74850]:     </interface>
Nov 14 00:46:08 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:46:08 user nova-compute[74850]:       <mac address="fa:16:3e:87:3d:45"/>
Nov 14 00:46:08 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:46:08 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:46:08 user nova-compute[74850]:       <target dev="tap447494fb-fc"/>
Nov 14 00:46:08 user nova-compute[74850]:     </interface>
Nov 14 00:46:08 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:46:08 user nova-compute[74850]:       <mac address="fa:16:3e:96:01:0a"/>
Nov 14 00:46:08 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:46:08 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:46:08 user nova-compute[74850]:       <target dev="tap70f458ad-d5"/>
Nov 14 00:46:08 user nova-compute[74850]:     </interface>
Nov 14 00:46:08 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:46:08 user nova-compute[74850]:       <mac address="fa:16:3e:dd:36:d4"/>
Nov 14 00:46:08 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:46:08 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:46:08 user nova-compute[74850]:       <target dev="tap457e3066-b6"/>
Nov 14 00:46:08 user nova-compute[74850]:     </interface>
Nov 14 00:46:08 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:46:08 user nova-compute[74850]:       <mac address="fa:16:3e:66:d7:47"/>
Nov 14 00:46:08 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:46:08 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:46:08 user nova-compute[74850]:       <target dev="tap14239fc2-af"/>
Nov 14 00:46:08 user nova-compute[74850]:     </interface>
Nov 14 00:46:08 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:46:08 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/cc072036-25dc-48a8-b430-5a2655fb473a/console.log" append="off"/>
Nov 14 00:46:08 user nova-compute[74850]:     </serial>
Nov 14 00:46:08 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:46:08 user nova-compute[74850]:     <video>
Nov 14 00:46:08 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:46:08 user nova-compute[74850]:     </video>
Nov 14 00:46:08 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:46:08 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:46:08 user nova-compute[74850]:     </rng>
Nov 14 00:46:08 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:46:08 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:46:08 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:46:08 user nova-compute[74850]:     </memballoon>
Nov 14 00:46:08 user nova-compute[74850]:   </devices>
Nov 14 00:46:08 user nova-compute[74850]: </domain>
Nov 14 00:46:08 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500911426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500911426',id=12,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvUEeAUQLsXKl6m7NjNtE2ef2Weqmtoygn4z0iXpTrZKHLLVGmVbBND3rGgVzIxdNW/D9ndUeJzkE9PknlgrHFaaNshkRa/weDto/3TT+c3YiufBTSs5ncIjQtIYYNX4w==',key_name='tempest-keypair-637099234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c11a9473df4d4f11ac696ce90dfe7dff',ramdisk_id='',reservation_id='r-ci1qk04z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-132442839',owner_user_name='tempest-TaggedBootDevicesTest_v242-132442839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c75e4b6218c34ff98d528512b4b2d825',uuid=cc072036-25dc-48a8-b430-5a2655fb473a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a03ed99-51c7-49e9-abbb-dc338dd795ff", "address": "fa:16:3e:3b:53:d5", "network": {"id": "9ebba924-fce1-4de9-9859-4be03c6c5bd6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-873499233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a03ed99-51", "ovs_interfaceid": "9a03ed99-51c7-49e9-abbb-dc338dd795ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converting VIF {"id": "9a03ed99-51c7-49e9-abbb-dc338dd795ff", "address": "fa:16:3e:3b:53:d5", "network": {"id": "9ebba924-fce1-4de9-9859-4be03c6c5bd6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-873499233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a03ed99-51", "ovs_interfaceid": "9a03ed99-51c7-49e9-abbb-dc338dd795ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:53:d5,bridge_name='br-int',has_traffic_filtering=True,id=9a03ed99-51c7-49e9-abbb-dc338dd795ff,network=Network(9ebba924-fce1-4de9-9859-4be03c6c5bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a03ed99-51') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG os_vif [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:53:d5,bridge_name='br-int',has_traffic_filtering=True,id=9a03ed99-51c7-49e9-abbb-dc338dd795ff,network=Network(9ebba924-fce1-4de9-9859-4be03c6c5bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a03ed99-51') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0ea20fa3-ae34-559e-ba53-5c0e1e52bbb0', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[883da182-6eb6-4db7-bf8d-c3c418bfa7b5]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a03ed99-51, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9a03ed99-51, col_values=(('qos', UUID('f5082c6b-4e5a-4c47-bc47-66731f210a14')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9a03ed99-51, col_values=(('external_ids', {'iface-id': '9a03ed99-51c7-49e9-abbb-dc338dd795ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:53:d5', 'vm-uuid': 'cc072036-25dc-48a8-b430-5a2655fb473a'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a6c302-7681-4c07-9584-7f7c229eb525]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GHgSFWfn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:08 user nova-compute[74850]: INFO os_vif [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:53:d5,bridge_name='br-int',has_traffic_filtering=True,id=9a03ed99-51c7-49e9-abbb-dc338dd795ff,network=Network(9ebba924-fce1-4de9-9859-4be03c6c5bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a03ed99-51')
Nov 14 00:46:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500911426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500911426',id=12,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvUEeAUQLsXKl6m7NjNtE2ef2Weqmtoygn4z0iXpTrZKHLLVGmVbBND3rGgVzIxdNW/D9ndUeJzkE9PknlgrHFaaNshkRa/weDto/3TT+c3YiufBTSs5ncIjQtIYYNX4w==',key_name='tempest-keypair-637099234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c11a9473df4d4f11ac696ce90dfe7dff',ramdisk_id='',reservation_id='r-ci1qk04z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-132442839',owner_user_name='tempest-TaggedBootDevicesTest_v242-132442839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c75e4b6218c34ff98d528512b4b2d825',uuid=cc072036-25dc-48a8-b430-5a2655fb473a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b861886-0054-400a-b163-35945d498927", "address": "fa:16:3e:19:40:aa", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b861886-00", "ovs_interfaceid": "3b861886-0054-400a-b163-35945d498927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converting VIF {"id": "3b861886-0054-400a-b163-35945d498927", "address": "fa:16:3e:19:40:aa", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b861886-00", "ovs_interfaceid": "3b861886-0054-400a-b163-35945d498927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:40:aa,bridge_name='br-int',has_traffic_filtering=True,id=3b861886-0054-400a-b163-35945d498927,network=Network(6638fd71-589d-4917-8925-96a0fd255c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3b861886-00') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG os_vif [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:40:aa,bridge_name='br-int',has_traffic_filtering=True,id=3b861886-0054-400a-b163-35945d498927,network=Network(6638fd71-589d-4917-8925-96a0fd255c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3b861886-00') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd823a192-3175-5687-897d-a6ba29dd3a4f', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GHgSFWfn" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ba562b-8462-447a-9467-259443ad4362]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GHgSFWfn'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b861886-00, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3b861886-00, col_values=(('qos', UUID('b671613d-0cd1-4d9f-8a44-a65d8eee3395')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3b861886-00, col_values=(('external_ids', {'iface-id': '3b861886-0054-400a-b163-35945d498927', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:40:aa', 'vm-uuid': 'cc072036-25dc-48a8-b430-5a2655fb473a'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aacdfa5-814b-40e3-9dd8-318f61e9b8b1]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:08 user nova-compute[74850]: INFO os_vif [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:40:aa,bridge_name='br-int',has_traffic_filtering=True,id=3b861886-0054-400a-b163-35945d498927,network=Network(6638fd71-589d-4917-8925-96a0fd255c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3b861886-00')
Nov 14 00:46:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500911426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500911426',id=12,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvUEeAUQLsXKl6m7NjNtE2ef2Weqmtoygn4z0iXpTrZKHLLVGmVbBND3rGgVzIxdNW/D9ndUeJzkE9PknlgrHFaaNshkRa/weDto/3TT+c3YiufBTSs5ncIjQtIYYNX4w==',key_name='tempest-keypair-637099234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c11a9473df4d4f11ac696ce90dfe7dff',ramdisk_id='',reservation_id='r-ci1qk04z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-132442839',owner_user_name='tempest-TaggedBootDevicesTest_v242-132442839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c75e4b6218c34ff98d528512b4b2d825',uuid=cc072036-25dc-48a8-b430-5a2655fb473a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "381f68d0-96e0-404e-93e6-d166732e2df8", "address": "fa:16:3e:41:e5:08", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap381f68d0-96", "ovs_interfaceid": "381f68d0-96e0-404e-93e6-d166732e2df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converting VIF {"id": "381f68d0-96e0-404e-93e6-d166732e2df8", "address": "fa:16:3e:41:e5:08", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap381f68d0-96", "ovs_interfaceid": "381f68d0-96e0-404e-93e6-d166732e2df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:e5:08,bridge_name='br-int',has_traffic_filtering=True,id=381f68d0-96e0-404e-93e6-d166732e2df8,network=Network(6638fd71-589d-4917-8925-96a0fd255c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap381f68d0-96') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG os_vif [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:e5:08,bridge_name='br-int',has_traffic_filtering=True,id=381f68d0-96e0-404e-93e6-d166732e2df8,network=Network(6638fd71-589d-4917-8925-96a0fd255c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap381f68d0-96') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf042fe5-e210-59fa-a397-3ea4cbd02883', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[df80d5be-c356-479e-91c3-68e69c1eb78a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:46:08 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:46:08 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:46:08 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:46:08 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:46:08 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:46:08 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:46:08 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:46:08 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:46:08 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:46:08 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:46:08 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:46:08 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap381f68d0-96, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap381f68d0-96, col_values=(('qos', UUID('f0c8cc85-49db-4f9c-a5da-f5ae7de74b7b')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap381f68d0-96, col_values=(('external_ids', {'iface-id': '381f68d0-96e0-404e-93e6-d166732e2df8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:e5:08', 'vm-uuid': 'cc072036-25dc-48a8-b430-5a2655fb473a'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:08 user nova-compute[74850]: INFO os_vif [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:e5:08,bridge_name='br-int',has_traffic_filtering=True,id=381f68d0-96e0-404e-93e6-d166732e2df8,network=Network(6638fd71-589d-4917-8925-96a0fd255c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap381f68d0-96')
Nov 14 00:46:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500911426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500911426',id=12,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvUEeAUQLsXKl6m7NjNtE2ef2Weqmtoygn4z0iXpTrZKHLLVGmVbBND3rGgVzIxdNW/D9ndUeJzkE9PknlgrHFaaNshkRa/weDto/3TT+c3YiufBTSs5ncIjQtIYYNX4w==',key_name='tempest-keypair-637099234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c11a9473df4d4f11ac696ce90dfe7dff',ramdisk_id='',reservation_id='r-ci1qk04z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-132442839',owner_user_name='tempest-TaggedBootDevicesTest_v242-132442839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c75e4b6218c34ff98d528512b4b2d825',uuid=cc072036-25dc-48a8-b430-5a2655fb473a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "447494fb-fc40-41f9-94d9-d1c39434a22d", "address": "fa:16:3e:87:3d:45", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap447494fb-fc", "ovs_interfaceid": "447494fb-fc40-41f9-94d9-d1c39434a22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converting VIF {"id": "447494fb-fc40-41f9-94d9-d1c39434a22d", "address": "fa:16:3e:87:3d:45", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap447494fb-fc", "ovs_interfaceid": "447494fb-fc40-41f9-94d9-d1c39434a22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:3d:45,bridge_name='br-int',has_traffic_filtering=True,id=447494fb-fc40-41f9-94d9-d1c39434a22d,network=Network(6638fd71-589d-4917-8925-96a0fd255c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap447494fb-fc') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG os_vif [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:3d:45,bridge_name='br-int',has_traffic_filtering=True,id=447494fb-fc40-41f9-94d9-d1c39434a22d,network=Network(6638fd71-589d-4917-8925-96a0fd255c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap447494fb-fc') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1b2c5e0c-23fd-5e8a-9d86-8719d272fbf7', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3133d9-7a94-4aa7-9349-af7407887496]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap447494fb-fc, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap447494fb-fc, col_values=(('qos', UUID('677f08ff-05e9-4938-87d4-5746432d996a')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap447494fb-fc, col_values=(('external_ids', {'iface-id': '447494fb-fc40-41f9-94d9-d1c39434a22d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:3d:45', 'vm-uuid': 'cc072036-25dc-48a8-b430-5a2655fb473a'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83, portal: 172.16.0.220,3260]
Nov 14 00:46:09 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83, portal: 172.16.0.220,3260] successful.
Nov 14 00:46:09 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e50719-815e-474f-97c4-f116c5e7ecca]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:09 user nova-compute[74850]: INFO os_vif [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:3d:45,bridge_name='br-int',has_traffic_filtering=True,id=447494fb-fc40-41f9-94d9-d1c39434a22d,network=Network(6638fd71-589d-4917-8925-96a0fd255c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap447494fb-fc')
Nov 14 00:46:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500911426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500911426',id=12,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvUEeAUQLsXKl6m7NjNtE2ef2Weqmtoygn4z0iXpTrZKHLLVGmVbBND3rGgVzIxdNW/D9ndUeJzkE9PknlgrHFaaNshkRa/weDto/3TT+c3YiufBTSs5ncIjQtIYYNX4w==',key_name='tempest-keypair-637099234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c11a9473df4d4f11ac696ce90dfe7dff',ramdisk_id='',reservation_id='r-ci1qk04z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-132442839',owner_user_name='tempest-TaggedBootDevicesTest_v242-132442839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c75e4b6218c34ff98d528512b4b2d825',uuid=cc072036-25dc-48a8-b430-5a2655fb473a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70f458ad-d5db-47a5-9ab1-b776a8fdbb98", "address": "fa:16:3e:96:01:0a", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f458ad-d5", "ovs_interfaceid": "70f458ad-d5db-47a5-9ab1-b776a8fdbb98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converting VIF {"id": "70f458ad-d5db-47a5-9ab1-b776a8fdbb98", "address": "fa:16:3e:96:01:0a", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f458ad-d5", "ovs_interfaceid": "70f458ad-d5db-47a5-9ab1-b776a8fdbb98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:01:0a,bridge_name='br-int',has_traffic_filtering=True,id=70f458ad-d5db-47a5-9ab1-b776a8fdbb98,network=Network(6638fd71-589d-4917-8925-96a0fd255c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70f458ad-d5') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG os_vif [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:01:0a,bridge_name='br-int',has_traffic_filtering=True,id=70f458ad-d5db-47a5-9ab1-b776a8fdbb98,network=Network(6638fd71-589d-4917-8925-96a0fd255c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70f458ad-d5') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '19fc403f-c520-5ab2-a88b-7336de496706', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b87438-b198-4ffe-bd1f-60aaf25e0178]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:46:09 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:46:09 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:46:09 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:46:09 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:46:09 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:46:09 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:46:09 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:46:09 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:46:09 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:46:09 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:46:09 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:46:09 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:46:09 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:46:09 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[347f6272-a8a4-4b09-b29f-24aaa9ea97d0]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GHgSFWfn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70f458ad-d5, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap70f458ad-d5, col_values=(('qos', UUID('f0f1c332-0efa-45e9-b2bb-8d0a64d3807b')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap70f458ad-d5, col_values=(('external_ids', {'iface-id': '70f458ad-d5db-47a5-9ab1-b776a8fdbb98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:01:0a', 'vm-uuid': 'cc072036-25dc-48a8-b430-5a2655fb473a'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:09 user nova-compute[74850]: INFO os_vif [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:01:0a,bridge_name='br-int',has_traffic_filtering=True,id=70f458ad-d5db-47a5-9ab1-b776a8fdbb98,network=Network(6638fd71-589d-4917-8925-96a0fd255c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70f458ad-d5')
Nov 14 00:46:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500911426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500911426',id=12,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvUEeAUQLsXKl6m7NjNtE2ef2Weqmtoygn4z0iXpTrZKHLLVGmVbBND3rGgVzIxdNW/D9ndUeJzkE9PknlgrHFaaNshkRa/weDto/3TT+c3YiufBTSs5ncIjQtIYYNX4w==',key_name='tempest-keypair-637099234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c11a9473df4d4f11ac696ce90dfe7dff',ramdisk_id='',reservation_id='r-ci1qk04z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-132442839',owner_user_name='tempest-TaggedBootDevicesTest_v242-132442839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c75e4b6218c34ff98d528512b4b2d825',uuid=cc072036-25dc-48a8-b430-5a2655fb473a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "457e3066-b6bf-4d67-9c40-d1437ef901a3", "address": "fa:16:3e:dd:36:d4", "network": {"id": "b5892a30-40d5-4832-bb6b-b8a7f20106b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-725774050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457e3066-b6", "ovs_interfaceid": "457e3066-b6bf-4d67-9c40-d1437ef901a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converting VIF {"id": "457e3066-b6bf-4d67-9c40-d1437ef901a3", "address": "fa:16:3e:dd:36:d4", "network": {"id": "b5892a30-40d5-4832-bb6b-b8a7f20106b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-725774050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457e3066-b6", "ovs_interfaceid": "457e3066-b6bf-4d67-9c40-d1437ef901a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:36:d4,bridge_name='br-int',has_traffic_filtering=True,id=457e3066-b6bf-4d67-9c40-d1437ef901a3,network=Network(b5892a30-40d5-4832-bb6b-b8a7f20106b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457e3066-b6') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG os_vif [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:36:d4,bridge_name='br-int',has_traffic_filtering=True,id=457e3066-b6bf-4d67-9c40-d1437ef901a3,network=Network(b5892a30-40d5-4832-bb6b-b8a7f20106b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457e3066-b6') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f23d6e98-bacb-5618-8e19-334a621815d2', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap457e3066-b6, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap457e3066-b6, col_values=(('qos', UUID('f8f680ad-ba90-43b9-b894-31ce023eef08')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap457e3066-b6, col_values=(('external_ids', {'iface-id': '457e3066-b6bf-4d67-9c40-d1437ef901a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:36:d4', 'vm-uuid': 'cc072036-25dc-48a8-b430-5a2655fb473a'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:09 user nova-compute[74850]: INFO os_vif [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:36:d4,bridge_name='br-int',has_traffic_filtering=True,id=457e3066-b6bf-4d67-9c40-d1437ef901a3,network=Network(b5892a30-40d5-4832-bb6b-b8a7f20106b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457e3066-b6')
Nov 14 00:46:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500911426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500911426',id=12,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvUEeAUQLsXKl6m7NjNtE2ef2Weqmtoygn4z0iXpTrZKHLLVGmVbBND3rGgVzIxdNW/D9ndUeJzkE9PknlgrHFaaNshkRa/weDto/3TT+c3YiufBTSs5ncIjQtIYYNX4w==',key_name='tempest-keypair-637099234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c11a9473df4d4f11ac696ce90dfe7dff',ramdisk_id='',reservation_id='r-ci1qk04z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-132442839',owner_user_name='tempest-TaggedBootDevicesTest_v242-132442839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c75e4b6218c34ff98d528512b4b2d825',uuid=cc072036-25dc-48a8-b430-5a2655fb473a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14239fc2-af2c-4d50-9f58-9758fe0f1221", "address": "fa:16:3e:66:d7:47", "network": {"id": "b5892a30-40d5-4832-bb6b-b8a7f20106b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-725774050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14239fc2-af", "ovs_interfaceid": "14239fc2-af2c-4d50-9f58-9758fe0f1221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converting VIF {"id": "14239fc2-af2c-4d50-9f58-9758fe0f1221", "address": "fa:16:3e:66:d7:47", "network": {"id": "b5892a30-40d5-4832-bb6b-b8a7f20106b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-725774050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14239fc2-af", "ovs_interfaceid": "14239fc2-af2c-4d50-9f58-9758fe0f1221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:d7:47,bridge_name='br-int',has_traffic_filtering=True,id=14239fc2-af2c-4d50-9f58-9758fe0f1221,network=Network(b5892a30-40d5-4832-bb6b-b8a7f20106b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14239fc2-af') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG os_vif [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:d7:47,bridge_name='br-int',has_traffic_filtering=True,id=14239fc2-af2c-4d50-9f58-9758fe0f1221,network=Network(b5892a30-40d5-4832-bb6b-b8a7f20106b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14239fc2-af') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e8801b33-24bd-5a5e-a091-0eee7cd7dedf', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap14239fc2-af, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap14239fc2-af, col_values=(('qos', UUID('cc52275f-8530-46c2-8b8b-578f66a5587c')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap14239fc2-af, col_values=(('external_ids', {'iface-id': '14239fc2-af2c-4d50-9f58-9758fe0f1221', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:d7:47', 'vm-uuid': 'cc072036-25dc-48a8-b430-5a2655fb473a'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:09 user nova-compute[74850]: INFO os_vif [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:d7:47,bridge_name='br-int',has_traffic_filtering=True,id=14239fc2-af2c-4d50-9f58-9758fe0f1221,network=Network(b5892a30-40d5-4832-bb6b-b8a7f20106b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14239fc2-af')
Nov 14 00:46:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] No BDM found with device name hda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] No VIF found with MAC fa:16:3e:3b:53:d5, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] No VIF found with MAC fa:16:3e:96:01:0a, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:46:09 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Using config drive
Nov 14 00:46:09 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Creating config drive at /opt/stack/data/nova/instances/cc072036-25dc-48a8-b430-5a2655fb473a/disk.config
Nov 14 00:46:09 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cc072036-25dc-48a8-b430-5a2655fb473a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpoixn1fjg {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:09 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cc072036-25dc-48a8-b430-5a2655fb473a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpoixn1fjg" returned: 0 in 0.053s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] <== connect_volume: return (2653ms) {'type': 'block', 'scsi_wwn': '23033333466336136', 'path': '/dev/sdh'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033333466336136', 'path': '/dev/sdh'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780227733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780227733',id=11,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF57Qp6LzTZet9KO3h8AMaiCGc7mfI+8CAEfeVIWHvfo6+I5KOzjDqG6/Zv0iKBqb9dwSRVKram/F70Gwho1DzWHcABMdG5wg6wHBH7XqUEw1cWGufHs21TbIjLtuj9MVQ==',key_name='tempest-keypair-1977090372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f380efb37074b3399411fafb1deaa00',ramdisk_id='',reservation_id='r-x0omn3lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105688157',owner_user_name='tempest-TaggedBootDevicesTest-1105688157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb387c6b56014059a5ce18ffe642c3a0',uuid=7b1dc486-c6b5-4518-8da5-6042c97cbe55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04f4b3e3-634c-4285-b389-785cff1205ea", "address": "fa:16:3e:c0:42:3b", "network": {"id": "7b7555f1-01f5-4ec4-a537-8dba31d7bcc0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1180089476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f4b3e3-63", "ovs_interfaceid": "04f4b3e3-634c-4285-b389-785cff1205ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converting VIF {"id": "04f4b3e3-634c-4285-b389-785cff1205ea", "address": "fa:16:3e:c0:42:3b", "network": {"id": "7b7555f1-01f5-4ec4-a537-8dba31d7bcc0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1180089476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f4b3e3-63", "ovs_interfaceid": "04f4b3e3-634c-4285-b389-785cff1205ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:42:3b,bridge_name='br-int',has_traffic_filtering=True,id=04f4b3e3-634c-4285-b389-785cff1205ea,network=Network(7b7555f1-01f5-4ec4-a537-8dba31d7bcc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04f4b3e3-63') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780227733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780227733',id=11,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF57Qp6LzTZet9KO3h8AMaiCGc7mfI+8CAEfeVIWHvfo6+I5KOzjDqG6/Zv0iKBqb9dwSRVKram/F70Gwho1DzWHcABMdG5wg6wHBH7XqUEw1cWGufHs21TbIjLtuj9MVQ==',key_name='tempest-keypair-1977090372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f380efb37074b3399411fafb1deaa00',ramdisk_id='',reservation_id='r-x0omn3lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105688157',owner_user_name='tempest-TaggedBootDevicesTest-1105688157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb387c6b56014059a5ce18ffe642c3a0',uuid=7b1dc486-c6b5-4518-8da5-6042c97cbe55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78e098ef-09f4-4007-9e14-ebff143a4ba1", "address": "fa:16:3e:92:05:67", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78e098ef-09", "ovs_interfaceid": "78e098ef-09f4-4007-9e14-ebff143a4ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converting VIF {"id": "78e098ef-09f4-4007-9e14-ebff143a4ba1", "address": "fa:16:3e:92:05:67", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78e098ef-09", "ovs_interfaceid": "78e098ef-09f4-4007-9e14-ebff143a4ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:05:67,bridge_name='br-int',has_traffic_filtering=True,id=78e098ef-09f4-4007-9e14-ebff143a4ba1,network=Network(2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap78e098ef-09') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780227733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780227733',id=11,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF57Qp6LzTZet9KO3h8AMaiCGc7mfI+8CAEfeVIWHvfo6+I5KOzjDqG6/Zv0iKBqb9dwSRVKram/F70Gwho1DzWHcABMdG5wg6wHBH7XqUEw1cWGufHs21TbIjLtuj9MVQ==',key_name='tempest-keypair-1977090372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f380efb37074b3399411fafb1deaa00',ramdisk_id='',reservation_id='r-x0omn3lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105688157',owner_user_name='tempest-TaggedBootDevicesTest-1105688157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb387c6b56014059a5ce18ffe642c3a0',uuid=7b1dc486-c6b5-4518-8da5-6042c97cbe55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bbb73c1-6eda-416d-a9c8-6592c2abbea4", "address": "fa:16:3e:e8:f0:5f", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbb73c1-6e", "ovs_interfaceid": "0bbb73c1-6eda-416d-a9c8-6592c2abbea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converting VIF {"id": "0bbb73c1-6eda-416d-a9c8-6592c2abbea4", "address": "fa:16:3e:e8:f0:5f", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbb73c1-6e", "ovs_interfaceid": "0bbb73c1-6eda-416d-a9c8-6592c2abbea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:f0:5f,bridge_name='br-int',has_traffic_filtering=True,id=0bbb73c1-6eda-416d-a9c8-6592c2abbea4,network=Network(2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0bbb73c1-6e') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780227733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780227733',id=11,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF57Qp6LzTZet9KO3h8AMaiCGc7mfI+8CAEfeVIWHvfo6+I5KOzjDqG6/Zv0iKBqb9dwSRVKram/F70Gwho1DzWHcABMdG5wg6wHBH7XqUEw1cWGufHs21TbIjLtuj9MVQ==',key_name='tempest-keypair-1977090372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f380efb37074b3399411fafb1deaa00',ramdisk_id='',reservation_id='r-x0omn3lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105688157',owner_user_name='tempest-TaggedBootDevicesTest-1105688157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb387c6b56014059a5ce18ffe642c3a0',uuid=7b1dc486-c6b5-4518-8da5-6042c97cbe55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab41a728-624a-46a0-9fd6-0268c0b35f55", "address": "fa:16:3e:f1:76:22", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab41a728-62", "ovs_interfaceid": "ab41a728-624a-46a0-9fd6-0268c0b35f55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converting VIF {"id": "ab41a728-624a-46a0-9fd6-0268c0b35f55", "address": "fa:16:3e:f1:76:22", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab41a728-62", "ovs_interfaceid": "ab41a728-624a-46a0-9fd6-0268c0b35f55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:76:22,bridge_name='br-int',has_traffic_filtering=True,id=ab41a728-624a-46a0-9fd6-0268c0b35f55,network=Network(2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab41a728-62') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780227733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780227733',id=11,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF57Qp6LzTZet9KO3h8AMaiCGc7mfI+8CAEfeVIWHvfo6+I5KOzjDqG6/Zv0iKBqb9dwSRVKram/F70Gwho1DzWHcABMdG5wg6wHBH7XqUEw1cWGufHs21TbIjLtuj9MVQ==',key_name='tempest-keypair-1977090372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f380efb37074b3399411fafb1deaa00',ramdisk_id='',reservation_id='r-x0omn3lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105688157',owner_user_name='tempest-TaggedBootDevicesTest-1105688157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb387c6b56014059a5ce18ffe642c3a0',uuid=7b1dc486-c6b5-4518-8da5-6042c97cbe55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "091cb215-5fc9-4eb5-9aca-0751d5e41ea4", "address": "fa:16:3e:1f:ed:c6", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091cb215-5f", "ovs_interfaceid": "091cb215-5fc9-4eb5-9aca-0751d5e41ea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converting VIF {"id": "091cb215-5fc9-4eb5-9aca-0751d5e41ea4", "address": "fa:16:3e:1f:ed:c6", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091cb215-5f", "ovs_interfaceid": "091cb215-5fc9-4eb5-9aca-0751d5e41ea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:ed:c6,bridge_name='br-int',has_traffic_filtering=True,id=091cb215-5fc9-4eb5-9aca-0751d5e41ea4,network=Network(2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091cb215-5f') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780227733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780227733',id=11,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF57Qp6LzTZet9KO3h8AMaiCGc7mfI+8CAEfeVIWHvfo6+I5KOzjDqG6/Zv0iKBqb9dwSRVKram/F70Gwho1DzWHcABMdG5wg6wHBH7XqUEw1cWGufHs21TbIjLtuj9MVQ==',key_name='tempest-keypair-1977090372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f380efb37074b3399411fafb1deaa00',ramdisk_id='',reservation_id='r-x0omn3lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105688157',owner_user_name='tempest-TaggedBootDevicesTest-1105688157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb387c6b56014059a5ce18ffe642c3a0',uuid=7b1dc486-c6b5-4518-8da5-6042c97cbe55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fdd3936-9253-49a5-9f2d-6c2fdce456ea", "address": "fa:16:3e:e3:e9:a7", "network": {"id": "947450c5-5cd3-4c59-89ef-c5ac64194c29", "bridge": "br-int", "label": "tempest-device-tagging-net2-516735970", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdd3936-92", "ovs_interfaceid": "5fdd3936-9253-49a5-9f2d-6c2fdce456ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converting VIF {"id": "5fdd3936-9253-49a5-9f2d-6c2fdce456ea", "address": "fa:16:3e:e3:e9:a7", "network": {"id": "947450c5-5cd3-4c59-89ef-c5ac64194c29", "bridge": "br-int", "label": "tempest-device-tagging-net2-516735970", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdd3936-92", "ovs_interfaceid": "5fdd3936-9253-49a5-9f2d-6c2fdce456ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:e9:a7,bridge_name='br-int',has_traffic_filtering=True,id=5fdd3936-9253-49a5-9f2d-6c2fdce456ea,network=Network(947450c5-5cd3-4c59-89ef-c5ac64194c29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fdd3936-92') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780227733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780227733',id=11,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF57Qp6LzTZet9KO3h8AMaiCGc7mfI+8CAEfeVIWHvfo6+I5KOzjDqG6/Zv0iKBqb9dwSRVKram/F70Gwho1DzWHcABMdG5wg6wHBH7XqUEw1cWGufHs21TbIjLtuj9MVQ==',key_name='tempest-keypair-1977090372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f380efb37074b3399411fafb1deaa00',ramdisk_id='',reservation_id='r-x0omn3lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105688157',owner_user_name='tempest-TaggedBootDevicesTest-1105688157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb387c6b56014059a5ce18ffe642c3a0',uuid=7b1dc486-c6b5-4518-8da5-6042c97cbe55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dff8eb7c-ea5d-459e-a836-440097829dfd", "address": "fa:16:3e:61:a0:19", "network": {"id": "947450c5-5cd3-4c59-89ef-c5ac64194c29", "bridge": "br-int", "label": "tempest-device-tagging-net2-516735970", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff8eb7c-ea", "ovs_interfaceid": "dff8eb7c-ea5d-459e-a836-440097829dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converting VIF {"id": "dff8eb7c-ea5d-459e-a836-440097829dfd", "address": "fa:16:3e:61:a0:19", "network": {"id": "947450c5-5cd3-4c59-89ef-c5ac64194c29", "bridge": "br-int", "label": "tempest-device-tagging-net2-516735970", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff8eb7c-ea", "ovs_interfaceid": "dff8eb7c-ea5d-459e-a836-440097829dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:a0:19,bridge_name='br-int',has_traffic_filtering=True,id=dff8eb7c-ea5d-459e-a836-440097829dfd,network=Network(947450c5-5cd3-4c59-89ef-c5ac64194c29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff8eb7c-ea') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG nova.objects.instance [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b1dc486-c6b5-4518-8da5-6042c97cbe55 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:46:10 user nova-compute[74850]:   <uuid>7b1dc486-c6b5-4518-8da5-6042c97cbe55</uuid>
Nov 14 00:46:10 user nova-compute[74850]:   <name>instance-0000000b</name>
Nov 14 00:46:10 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:46:10 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:46:10 user nova-compute[74850]:   <metadata>
Nov 14 00:46:10 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:46:10 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:46:10 user nova-compute[74850]:       <nova:name>tempest-device-tagging-server-1780227733</nova:name>
Nov 14 00:46:10 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:46:03</nova:creationTime>
Nov 14 00:46:10 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:46:10 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:46:10 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:46:10 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:46:10 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:46:10 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:46:10 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:46:10 user nova-compute[74850]:       <nova:owner>
Nov 14 00:46:10 user nova-compute[74850]:         <nova:user uuid="fb387c6b56014059a5ce18ffe642c3a0">tempest-TaggedBootDevicesTest-1105688157-project-member</nova:user>
Nov 14 00:46:10 user nova-compute[74850]:         <nova:project uuid="2f380efb37074b3399411fafb1deaa00">tempest-TaggedBootDevicesTest-1105688157</nova:project>
Nov 14 00:46:10 user nova-compute[74850]:       </nova:owner>
Nov 14 00:46:10 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:46:10 user nova-compute[74850]:       <nova:ports>
Nov 14 00:46:10 user nova-compute[74850]:         <nova:port uuid="04f4b3e3-634c-4285-b389-785cff1205ea">
Nov 14 00:46:10 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 00:46:10 user nova-compute[74850]:         </nova:port>
Nov 14 00:46:10 user nova-compute[74850]:         <nova:port uuid="78e098ef-09f4-4007-9e14-ebff143a4ba1">
Nov 14 00:46:10 user nova-compute[74850]:           <nova:ip type="fixed" address="10.1.1.172" ipVersion="4"/>
Nov 14 00:46:10 user nova-compute[74850]:         </nova:port>
Nov 14 00:46:10 user nova-compute[74850]:         <nova:port uuid="0bbb73c1-6eda-416d-a9c8-6592c2abbea4">
Nov 14 00:46:10 user nova-compute[74850]:           <nova:ip type="fixed" address="10.1.1.112" ipVersion="4"/>
Nov 14 00:46:10 user nova-compute[74850]:         </nova:port>
Nov 14 00:46:10 user nova-compute[74850]:         <nova:port uuid="ab41a728-624a-46a0-9fd6-0268c0b35f55">
Nov 14 00:46:10 user nova-compute[74850]:           <nova:ip type="fixed" address="10.1.1.47" ipVersion="4"/>
Nov 14 00:46:10 user nova-compute[74850]:         </nova:port>
Nov 14 00:46:10 user nova-compute[74850]:         <nova:port uuid="091cb215-5fc9-4eb5-9aca-0751d5e41ea4">
Nov 14 00:46:10 user nova-compute[74850]:           <nova:ip type="fixed" address="10.1.1.163" ipVersion="4"/>
Nov 14 00:46:10 user nova-compute[74850]:         </nova:port>
Nov 14 00:46:10 user nova-compute[74850]:         <nova:port uuid="5fdd3936-9253-49a5-9f2d-6c2fdce456ea">
Nov 14 00:46:10 user nova-compute[74850]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 14 00:46:10 user nova-compute[74850]:         </nova:port>
Nov 14 00:46:10 user nova-compute[74850]:         <nova:port uuid="dff8eb7c-ea5d-459e-a836-440097829dfd">
Nov 14 00:46:10 user nova-compute[74850]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 14 00:46:10 user nova-compute[74850]:         </nova:port>
Nov 14 00:46:10 user nova-compute[74850]:       </nova:ports>
Nov 14 00:46:10 user nova-compute[74850]:     </nova:instance>
Nov 14 00:46:10 user nova-compute[74850]:   </metadata>
Nov 14 00:46:10 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:46:10 user nova-compute[74850]:     <system>
Nov 14 00:46:10 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:46:10 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:46:10 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:46:10 user nova-compute[74850]:       <entry name="serial">7b1dc486-c6b5-4518-8da5-6042c97cbe55</entry>
Nov 14 00:46:10 user nova-compute[74850]:       <entry name="uuid">7b1dc486-c6b5-4518-8da5-6042c97cbe55</entry>
Nov 14 00:46:10 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:46:10 user nova-compute[74850]:     </system>
Nov 14 00:46:10 user nova-compute[74850]:   </sysinfo>
Nov 14 00:46:10 user nova-compute[74850]:   <os>
Nov 14 00:46:10 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:46:10 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 00:46:10 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:46:10 user nova-compute[74850]:   </os>
Nov 14 00:46:10 user nova-compute[74850]:   <features>
Nov 14 00:46:10 user nova-compute[74850]:     <acpi/>
Nov 14 00:46:10 user nova-compute[74850]:     <apic/>
Nov 14 00:46:10 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:46:10 user nova-compute[74850]:   </features>
Nov 14 00:46:10 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:46:10 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:46:10 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:46:10 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:46:10 user nova-compute[74850]:   </clock>
Nov 14 00:46:10 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:46:10 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:46:10 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:46:10 user nova-compute[74850]:   </cpu>
Nov 14 00:46:10 user nova-compute[74850]:   <devices>
Nov 14 00:46:10 user nova-compute[74850]:     <disk type="file" device="cdrom">
Nov 14 00:46:10 user nova-compute[74850]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 00:46:10 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/7b1dc486-c6b5-4518-8da5-6042c97cbe55/disk.config"/>
Nov 14 00:46:10 user nova-compute[74850]:       <target dev="hda" bus="ide"/>
Nov 14 00:46:10 user nova-compute[74850]:     </disk>
Nov 14 00:46:10 user nova-compute[74850]:     <disk type="block" device="disk">
Nov 14 00:46:10 user nova-compute[74850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:46:10 user nova-compute[74850]:       <source dev="/dev/sdd"/>
Nov 14 00:46:10 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:46:10 user nova-compute[74850]:       <serial>866aee5f-8ea9-4a58-a6ee-1a4aee92f606</serial>
Nov 14 00:46:10 user nova-compute[74850]:     </disk>
Nov 14 00:46:10 user nova-compute[74850]:     <disk type="block" device="disk">
Nov 14 00:46:10 user nova-compute[74850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:46:10 user nova-compute[74850]:       <source dev="/dev/sdf"/>
Nov 14 00:46:10 user nova-compute[74850]:       <target dev="vdb" bus="virtio"/>
Nov 14 00:46:10 user nova-compute[74850]:       <serial>9283b1c4-11f9-41e1-986e-7141d0774fec</serial>
Nov 14 00:46:10 user nova-compute[74850]:     </disk>
Nov 14 00:46:10 user nova-compute[74850]:     <disk type="block" device="disk">
Nov 14 00:46:10 user nova-compute[74850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:46:10 user nova-compute[74850]:       <source dev="/dev/sdh"/>
Nov 14 00:46:10 user nova-compute[74850]:       <target dev="vdc" bus="virtio"/>
Nov 14 00:46:10 user nova-compute[74850]:       <serial>12497dec-be59-409e-8653-a094b2ef1c83</serial>
Nov 14 00:46:10 user nova-compute[74850]:     </disk>
Nov 14 00:46:10 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:46:10 user nova-compute[74850]:       <mac address="fa:16:3e:c0:42:3b"/>
Nov 14 00:46:10 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:46:10 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:46:10 user nova-compute[74850]:       <target dev="tap04f4b3e3-63"/>
Nov 14 00:46:10 user nova-compute[74850]:     </interface>
Nov 14 00:46:10 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:46:10 user nova-compute[74850]:       <mac address="fa:16:3e:92:05:67"/>
Nov 14 00:46:10 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:46:10 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:46:10 user nova-compute[74850]:       <target dev="tap78e098ef-09"/>
Nov 14 00:46:10 user nova-compute[74850]:     </interface>
Nov 14 00:46:10 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:46:10 user nova-compute[74850]:       <mac address="fa:16:3e:e8:f0:5f"/>
Nov 14 00:46:10 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:46:10 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:46:10 user nova-compute[74850]:       <target dev="tap0bbb73c1-6e"/>
Nov 14 00:46:10 user nova-compute[74850]:     </interface>
Nov 14 00:46:10 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:46:10 user nova-compute[74850]:       <mac address="fa:16:3e:f1:76:22"/>
Nov 14 00:46:10 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:46:10 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:46:10 user nova-compute[74850]:       <target dev="tapab41a728-62"/>
Nov 14 00:46:10 user nova-compute[74850]:     </interface>
Nov 14 00:46:10 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:46:10 user nova-compute[74850]:       <mac address="fa:16:3e:1f:ed:c6"/>
Nov 14 00:46:10 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:46:10 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:46:10 user nova-compute[74850]:       <target dev="tap091cb215-5f"/>
Nov 14 00:46:10 user nova-compute[74850]:     </interface>
Nov 14 00:46:10 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:46:10 user nova-compute[74850]:       <mac address="fa:16:3e:e3:e9:a7"/>
Nov 14 00:46:10 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:46:10 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:46:10 user nova-compute[74850]:       <target dev="tap5fdd3936-92"/>
Nov 14 00:46:10 user nova-compute[74850]:     </interface>
Nov 14 00:46:10 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:46:10 user nova-compute[74850]:       <mac address="fa:16:3e:61:a0:19"/>
Nov 14 00:46:10 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:46:10 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:46:10 user nova-compute[74850]:       <target dev="tapdff8eb7c-ea"/>
Nov 14 00:46:10 user nova-compute[74850]:     </interface>
Nov 14 00:46:10 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:46:10 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/7b1dc486-c6b5-4518-8da5-6042c97cbe55/console.log" append="off"/>
Nov 14 00:46:10 user nova-compute[74850]:     </serial>
Nov 14 00:46:10 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:46:10 user nova-compute[74850]:     <video>
Nov 14 00:46:10 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:46:10 user nova-compute[74850]:     </video>
Nov 14 00:46:10 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:46:10 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:46:10 user nova-compute[74850]:     </rng>
Nov 14 00:46:10 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:46:10 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:46:10 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:46:10 user nova-compute[74850]:     </memballoon>
Nov 14 00:46:10 user nova-compute[74850]:   </devices>
Nov 14 00:46:10 user nova-compute[74850]: </domain>
Nov 14 00:46:10 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780227733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780227733',id=11,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF57Qp6LzTZet9KO3h8AMaiCGc7mfI+8CAEfeVIWHvfo6+I5KOzjDqG6/Zv0iKBqb9dwSRVKram/F70Gwho1DzWHcABMdG5wg6wHBH7XqUEw1cWGufHs21TbIjLtuj9MVQ==',key_name='tempest-keypair-1977090372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f380efb37074b3399411fafb1deaa00',ramdisk_id='',reservation_id='r-x0omn3lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105688157',owner_user_name='tempest-TaggedBootDevicesTest-1105688157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb387c6b56014059a5ce18ffe642c3a0',uuid=7b1dc486-c6b5-4518-8da5-6042c97cbe55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04f4b3e3-634c-4285-b389-785cff1205ea", "address": "fa:16:3e:c0:42:3b", "network": {"id": "7b7555f1-01f5-4ec4-a537-8dba31d7bcc0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1180089476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f4b3e3-63", "ovs_interfaceid": "04f4b3e3-634c-4285-b389-785cff1205ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converting VIF {"id": "04f4b3e3-634c-4285-b389-785cff1205ea", "address": "fa:16:3e:c0:42:3b", "network": {"id": "7b7555f1-01f5-4ec4-a537-8dba31d7bcc0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1180089476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f4b3e3-63", "ovs_interfaceid": "04f4b3e3-634c-4285-b389-785cff1205ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:42:3b,bridge_name='br-int',has_traffic_filtering=True,id=04f4b3e3-634c-4285-b389-785cff1205ea,network=Network(7b7555f1-01f5-4ec4-a537-8dba31d7bcc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04f4b3e3-63') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG os_vif [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:42:3b,bridge_name='br-int',has_traffic_filtering=True,id=04f4b3e3-634c-4285-b389-785cff1205ea,network=Network(7b7555f1-01f5-4ec4-a537-8dba31d7bcc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04f4b3e3-63') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd327a6fe-30d1-5d5f-897c-4821a95e821d', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04f4b3e3-63, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap04f4b3e3-63, col_values=(('qos', UUID('b4c071cf-6dcf-4d2d-b7ce-2d1596e65c61')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap04f4b3e3-63, col_values=(('external_ids', {'iface-id': '04f4b3e3-634c-4285-b389-785cff1205ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:42:3b', 'vm-uuid': '7b1dc486-c6b5-4518-8da5-6042c97cbe55'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:10 user nova-compute[74850]: INFO os_vif [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:42:3b,bridge_name='br-int',has_traffic_filtering=True,id=04f4b3e3-634c-4285-b389-785cff1205ea,network=Network(7b7555f1-01f5-4ec4-a537-8dba31d7bcc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04f4b3e3-63')
Nov 14 00:46:10 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780227733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780227733',id=11,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF57Qp6LzTZet9KO3h8AMaiCGc7mfI+8CAEfeVIWHvfo6+I5KOzjDqG6/Zv0iKBqb9dwSRVKram/F70Gwho1DzWHcABMdG5wg6wHBH7XqUEw1cWGufHs21TbIjLtuj9MVQ==',key_name='tempest-keypair-1977090372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f380efb37074b3399411fafb1deaa00',ramdisk_id='',reservation_id='r-x0omn3lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105688157',owner_user_name='tempest-TaggedBootDevicesTest-1105688157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb387c6b56014059a5ce18ffe642c3a0',uuid=7b1dc486-c6b5-4518-8da5-6042c97cbe55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78e098ef-09f4-4007-9e14-ebff143a4ba1", "address": "fa:16:3e:92:05:67", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78e098ef-09", "ovs_interfaceid": "78e098ef-09f4-4007-9e14-ebff143a4ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converting VIF {"id": "78e098ef-09f4-4007-9e14-ebff143a4ba1", "address": "fa:16:3e:92:05:67", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78e098ef-09", "ovs_interfaceid": "78e098ef-09f4-4007-9e14-ebff143a4ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:05:67,bridge_name='br-int',has_traffic_filtering=True,id=78e098ef-09f4-4007-9e14-ebff143a4ba1,network=Network(2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap78e098ef-09') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG os_vif [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:05:67,bridge_name='br-int',has_traffic_filtering=True,id=78e098ef-09f4-4007-9e14-ebff143a4ba1,network=Network(2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap78e098ef-09') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '79f08da9-fc63-5fbd-a20a-8995afee132f', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78e098ef-09, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap78e098ef-09, col_values=(('qos', UUID('9d3f289f-68e4-40af-9a1e-bcc21f943706')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap78e098ef-09, col_values=(('external_ids', {'iface-id': '78e098ef-09f4-4007-9e14-ebff143a4ba1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:05:67', 'vm-uuid': '7b1dc486-c6b5-4518-8da5-6042c97cbe55'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:10 user nova-compute[74850]: INFO os_vif [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:05:67,bridge_name='br-int',has_traffic_filtering=True,id=78e098ef-09f4-4007-9e14-ebff143a4ba1,network=Network(2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap78e098ef-09')
Nov 14 00:46:10 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780227733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780227733',id=11,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF57Qp6LzTZet9KO3h8AMaiCGc7mfI+8CAEfeVIWHvfo6+I5KOzjDqG6/Zv0iKBqb9dwSRVKram/F70Gwho1DzWHcABMdG5wg6wHBH7XqUEw1cWGufHs21TbIjLtuj9MVQ==',key_name='tempest-keypair-1977090372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f380efb37074b3399411fafb1deaa00',ramdisk_id='',reservation_id='r-x0omn3lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105688157',owner_user_name='tempest-TaggedBootDevicesTest-1105688157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb387c6b56014059a5ce18ffe642c3a0',uuid=7b1dc486-c6b5-4518-8da5-6042c97cbe55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bbb73c1-6eda-416d-a9c8-6592c2abbea4", "address": "fa:16:3e:e8:f0:5f", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbb73c1-6e", "ovs_interfaceid": "0bbb73c1-6eda-416d-a9c8-6592c2abbea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converting VIF {"id": "0bbb73c1-6eda-416d-a9c8-6592c2abbea4", "address": "fa:16:3e:e8:f0:5f", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbb73c1-6e", "ovs_interfaceid": "0bbb73c1-6eda-416d-a9c8-6592c2abbea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:f0:5f,bridge_name='br-int',has_traffic_filtering=True,id=0bbb73c1-6eda-416d-a9c8-6592c2abbea4,network=Network(2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0bbb73c1-6e') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG os_vif [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:f0:5f,bridge_name='br-int',has_traffic_filtering=True,id=0bbb73c1-6eda-416d-a9c8-6592c2abbea4,network=Network(2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0bbb73c1-6e') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1ceb81be-0181-594e-9352-df91d4197b04', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0bbb73c1-6e, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0bbb73c1-6e, col_values=(('qos', UUID('cdef3a26-45de-4b5a-8e3a-774dfa851729')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0bbb73c1-6e, col_values=(('external_ids', {'iface-id': '0bbb73c1-6eda-416d-a9c8-6592c2abbea4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:f0:5f', 'vm-uuid': '7b1dc486-c6b5-4518-8da5-6042c97cbe55'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:10 user nova-compute[74850]: INFO os_vif [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:f0:5f,bridge_name='br-int',has_traffic_filtering=True,id=0bbb73c1-6eda-416d-a9c8-6592c2abbea4,network=Network(2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0bbb73c1-6e')
Nov 14 00:46:10 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780227733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780227733',id=11,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF57Qp6LzTZet9KO3h8AMaiCGc7mfI+8CAEfeVIWHvfo6+I5KOzjDqG6/Zv0iKBqb9dwSRVKram/F70Gwho1DzWHcABMdG5wg6wHBH7XqUEw1cWGufHs21TbIjLtuj9MVQ==',key_name='tempest-keypair-1977090372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f380efb37074b3399411fafb1deaa00',ramdisk_id='',reservation_id='r-x0omn3lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105688157',owner_user_name='tempest-TaggedBootDevicesTest-1105688157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb387c6b56014059a5ce18ffe642c3a0',uuid=7b1dc486-c6b5-4518-8da5-6042c97cbe55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab41a728-624a-46a0-9fd6-0268c0b35f55", "address": "fa:16:3e:f1:76:22", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab41a728-62", "ovs_interfaceid": "ab41a728-624a-46a0-9fd6-0268c0b35f55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converting VIF {"id": "ab41a728-624a-46a0-9fd6-0268c0b35f55", "address": "fa:16:3e:f1:76:22", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab41a728-62", "ovs_interfaceid": "ab41a728-624a-46a0-9fd6-0268c0b35f55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:76:22,bridge_name='br-int',has_traffic_filtering=True,id=ab41a728-624a-46a0-9fd6-0268c0b35f55,network=Network(2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab41a728-62') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG os_vif [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:76:22,bridge_name='br-int',has_traffic_filtering=True,id=ab41a728-624a-46a0-9fd6-0268c0b35f55,network=Network(2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab41a728-62') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3092cc11-f93a-5217-b7ad-97567f462bfa', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab41a728-62, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab41a728-62, col_values=(('qos', UUID('82323faa-aa28-4670-bef2-593fdc9b1f8f')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab41a728-62, col_values=(('external_ids', {'iface-id': 'ab41a728-624a-46a0-9fd6-0268c0b35f55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:76:22', 'vm-uuid': '7b1dc486-c6b5-4518-8da5-6042c97cbe55'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:10 user nova-compute[74850]: INFO os_vif [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:76:22,bridge_name='br-int',has_traffic_filtering=True,id=ab41a728-624a-46a0-9fd6-0268c0b35f55,network=Network(2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab41a728-62')
Nov 14 00:46:10 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780227733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780227733',id=11,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF57Qp6LzTZet9KO3h8AMaiCGc7mfI+8CAEfeVIWHvfo6+I5KOzjDqG6/Zv0iKBqb9dwSRVKram/F70Gwho1DzWHcABMdG5wg6wHBH7XqUEw1cWGufHs21TbIjLtuj9MVQ==',key_name='tempest-keypair-1977090372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f380efb37074b3399411fafb1deaa00',ramdisk_id='',reservation_id='r-x0omn3lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105688157',owner_user_name='tempest-TaggedBootDevicesTest-1105688157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb387c6b56014059a5ce18ffe642c3a0',uuid=7b1dc486-c6b5-4518-8da5-6042c97cbe55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "091cb215-5fc9-4eb5-9aca-0751d5e41ea4", "address": "fa:16:3e:1f:ed:c6", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091cb215-5f", "ovs_interfaceid": "091cb215-5fc9-4eb5-9aca-0751d5e41ea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converting VIF {"id": "091cb215-5fc9-4eb5-9aca-0751d5e41ea4", "address": "fa:16:3e:1f:ed:c6", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091cb215-5f", "ovs_interfaceid": "091cb215-5fc9-4eb5-9aca-0751d5e41ea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:ed:c6,bridge_name='br-int',has_traffic_filtering=True,id=091cb215-5fc9-4eb5-9aca-0751d5e41ea4,network=Network(2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091cb215-5f') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG os_vif [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:ed:c6,bridge_name='br-int',has_traffic_filtering=True,id=091cb215-5fc9-4eb5-9aca-0751d5e41ea4,network=Network(2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091cb215-5f') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad5291f0-e214-5b04-9e27-624a575a5b81', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap091cb215-5f, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap091cb215-5f, col_values=(('qos', UUID('e8fa6c52-1abc-411a-8d62-c5d089c9d9df')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap091cb215-5f, col_values=(('external_ids', {'iface-id': '091cb215-5fc9-4eb5-9aca-0751d5e41ea4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:ed:c6', 'vm-uuid': '7b1dc486-c6b5-4518-8da5-6042c97cbe55'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:11 user nova-compute[74850]: INFO os_vif [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:ed:c6,bridge_name='br-int',has_traffic_filtering=True,id=091cb215-5fc9-4eb5-9aca-0751d5e41ea4,network=Network(2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091cb215-5f')
Nov 14 00:46:11 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780227733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780227733',id=11,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF57Qp6LzTZet9KO3h8AMaiCGc7mfI+8CAEfeVIWHvfo6+I5KOzjDqG6/Zv0iKBqb9dwSRVKram/F70Gwho1DzWHcABMdG5wg6wHBH7XqUEw1cWGufHs21TbIjLtuj9MVQ==',key_name='tempest-keypair-1977090372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f380efb37074b3399411fafb1deaa00',ramdisk_id='',reservation_id='r-x0omn3lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105688157',owner_user_name='tempest-TaggedBootDevicesTest-1105688157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb387c6b56014059a5ce18ffe642c3a0',uuid=7b1dc486-c6b5-4518-8da5-6042c97cbe55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fdd3936-9253-49a5-9f2d-6c2fdce456ea", "address": "fa:16:3e:e3:e9:a7", "network": {"id": "947450c5-5cd3-4c59-89ef-c5ac64194c29", "bridge": "br-int", "label": "tempest-device-tagging-net2-516735970", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdd3936-92", "ovs_interfaceid": "5fdd3936-9253-49a5-9f2d-6c2fdce456ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converting VIF {"id": "5fdd3936-9253-49a5-9f2d-6c2fdce456ea", "address": "fa:16:3e:e3:e9:a7", "network": {"id": "947450c5-5cd3-4c59-89ef-c5ac64194c29", "bridge": "br-int", "label": "tempest-device-tagging-net2-516735970", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdd3936-92", "ovs_interfaceid": "5fdd3936-9253-49a5-9f2d-6c2fdce456ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:e9:a7,bridge_name='br-int',has_traffic_filtering=True,id=5fdd3936-9253-49a5-9f2d-6c2fdce456ea,network=Network(947450c5-5cd3-4c59-89ef-c5ac64194c29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fdd3936-92') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG os_vif [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:e9:a7,bridge_name='br-int',has_traffic_filtering=True,id=5fdd3936-9253-49a5-9f2d-6c2fdce456ea,network=Network(947450c5-5cd3-4c59-89ef-c5ac64194c29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fdd3936-92') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fce74dd7-13ac-57f5-9559-cc4a1ba9753e', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5fdd3936-92, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5fdd3936-92, col_values=(('qos', UUID('4ed4768d-793e-4d7d-8582-d34db799eb0a')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5fdd3936-92, col_values=(('external_ids', {'iface-id': '5fdd3936-9253-49a5-9f2d-6c2fdce456ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:e9:a7', 'vm-uuid': '7b1dc486-c6b5-4518-8da5-6042c97cbe55'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:11 user nova-compute[74850]: INFO os_vif [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:e9:a7,bridge_name='br-int',has_traffic_filtering=True,id=5fdd3936-9253-49a5-9f2d-6c2fdce456ea,network=Network(947450c5-5cd3-4c59-89ef-c5ac64194c29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fdd3936-92')
Nov 14 00:46:11 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780227733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780227733',id=11,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF57Qp6LzTZet9KO3h8AMaiCGc7mfI+8CAEfeVIWHvfo6+I5KOzjDqG6/Zv0iKBqb9dwSRVKram/F70Gwho1DzWHcABMdG5wg6wHBH7XqUEw1cWGufHs21TbIjLtuj9MVQ==',key_name='tempest-keypair-1977090372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f380efb37074b3399411fafb1deaa00',ramdisk_id='',reservation_id='r-x0omn3lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105688157',owner_user_name='tempest-TaggedBootDevicesTest-1105688157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb387c6b56014059a5ce18ffe642c3a0',uuid=7b1dc486-c6b5-4518-8da5-6042c97cbe55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dff8eb7c-ea5d-459e-a836-440097829dfd", "address": "fa:16:3e:61:a0:19", "network": {"id": "947450c5-5cd3-4c59-89ef-c5ac64194c29", "bridge": "br-int", "label": "tempest-device-tagging-net2-516735970", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff8eb7c-ea", "ovs_interfaceid": "dff8eb7c-ea5d-459e-a836-440097829dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converting VIF {"id": "dff8eb7c-ea5d-459e-a836-440097829dfd", "address": "fa:16:3e:61:a0:19", "network": {"id": "947450c5-5cd3-4c59-89ef-c5ac64194c29", "bridge": "br-int", "label": "tempest-device-tagging-net2-516735970", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff8eb7c-ea", "ovs_interfaceid": "dff8eb7c-ea5d-459e-a836-440097829dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:a0:19,bridge_name='br-int',has_traffic_filtering=True,id=dff8eb7c-ea5d-459e-a836-440097829dfd,network=Network(947450c5-5cd3-4c59-89ef-c5ac64194c29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff8eb7c-ea') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG os_vif [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:a0:19,bridge_name='br-int',has_traffic_filtering=True,id=dff8eb7c-ea5d-459e-a836-440097829dfd,network=Network(947450c5-5cd3-4c59-89ef-c5ac64194c29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff8eb7c-ea') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c4014c9c-edab-5386-a9fb-38bf382ff8fb', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG nova.compute.manager [req-6aef62bf-c83b-490c-bc54-4f90b0ed66c1 req-48b45984-1aca-4e0d-91b5-66075acc0e4b service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-plugged-9a03ed99-51c7-49e9-abbb-dc338dd795ff {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6aef62bf-c83b-490c-bc54-4f90b0ed66c1 req-48b45984-1aca-4e0d-91b5-66075acc0e4b service nova] Acquiring lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6aef62bf-c83b-490c-bc54-4f90b0ed66c1 req-48b45984-1aca-4e0d-91b5-66075acc0e4b service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6aef62bf-c83b-490c-bc54-4f90b0ed66c1 req-48b45984-1aca-4e0d-91b5-66075acc0e4b service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG nova.compute.manager [req-6aef62bf-c83b-490c-bc54-4f90b0ed66c1 req-48b45984-1aca-4e0d-91b5-66075acc0e4b service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] No waiting events found dispatching network-vif-plugged-9a03ed99-51c7-49e9-abbb-dc338dd795ff {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:46:11 user nova-compute[74850]: WARNING nova.compute.manager [req-6aef62bf-c83b-490c-bc54-4f90b0ed66c1 req-48b45984-1aca-4e0d-91b5-66075acc0e4b service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received unexpected event network-vif-plugged-9a03ed99-51c7-49e9-abbb-dc338dd795ff for instance with vm_state building and task_state spawning.
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdff8eb7c-ea, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdff8eb7c-ea, col_values=(('qos', UUID('9c6069c1-8081-433e-bbce-3f5ca52f5683')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdff8eb7c-ea, col_values=(('external_ids', {'iface-id': 'dff8eb7c-ea5d-459e-a836-440097829dfd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:a0:19', 'vm-uuid': '7b1dc486-c6b5-4518-8da5-6042c97cbe55'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:12 user nova-compute[74850]: INFO os_vif [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:a0:19,bridge_name='br-int',has_traffic_filtering=True,id=dff8eb7c-ea5d-459e-a836-440097829dfd,network=Network(947450c5-5cd3-4c59-89ef-c5ac64194c29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff8eb7c-ea')
Nov 14 00:46:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:12 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] No BDM found with device name hda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:46:12 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:46:12 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] No VIF found with MAC fa:16:3e:c0:42:3b, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:46:12 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] No VIF found with MAC fa:16:3e:1f:ed:c6, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:46:12 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Using config drive
Nov 14 00:46:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:12 user nova-compute[74850]: DEBUG nova.compute.manager [req-9c5f148c-7d10-4c24-be7a-3fe74cd4e23a req-8c897e59-1bb5-4c00-a086-963985806f7a service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-plugged-3b861886-0054-400a-b163-35945d498927 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:46:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9c5f148c-7d10-4c24-be7a-3fe74cd4e23a req-8c897e59-1bb5-4c00-a086-963985806f7a service nova] Acquiring lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9c5f148c-7d10-4c24-be7a-3fe74cd4e23a req-8c897e59-1bb5-4c00-a086-963985806f7a service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9c5f148c-7d10-4c24-be7a-3fe74cd4e23a req-8c897e59-1bb5-4c00-a086-963985806f7a service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:12 user nova-compute[74850]: DEBUG nova.compute.manager [req-9c5f148c-7d10-4c24-be7a-3fe74cd4e23a req-8c897e59-1bb5-4c00-a086-963985806f7a service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] No waiting events found dispatching network-vif-plugged-3b861886-0054-400a-b163-35945d498927 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:46:12 user nova-compute[74850]: WARNING nova.compute.manager [req-9c5f148c-7d10-4c24-be7a-3fe74cd4e23a req-8c897e59-1bb5-4c00-a086-963985806f7a service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received unexpected event network-vif-plugged-3b861886-0054-400a-b163-35945d498927 for instance with vm_state building and task_state spawning.
Nov 14 00:46:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:12 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Creating config drive at /opt/stack/data/nova/instances/7b1dc486-c6b5-4518-8da5-6042c97cbe55/disk.config
Nov 14 00:46:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7b1dc486-c6b5-4518-8da5-6042c97cbe55/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp0m8nru81 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7b1dc486-c6b5-4518-8da5-6042c97cbe55/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp0m8nru81" returned: 0 in 0.083s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:13 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:13 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:13 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:13 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:13 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:13 user nova-compute[74850]: DEBUG nova.compute.manager [req-ddfeeaf8-f275-4cf1-a50e-124c2d9ce6e1 req-62cbb345-ad7b-4699-8e99-5c834234c74f service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-plugged-457e3066-b6bf-4d67-9c40-d1437ef901a3 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:46:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ddfeeaf8-f275-4cf1-a50e-124c2d9ce6e1 req-62cbb345-ad7b-4699-8e99-5c834234c74f service nova] Acquiring lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ddfeeaf8-f275-4cf1-a50e-124c2d9ce6e1 req-62cbb345-ad7b-4699-8e99-5c834234c74f service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ddfeeaf8-f275-4cf1-a50e-124c2d9ce6e1 req-62cbb345-ad7b-4699-8e99-5c834234c74f service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:13 user nova-compute[74850]: DEBUG nova.compute.manager [req-ddfeeaf8-f275-4cf1-a50e-124c2d9ce6e1 req-62cbb345-ad7b-4699-8e99-5c834234c74f service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] No waiting events found dispatching network-vif-plugged-457e3066-b6bf-4d67-9c40-d1437ef901a3 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:46:13 user nova-compute[74850]: WARNING nova.compute.manager [req-ddfeeaf8-f275-4cf1-a50e-124c2d9ce6e1 req-62cbb345-ad7b-4699-8e99-5c834234c74f service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received unexpected event network-vif-plugged-457e3066-b6bf-4d67-9c40-d1437ef901a3 for instance with vm_state building and task_state spawning.
Nov 14 00:46:13 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:13 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:13 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:13 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:13 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:13 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:13 user nova-compute[74850]: DEBUG nova.compute.manager [req-9e3fd33e-763e-4559-a0fb-252cc8c40f12 req-41e9d8ae-91fa-4710-8b4b-09f8a245e7e6 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-plugged-9a03ed99-51c7-49e9-abbb-dc338dd795ff {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:46:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9e3fd33e-763e-4559-a0fb-252cc8c40f12 req-41e9d8ae-91fa-4710-8b4b-09f8a245e7e6 service nova] Acquiring lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9e3fd33e-763e-4559-a0fb-252cc8c40f12 req-41e9d8ae-91fa-4710-8b4b-09f8a245e7e6 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9e3fd33e-763e-4559-a0fb-252cc8c40f12 req-41e9d8ae-91fa-4710-8b4b-09f8a245e7e6 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:13 user nova-compute[74850]: DEBUG nova.compute.manager [req-9e3fd33e-763e-4559-a0fb-252cc8c40f12 req-41e9d8ae-91fa-4710-8b4b-09f8a245e7e6 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] No waiting events found dispatching network-vif-plugged-9a03ed99-51c7-49e9-abbb-dc338dd795ff {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:46:13 user nova-compute[74850]: WARNING nova.compute.manager [req-9e3fd33e-763e-4559-a0fb-252cc8c40f12 req-41e9d8ae-91fa-4710-8b4b-09f8a245e7e6 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received unexpected event network-vif-plugged-9a03ed99-51c7-49e9-abbb-dc338dd795ff for instance with vm_state building and task_state spawning.
Nov 14 00:46:13 user nova-compute[74850]: DEBUG nova.compute.manager [req-9e3fd33e-763e-4559-a0fb-252cc8c40f12 req-41e9d8ae-91fa-4710-8b4b-09f8a245e7e6 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-plugged-447494fb-fc40-41f9-94d9-d1c39434a22d {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:46:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9e3fd33e-763e-4559-a0fb-252cc8c40f12 req-41e9d8ae-91fa-4710-8b4b-09f8a245e7e6 service nova] Acquiring lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9e3fd33e-763e-4559-a0fb-252cc8c40f12 req-41e9d8ae-91fa-4710-8b4b-09f8a245e7e6 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9e3fd33e-763e-4559-a0fb-252cc8c40f12 req-41e9d8ae-91fa-4710-8b4b-09f8a245e7e6 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:13 user nova-compute[74850]: DEBUG nova.compute.manager [req-9e3fd33e-763e-4559-a0fb-252cc8c40f12 req-41e9d8ae-91fa-4710-8b4b-09f8a245e7e6 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] No waiting events found dispatching network-vif-plugged-447494fb-fc40-41f9-94d9-d1c39434a22d {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:46:13 user nova-compute[74850]: WARNING nova.compute.manager [req-9e3fd33e-763e-4559-a0fb-252cc8c40f12 req-41e9d8ae-91fa-4710-8b4b-09f8a245e7e6 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received unexpected event network-vif-plugged-447494fb-fc40-41f9-94d9-d1c39434a22d for instance with vm_state building and task_state spawning.
Nov 14 00:46:13 user nova-compute[74850]: DEBUG nova.compute.manager [req-9e3fd33e-763e-4559-a0fb-252cc8c40f12 req-41e9d8ae-91fa-4710-8b4b-09f8a245e7e6 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-plugged-447494fb-fc40-41f9-94d9-d1c39434a22d {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:46:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9e3fd33e-763e-4559-a0fb-252cc8c40f12 req-41e9d8ae-91fa-4710-8b4b-09f8a245e7e6 service nova] Acquiring lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9e3fd33e-763e-4559-a0fb-252cc8c40f12 req-41e9d8ae-91fa-4710-8b4b-09f8a245e7e6 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9e3fd33e-763e-4559-a0fb-252cc8c40f12 req-41e9d8ae-91fa-4710-8b4b-09f8a245e7e6 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:13 user nova-compute[74850]: DEBUG nova.compute.manager [req-9e3fd33e-763e-4559-a0fb-252cc8c40f12 req-41e9d8ae-91fa-4710-8b4b-09f8a245e7e6 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] No waiting events found dispatching network-vif-plugged-447494fb-fc40-41f9-94d9-d1c39434a22d {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:46:13 user nova-compute[74850]: WARNING nova.compute.manager [req-9e3fd33e-763e-4559-a0fb-252cc8c40f12 req-41e9d8ae-91fa-4710-8b4b-09f8a245e7e6 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received unexpected event network-vif-plugged-447494fb-fc40-41f9-94d9-d1c39434a22d for instance with vm_state building and task_state spawning.
Nov 14 00:46:13 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:13 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:14 user nova-compute[74850]: DEBUG nova.compute.manager [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-plugged-3b861886-0054-400a-b163-35945d498927 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:46:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] Acquiring lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:14 user nova-compute[74850]: DEBUG nova.compute.manager [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] No waiting events found dispatching network-vif-plugged-3b861886-0054-400a-b163-35945d498927 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:46:14 user nova-compute[74850]: WARNING nova.compute.manager [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received unexpected event network-vif-plugged-3b861886-0054-400a-b163-35945d498927 for instance with vm_state building and task_state spawning.
Nov 14 00:46:14 user nova-compute[74850]: DEBUG nova.compute.manager [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-plugged-381f68d0-96e0-404e-93e6-d166732e2df8 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:46:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] Acquiring lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:14 user nova-compute[74850]: DEBUG nova.compute.manager [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] No waiting events found dispatching network-vif-plugged-381f68d0-96e0-404e-93e6-d166732e2df8 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:46:14 user nova-compute[74850]: WARNING nova.compute.manager [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received unexpected event network-vif-plugged-381f68d0-96e0-404e-93e6-d166732e2df8 for instance with vm_state building and task_state spawning.
Nov 14 00:46:14 user nova-compute[74850]: DEBUG nova.compute.manager [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-plugged-381f68d0-96e0-404e-93e6-d166732e2df8 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:46:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] Acquiring lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:14 user nova-compute[74850]: DEBUG nova.compute.manager [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] No waiting events found dispatching network-vif-plugged-381f68d0-96e0-404e-93e6-d166732e2df8 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:46:14 user nova-compute[74850]: WARNING nova.compute.manager [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received unexpected event network-vif-plugged-381f68d0-96e0-404e-93e6-d166732e2df8 for instance with vm_state building and task_state spawning.
Nov 14 00:46:14 user nova-compute[74850]: DEBUG nova.compute.manager [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-plugged-70f458ad-d5db-47a5-9ab1-b776a8fdbb98 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:46:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] Acquiring lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:14 user nova-compute[74850]: DEBUG nova.compute.manager [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] No waiting events found dispatching network-vif-plugged-70f458ad-d5db-47a5-9ab1-b776a8fdbb98 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:46:14 user nova-compute[74850]: WARNING nova.compute.manager [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received unexpected event network-vif-plugged-70f458ad-d5db-47a5-9ab1-b776a8fdbb98 for instance with vm_state building and task_state spawning.
Nov 14 00:46:14 user nova-compute[74850]: DEBUG nova.compute.manager [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-plugged-70f458ad-d5db-47a5-9ab1-b776a8fdbb98 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:46:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] Acquiring lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:14 user nova-compute[74850]: DEBUG nova.compute.manager [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] No waiting events found dispatching network-vif-plugged-70f458ad-d5db-47a5-9ab1-b776a8fdbb98 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:46:14 user nova-compute[74850]: WARNING nova.compute.manager [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received unexpected event network-vif-plugged-70f458ad-d5db-47a5-9ab1-b776a8fdbb98 for instance with vm_state building and task_state spawning.
Nov 14 00:46:14 user nova-compute[74850]: DEBUG nova.compute.manager [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-plugged-14239fc2-af2c-4d50-9f58-9758fe0f1221 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:46:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] Acquiring lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:14 user nova-compute[74850]: DEBUG nova.compute.manager [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] No waiting events found dispatching network-vif-plugged-14239fc2-af2c-4d50-9f58-9758fe0f1221 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:46:14 user nova-compute[74850]: WARNING nova.compute.manager [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received unexpected event network-vif-plugged-14239fc2-af2c-4d50-9f58-9758fe0f1221 for instance with vm_state building and task_state spawning.
Nov 14 00:46:14 user nova-compute[74850]: DEBUG nova.compute.manager [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-plugged-14239fc2-af2c-4d50-9f58-9758fe0f1221 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:46:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] Acquiring lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:14 user nova-compute[74850]: DEBUG nova.compute.manager [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] No waiting events found dispatching network-vif-plugged-14239fc2-af2c-4d50-9f58-9758fe0f1221 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:46:14 user nova-compute[74850]: WARNING nova.compute.manager [req-e511cad0-f4e2-40ec-9830-7260db449973 req-cc1929cb-e6ab-4ad1-898d-99d76ca5a656 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received unexpected event network-vif-plugged-14239fc2-af2c-4d50-9f58-9758fe0f1221 for instance with vm_state building and task_state spawning.
Nov 14 00:46:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:15 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:15 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:15 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:15 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:15 user nova-compute[74850]: DEBUG nova.compute.manager [req-21d56403-42a4-4fad-81e9-8fd78154ef0d req-b81dfc39-5222-4b84-9680-9322aeb46d23 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-plugged-457e3066-b6bf-4d67-9c40-d1437ef901a3 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:46:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-21d56403-42a4-4fad-81e9-8fd78154ef0d req-b81dfc39-5222-4b84-9680-9322aeb46d23 service nova] Acquiring lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-21d56403-42a4-4fad-81e9-8fd78154ef0d req-b81dfc39-5222-4b84-9680-9322aeb46d23 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-21d56403-42a4-4fad-81e9-8fd78154ef0d req-b81dfc39-5222-4b84-9680-9322aeb46d23 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:15 user nova-compute[74850]: DEBUG nova.compute.manager [req-21d56403-42a4-4fad-81e9-8fd78154ef0d req-b81dfc39-5222-4b84-9680-9322aeb46d23 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] No waiting events found dispatching network-vif-plugged-457e3066-b6bf-4d67-9c40-d1437ef901a3 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:46:15 user nova-compute[74850]: WARNING nova.compute.manager [req-21d56403-42a4-4fad-81e9-8fd78154ef0d req-b81dfc39-5222-4b84-9680-9322aeb46d23 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received unexpected event network-vif-plugged-457e3066-b6bf-4d67-9c40-d1437ef901a3 for instance with vm_state building and task_state spawning.
Nov 14 00:46:15 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:15 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:15 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:15 user nova-compute[74850]: DEBUG nova.compute.manager [req-bf12a82c-f2d8-42f1-ba49-3cf929573953 req-bd2f1baa-3c1a-4d2b-ac29-7a9515e0157d service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-plugged-78e098ef-09f4-4007-9e14-ebff143a4ba1 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:46:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-bf12a82c-f2d8-42f1-ba49-3cf929573953 req-bd2f1baa-3c1a-4d2b-ac29-7a9515e0157d service nova] Acquiring lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-bf12a82c-f2d8-42f1-ba49-3cf929573953 req-bd2f1baa-3c1a-4d2b-ac29-7a9515e0157d service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-bf12a82c-f2d8-42f1-ba49-3cf929573953 req-bd2f1baa-3c1a-4d2b-ac29-7a9515e0157d service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:15 user nova-compute[74850]: DEBUG nova.compute.manager [req-bf12a82c-f2d8-42f1-ba49-3cf929573953 req-bd2f1baa-3c1a-4d2b-ac29-7a9515e0157d service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] No waiting events found dispatching network-vif-plugged-78e098ef-09f4-4007-9e14-ebff143a4ba1 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:46:15 user nova-compute[74850]: WARNING nova.compute.manager [req-bf12a82c-f2d8-42f1-ba49-3cf929573953 req-bd2f1baa-3c1a-4d2b-ac29-7a9515e0157d service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received unexpected event network-vif-plugged-78e098ef-09f4-4007-9e14-ebff143a4ba1 for instance with vm_state building and task_state spawning.
Nov 14 00:46:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG nova.compute.manager [req-7ef3bfdb-ced8-40b3-ae8c-2584cb94cc2d req-24952434-f3a7-4e5d-bfe9-48c79597a42b service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-plugged-04f4b3e3-634c-4285-b389-785cff1205ea {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7ef3bfdb-ced8-40b3-ae8c-2584cb94cc2d req-24952434-f3a7-4e5d-bfe9-48c79597a42b service nova] Acquiring lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7ef3bfdb-ced8-40b3-ae8c-2584cb94cc2d req-24952434-f3a7-4e5d-bfe9-48c79597a42b service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7ef3bfdb-ced8-40b3-ae8c-2584cb94cc2d req-24952434-f3a7-4e5d-bfe9-48c79597a42b service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG nova.compute.manager [req-7ef3bfdb-ced8-40b3-ae8c-2584cb94cc2d req-24952434-f3a7-4e5d-bfe9-48c79597a42b service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] No waiting events found dispatching network-vif-plugged-04f4b3e3-634c-4285-b389-785cff1205ea {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:46:16 user nova-compute[74850]: WARNING nova.compute.manager [req-7ef3bfdb-ced8-40b3-ae8c-2584cb94cc2d req-24952434-f3a7-4e5d-bfe9-48c79597a42b service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received unexpected event network-vif-plugged-04f4b3e3-634c-4285-b389-785cff1205ea for instance with vm_state building and task_state spawning.
Nov 14 00:46:16 user nova-compute[74850]: DEBUG nova.compute.manager [req-7ef3bfdb-ced8-40b3-ae8c-2584cb94cc2d req-24952434-f3a7-4e5d-bfe9-48c79597a42b service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-plugged-04f4b3e3-634c-4285-b389-785cff1205ea {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7ef3bfdb-ced8-40b3-ae8c-2584cb94cc2d req-24952434-f3a7-4e5d-bfe9-48c79597a42b service nova] Acquiring lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7ef3bfdb-ced8-40b3-ae8c-2584cb94cc2d req-24952434-f3a7-4e5d-bfe9-48c79597a42b service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7ef3bfdb-ced8-40b3-ae8c-2584cb94cc2d req-24952434-f3a7-4e5d-bfe9-48c79597a42b service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG nova.compute.manager [req-7ef3bfdb-ced8-40b3-ae8c-2584cb94cc2d req-24952434-f3a7-4e5d-bfe9-48c79597a42b service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] No waiting events found dispatching network-vif-plugged-04f4b3e3-634c-4285-b389-785cff1205ea {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:46:16 user nova-compute[74850]: WARNING nova.compute.manager [req-7ef3bfdb-ced8-40b3-ae8c-2584cb94cc2d req-24952434-f3a7-4e5d-bfe9-48c79597a42b service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received unexpected event network-vif-plugged-04f4b3e3-634c-4285-b389-785cff1205ea for instance with vm_state building and task_state spawning.
Nov 14 00:46:16 user nova-compute[74850]: DEBUG nova.compute.manager [req-7ef3bfdb-ced8-40b3-ae8c-2584cb94cc2d req-24952434-f3a7-4e5d-bfe9-48c79597a42b service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-plugged-ab41a728-624a-46a0-9fd6-0268c0b35f55 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7ef3bfdb-ced8-40b3-ae8c-2584cb94cc2d req-24952434-f3a7-4e5d-bfe9-48c79597a42b service nova] Acquiring lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7ef3bfdb-ced8-40b3-ae8c-2584cb94cc2d req-24952434-f3a7-4e5d-bfe9-48c79597a42b service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7ef3bfdb-ced8-40b3-ae8c-2584cb94cc2d req-24952434-f3a7-4e5d-bfe9-48c79597a42b service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG nova.compute.manager [req-7ef3bfdb-ced8-40b3-ae8c-2584cb94cc2d req-24952434-f3a7-4e5d-bfe9-48c79597a42b service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] No waiting events found dispatching network-vif-plugged-ab41a728-624a-46a0-9fd6-0268c0b35f55 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:46:16 user nova-compute[74850]: WARNING nova.compute.manager [req-7ef3bfdb-ced8-40b3-ae8c-2584cb94cc2d req-24952434-f3a7-4e5d-bfe9-48c79597a42b service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received unexpected event network-vif-plugged-ab41a728-624a-46a0-9fd6-0268c0b35f55 for instance with vm_state building and task_state spawning.
Nov 14 00:46:16 user nova-compute[74850]: DEBUG nova.compute.manager [req-7ef3bfdb-ced8-40b3-ae8c-2584cb94cc2d req-24952434-f3a7-4e5d-bfe9-48c79597a42b service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-plugged-ab41a728-624a-46a0-9fd6-0268c0b35f55 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7ef3bfdb-ced8-40b3-ae8c-2584cb94cc2d req-24952434-f3a7-4e5d-bfe9-48c79597a42b service nova] Acquiring lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7ef3bfdb-ced8-40b3-ae8c-2584cb94cc2d req-24952434-f3a7-4e5d-bfe9-48c79597a42b service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7ef3bfdb-ced8-40b3-ae8c-2584cb94cc2d req-24952434-f3a7-4e5d-bfe9-48c79597a42b service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG nova.compute.manager [req-7ef3bfdb-ced8-40b3-ae8c-2584cb94cc2d req-24952434-f3a7-4e5d-bfe9-48c79597a42b service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] No waiting events found dispatching network-vif-plugged-ab41a728-624a-46a0-9fd6-0268c0b35f55 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:46:16 user nova-compute[74850]: WARNING nova.compute.manager [req-7ef3bfdb-ced8-40b3-ae8c-2584cb94cc2d req-24952434-f3a7-4e5d-bfe9-48c79597a42b service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received unexpected event network-vif-plugged-ab41a728-624a-46a0-9fd6-0268c0b35f55 for instance with vm_state building and task_state spawning.
Nov 14 00:46:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:16 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Instance spawned successfully.
Nov 14 00:46:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:46:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:46:17 user nova-compute[74850]: INFO nova.compute.manager [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Took 15.03 seconds to spawn the instance on the hypervisor.
Nov 14 00:46:17 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:46:17 user nova-compute[74850]: INFO nova.compute.manager [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Took 34.48 seconds to build instance.
Nov 14 00:46:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4b3a5091-5de2-4f08-a997-b59910afc930 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Lock "cc072036-25dc-48a8-b430-5a2655fb473a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.736s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:17 user nova-compute[74850]: DEBUG nova.compute.manager [req-c9295a15-ec7a-45f9-a3f0-299432106397 req-ae367ba0-69cb-4f2b-8a33-6685a6071a02 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-plugged-0bbb73c1-6eda-416d-a9c8-6592c2abbea4 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:46:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c9295a15-ec7a-45f9-a3f0-299432106397 req-ae367ba0-69cb-4f2b-8a33-6685a6071a02 service nova] Acquiring lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c9295a15-ec7a-45f9-a3f0-299432106397 req-ae367ba0-69cb-4f2b-8a33-6685a6071a02 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c9295a15-ec7a-45f9-a3f0-299432106397 req-ae367ba0-69cb-4f2b-8a33-6685a6071a02 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:17 user nova-compute[74850]: DEBUG nova.compute.manager [req-c9295a15-ec7a-45f9-a3f0-299432106397 req-ae367ba0-69cb-4f2b-8a33-6685a6071a02 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] No waiting events found dispatching network-vif-plugged-0bbb73c1-6eda-416d-a9c8-6592c2abbea4 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:46:17 user nova-compute[74850]: WARNING nova.compute.manager [req-c9295a15-ec7a-45f9-a3f0-299432106397 req-ae367ba0-69cb-4f2b-8a33-6685a6071a02 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received unexpected event network-vif-plugged-0bbb73c1-6eda-416d-a9c8-6592c2abbea4 for instance with vm_state building and task_state spawning.
Nov 14 00:46:17 user nova-compute[74850]: DEBUG nova.compute.manager [req-c9295a15-ec7a-45f9-a3f0-299432106397 req-ae367ba0-69cb-4f2b-8a33-6685a6071a02 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-plugged-0bbb73c1-6eda-416d-a9c8-6592c2abbea4 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:46:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c9295a15-ec7a-45f9-a3f0-299432106397 req-ae367ba0-69cb-4f2b-8a33-6685a6071a02 service nova] Acquiring lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c9295a15-ec7a-45f9-a3f0-299432106397 req-ae367ba0-69cb-4f2b-8a33-6685a6071a02 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c9295a15-ec7a-45f9-a3f0-299432106397 req-ae367ba0-69cb-4f2b-8a33-6685a6071a02 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:17 user nova-compute[74850]: DEBUG nova.compute.manager [req-c9295a15-ec7a-45f9-a3f0-299432106397 req-ae367ba0-69cb-4f2b-8a33-6685a6071a02 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] No waiting events found dispatching network-vif-plugged-0bbb73c1-6eda-416d-a9c8-6592c2abbea4 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:46:17 user nova-compute[74850]: WARNING nova.compute.manager [req-c9295a15-ec7a-45f9-a3f0-299432106397 req-ae367ba0-69cb-4f2b-8a33-6685a6071a02 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received unexpected event network-vif-plugged-0bbb73c1-6eda-416d-a9c8-6592c2abbea4 for instance with vm_state building and task_state spawning.
Nov 14 00:46:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:17 user nova-compute[74850]: DEBUG nova.compute.manager [req-de107f86-cb54-4988-b8a6-2b8f1dc2c74f req-7e028d97-a6f8-443b-9d44-33d9dfcc6de3 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-plugged-78e098ef-09f4-4007-9e14-ebff143a4ba1 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:46:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-de107f86-cb54-4988-b8a6-2b8f1dc2c74f req-7e028d97-a6f8-443b-9d44-33d9dfcc6de3 service nova] Acquiring lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-de107f86-cb54-4988-b8a6-2b8f1dc2c74f req-7e028d97-a6f8-443b-9d44-33d9dfcc6de3 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-de107f86-cb54-4988-b8a6-2b8f1dc2c74f req-7e028d97-a6f8-443b-9d44-33d9dfcc6de3 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:17 user nova-compute[74850]: DEBUG nova.compute.manager [req-de107f86-cb54-4988-b8a6-2b8f1dc2c74f req-7e028d97-a6f8-443b-9d44-33d9dfcc6de3 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] No waiting events found dispatching network-vif-plugged-78e098ef-09f4-4007-9e14-ebff143a4ba1 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:46:17 user nova-compute[74850]: WARNING nova.compute.manager [req-de107f86-cb54-4988-b8a6-2b8f1dc2c74f req-7e028d97-a6f8-443b-9d44-33d9dfcc6de3 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received unexpected event network-vif-plugged-78e098ef-09f4-4007-9e14-ebff143a4ba1 for instance with vm_state building and task_state spawning.
Nov 14 00:46:17 user nova-compute[74850]: DEBUG nova.compute.manager [req-de107f86-cb54-4988-b8a6-2b8f1dc2c74f req-7e028d97-a6f8-443b-9d44-33d9dfcc6de3 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-plugged-091cb215-5fc9-4eb5-9aca-0751d5e41ea4 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:46:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-de107f86-cb54-4988-b8a6-2b8f1dc2c74f req-7e028d97-a6f8-443b-9d44-33d9dfcc6de3 service nova] Acquiring lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-de107f86-cb54-4988-b8a6-2b8f1dc2c74f req-7e028d97-a6f8-443b-9d44-33d9dfcc6de3 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-de107f86-cb54-4988-b8a6-2b8f1dc2c74f req-7e028d97-a6f8-443b-9d44-33d9dfcc6de3 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:17 user nova-compute[74850]: DEBUG nova.compute.manager [req-de107f86-cb54-4988-b8a6-2b8f1dc2c74f req-7e028d97-a6f8-443b-9d44-33d9dfcc6de3 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] No waiting events found dispatching network-vif-plugged-091cb215-5fc9-4eb5-9aca-0751d5e41ea4 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:46:17 user nova-compute[74850]: WARNING nova.compute.manager [req-de107f86-cb54-4988-b8a6-2b8f1dc2c74f req-7e028d97-a6f8-443b-9d44-33d9dfcc6de3 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received unexpected event network-vif-plugged-091cb215-5fc9-4eb5-9aca-0751d5e41ea4 for instance with vm_state building and task_state spawning.
Nov 14 00:46:17 user nova-compute[74850]: DEBUG nova.compute.manager [req-de107f86-cb54-4988-b8a6-2b8f1dc2c74f req-7e028d97-a6f8-443b-9d44-33d9dfcc6de3 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-plugged-091cb215-5fc9-4eb5-9aca-0751d5e41ea4 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:46:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-de107f86-cb54-4988-b8a6-2b8f1dc2c74f req-7e028d97-a6f8-443b-9d44-33d9dfcc6de3 service nova] Acquiring lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-de107f86-cb54-4988-b8a6-2b8f1dc2c74f req-7e028d97-a6f8-443b-9d44-33d9dfcc6de3 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-de107f86-cb54-4988-b8a6-2b8f1dc2c74f req-7e028d97-a6f8-443b-9d44-33d9dfcc6de3 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:17 user nova-compute[74850]: DEBUG nova.compute.manager [req-de107f86-cb54-4988-b8a6-2b8f1dc2c74f req-7e028d97-a6f8-443b-9d44-33d9dfcc6de3 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] No waiting events found dispatching network-vif-plugged-091cb215-5fc9-4eb5-9aca-0751d5e41ea4 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:46:17 user nova-compute[74850]: WARNING nova.compute.manager [req-de107f86-cb54-4988-b8a6-2b8f1dc2c74f req-7e028d97-a6f8-443b-9d44-33d9dfcc6de3 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received unexpected event network-vif-plugged-091cb215-5fc9-4eb5-9aca-0751d5e41ea4 for instance with vm_state building and task_state spawning.
Nov 14 00:46:17 user nova-compute[74850]: DEBUG nova.compute.manager [req-de107f86-cb54-4988-b8a6-2b8f1dc2c74f req-7e028d97-a6f8-443b-9d44-33d9dfcc6de3 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-plugged-dff8eb7c-ea5d-459e-a836-440097829dfd {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:46:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-de107f86-cb54-4988-b8a6-2b8f1dc2c74f req-7e028d97-a6f8-443b-9d44-33d9dfcc6de3 service nova] Acquiring lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-de107f86-cb54-4988-b8a6-2b8f1dc2c74f req-7e028d97-a6f8-443b-9d44-33d9dfcc6de3 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-de107f86-cb54-4988-b8a6-2b8f1dc2c74f req-7e028d97-a6f8-443b-9d44-33d9dfcc6de3 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:17 user nova-compute[74850]: DEBUG nova.compute.manager [req-de107f86-cb54-4988-b8a6-2b8f1dc2c74f req-7e028d97-a6f8-443b-9d44-33d9dfcc6de3 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] No waiting events found dispatching network-vif-plugged-dff8eb7c-ea5d-459e-a836-440097829dfd {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:46:17 user nova-compute[74850]: WARNING nova.compute.manager [req-de107f86-cb54-4988-b8a6-2b8f1dc2c74f req-7e028d97-a6f8-443b-9d44-33d9dfcc6de3 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received unexpected event network-vif-plugged-dff8eb7c-ea5d-459e-a836-440097829dfd for instance with vm_state building and task_state spawning.
Nov 14 00:46:17 user nova-compute[74850]: DEBUG nova.compute.manager [req-de107f86-cb54-4988-b8a6-2b8f1dc2c74f req-7e028d97-a6f8-443b-9d44-33d9dfcc6de3 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-plugged-dff8eb7c-ea5d-459e-a836-440097829dfd {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:46:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-de107f86-cb54-4988-b8a6-2b8f1dc2c74f req-7e028d97-a6f8-443b-9d44-33d9dfcc6de3 service nova] Acquiring lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-de107f86-cb54-4988-b8a6-2b8f1dc2c74f req-7e028d97-a6f8-443b-9d44-33d9dfcc6de3 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-de107f86-cb54-4988-b8a6-2b8f1dc2c74f req-7e028d97-a6f8-443b-9d44-33d9dfcc6de3 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:17 user nova-compute[74850]: DEBUG nova.compute.manager [req-de107f86-cb54-4988-b8a6-2b8f1dc2c74f req-7e028d97-a6f8-443b-9d44-33d9dfcc6de3 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] No waiting events found dispatching network-vif-plugged-dff8eb7c-ea5d-459e-a836-440097829dfd {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:46:17 user nova-compute[74850]: WARNING nova.compute.manager [req-de107f86-cb54-4988-b8a6-2b8f1dc2c74f req-7e028d97-a6f8-443b-9d44-33d9dfcc6de3 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received unexpected event network-vif-plugged-dff8eb7c-ea5d-459e-a836-440097829dfd for instance with vm_state building and task_state spawning.
Nov 14 00:46:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:18 user nova-compute[74850]: DEBUG nova.compute.manager [req-ec10a9b1-2ca3-419e-ac12-f74e03647d81 req-23d69b5e-6cf2-475c-a5ae-42511f3889d0 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-plugged-5fdd3936-9253-49a5-9f2d-6c2fdce456ea {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:46:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ec10a9b1-2ca3-419e-ac12-f74e03647d81 req-23d69b5e-6cf2-475c-a5ae-42511f3889d0 service nova] Acquiring lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ec10a9b1-2ca3-419e-ac12-f74e03647d81 req-23d69b5e-6cf2-475c-a5ae-42511f3889d0 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ec10a9b1-2ca3-419e-ac12-f74e03647d81 req-23d69b5e-6cf2-475c-a5ae-42511f3889d0 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:18 user nova-compute[74850]: DEBUG nova.compute.manager [req-ec10a9b1-2ca3-419e-ac12-f74e03647d81 req-23d69b5e-6cf2-475c-a5ae-42511f3889d0 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] No waiting events found dispatching network-vif-plugged-5fdd3936-9253-49a5-9f2d-6c2fdce456ea {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:46:18 user nova-compute[74850]: WARNING nova.compute.manager [req-ec10a9b1-2ca3-419e-ac12-f74e03647d81 req-23d69b5e-6cf2-475c-a5ae-42511f3889d0 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received unexpected event network-vif-plugged-5fdd3936-9253-49a5-9f2d-6c2fdce456ea for instance with vm_state building and task_state spawning.
Nov 14 00:46:18 user nova-compute[74850]: DEBUG nova.compute.manager [req-ec10a9b1-2ca3-419e-ac12-f74e03647d81 req-23d69b5e-6cf2-475c-a5ae-42511f3889d0 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-plugged-5fdd3936-9253-49a5-9f2d-6c2fdce456ea {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:46:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ec10a9b1-2ca3-419e-ac12-f74e03647d81 req-23d69b5e-6cf2-475c-a5ae-42511f3889d0 service nova] Acquiring lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ec10a9b1-2ca3-419e-ac12-f74e03647d81 req-23d69b5e-6cf2-475c-a5ae-42511f3889d0 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ec10a9b1-2ca3-419e-ac12-f74e03647d81 req-23d69b5e-6cf2-475c-a5ae-42511f3889d0 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:18 user nova-compute[74850]: DEBUG nova.compute.manager [req-ec10a9b1-2ca3-419e-ac12-f74e03647d81 req-23d69b5e-6cf2-475c-a5ae-42511f3889d0 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] No waiting events found dispatching network-vif-plugged-5fdd3936-9253-49a5-9f2d-6c2fdce456ea {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:46:18 user nova-compute[74850]: WARNING nova.compute.manager [req-ec10a9b1-2ca3-419e-ac12-f74e03647d81 req-23d69b5e-6cf2-475c-a5ae-42511f3889d0 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received unexpected event network-vif-plugged-5fdd3936-9253-49a5-9f2d-6c2fdce456ea for instance with vm_state building and task_state spawning.
Nov 14 00:46:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:18 user nova-compute[74850]: DEBUG nova.compute.manager [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:46:18 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 00:46:18 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Instance spawned successfully.
Nov 14 00:46:18 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 00:46:18 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:46:18 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:46:18 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:46:18 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:46:18 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:46:18 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:46:18 user nova-compute[74850]: INFO nova.compute.manager [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Took 15.97 seconds to spawn the instance on the hypervisor.
Nov 14 00:46:19 user nova-compute[74850]: DEBUG nova.compute.manager [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:46:19 user nova-compute[74850]: INFO nova.compute.manager [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Took 40.73 seconds to build instance.
Nov 14 00:46:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1a9032a5-2c52-468b-aaf3-621be4637db4 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 40.918s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:46:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74850) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 00:46:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:46:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:46:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Acquiring lock "1282f7f3-c81e-4a6e-bd86-42459f49674f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Lock "1282f7f3-c81e-4a6e-bd86-42459f49674f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:37 user nova-compute[74850]: DEBUG nova.objects.instance [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Lazy-loading 'flavor' on Instance uuid 1282f7f3-c81e-4a6e-bd86-42459f49674f {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:46:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Lock "1282f7f3-c81e-4a6e-bd86-42459f49674f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:37 user nova-compute[74850]: INFO nova.compute.manager [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Rescuing
Nov 14 00:46:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "refresh_cache-1879be4c-9226-4c8c-a56c-f8e37398851b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:46:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquired lock "refresh_cache-1879be4c-9226-4c8c-a56c-f8e37398851b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:46:37 user nova-compute[74850]: DEBUG nova.network.neutron [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:46:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Acquiring lock "1282f7f3-c81e-4a6e-bd86-42459f49674f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Lock "1282f7f3-c81e-4a6e-bd86-42459f49674f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:37 user nova-compute[74850]: INFO nova.compute.manager [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Attaching volume 82c95e74-dd2e-475e-92eb-72a39002c90d to /dev/vdb
Nov 14 00:46:37 user nova-compute[74850]: DEBUG os_brick.utils [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:46:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:37 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ac80e0-0cff-4945-815c-de091c9ba6b6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.028s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:37 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[935c09d0-4aeb-42a9-bdc5-5d3080b77050]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:37 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7686f093-2311-4623-a94d-5bbc30bdeba4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:37 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[012e23ec-ad1a-403d-b3e2-c118fc765cb0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:46:37 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 00:46:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:46:37 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 00:46:37 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9fe919-5a7d-4a33-8913-7e6c918b1814]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:37 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 00:46:37 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 00:46:37 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 00:46:37 user nova-compute[74850]: DEBUG os_brick.utils [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:46:37 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Updating existing volume attachment record: ad74a73b-3ab8-471a-8cd6-eef85c7177df {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 00:46:38 user nova-compute[74850]: DEBUG nova.network.neutron [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Updating instance_info_cache with network_info: [{"id": "ff543781-9ab0-418a-ab62-1a74ee0ed1a9", "address": "fa:16:3e:04:e7:ab", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff543781-9a", "ovs_interfaceid": "ff543781-9ab0-418a-ab62-1a74ee0ed1a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:46:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Releasing lock "refresh_cache-1879be4c-9226-4c8c-a56c-f8e37398851b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:46:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:38 user nova-compute[74850]: DEBUG nova.compute.manager [req-30bc47ba-2e72-45a8-87e3-b32ff3bbf1bd req-adcab719-0af6-4ae7-92ae-ae41623e4128 service nova] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Received event network-vif-unplugged-ff543781-9ab0-418a-ab62-1a74ee0ed1a9 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:46:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-30bc47ba-2e72-45a8-87e3-b32ff3bbf1bd req-adcab719-0af6-4ae7-92ae-ae41623e4128 service nova] Acquiring lock "1879be4c-9226-4c8c-a56c-f8e37398851b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-30bc47ba-2e72-45a8-87e3-b32ff3bbf1bd req-adcab719-0af6-4ae7-92ae-ae41623e4128 service nova] Lock "1879be4c-9226-4c8c-a56c-f8e37398851b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-30bc47ba-2e72-45a8-87e3-b32ff3bbf1bd req-adcab719-0af6-4ae7-92ae-ae41623e4128 service nova] Lock "1879be4c-9226-4c8c-a56c-f8e37398851b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:38 user nova-compute[74850]: DEBUG nova.compute.manager [req-30bc47ba-2e72-45a8-87e3-b32ff3bbf1bd req-adcab719-0af6-4ae7-92ae-ae41623e4128 service nova] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] No waiting events found dispatching network-vif-unplugged-ff543781-9ab0-418a-ab62-1a74ee0ed1a9 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:46:38 user nova-compute[74850]: WARNING nova.compute.manager [req-30bc47ba-2e72-45a8-87e3-b32ff3bbf1bd req-adcab719-0af6-4ae7-92ae-ae41623e4128 service nova] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Received unexpected event network-vif-unplugged-ff543781-9ab0-418a-ab62-1a74ee0ed1a9 for instance with vm_state active and task_state rescuing.
Nov 14 00:46:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:38 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Instance destroyed successfully.
Nov 14 00:46:38 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Attempting rescue
Nov 14 00:46:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74850) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 00:46:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Instance directory exists: not creating {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 00:46:38 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Creating image(s)
Nov 14 00:46:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "/opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "/opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "/opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:38 user nova-compute[74850]: DEBUG nova.objects.instance [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1879be4c-9226-4c8c-a56c-f8e37398851b {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:46:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.226s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue" returned: 0 in 0.050s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG nova.objects.instance [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lazy-loading 'migration_context' on Instance uuid 1879be4c-9226-4c8c-a56c-f8e37398851b {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG nova.objects.base [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Object Instance<1879be4c-9226-4c8c-a56c-f8e37398851b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Start _get_guest_xml network_info=[{"id": "ff543781-9ab0-418a-ab62-1a74ee0ed1a9", "address": "fa:16:3e:04:e7:ab", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "vif_mac": "fa:16:3e:04:e7:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff543781-9a", "ovs_interfaceid": "ff543781-9ab0-418a-ab62-1a74ee0ed1a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG nova.objects.instance [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lazy-loading 'resources' on Instance uuid 1879be4c-9226-4c8c-a56c-f8e37398851b {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG nova.objects.base [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Object Instance<1879be4c-9226-4c8c-a56c-f8e37398851b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG nova.objects.instance [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lazy-loading 'numa_topology' on Instance uuid 1879be4c-9226-4c8c-a56c-f8e37398851b {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG nova.objects.base [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Object Instance<1879be4c-9226-4c8c-a56c-f8e37398851b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 00:46:39 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:46:39 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:46:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG nova.objects.instance [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1879be4c-9226-4c8c-a56c-f8e37398851b {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG nova.objects.base [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Object Instance<1879be4c-9226-4c8c-a56c-f8e37398851b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-298091161',display_name='tempest-ServerRescueNegativeTestJSON-server-298091161',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-298091161',id=3,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:45:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e933e8bc63bd442d882ff59243bd7faa',ramdisk_id='',reservation_id='r-t20jwzvz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-103787426',owner_user_name='tempest-ServerRescueNegativeTestJSON-103787426-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:45:03Z,user_data=None,user_id='84158c07e3344e01bf82e0e25e2a7244',uuid=1879be4c-9226-4c8c-a56c-f8e37398851b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff543781-9ab0-418a-ab62-1a74ee0ed1a9", "address": "fa:16:3e:04:e7:ab", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "vif_mac": "fa:16:3e:04:e7:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff543781-9a", "ovs_interfaceid": "ff543781-9ab0-418a-ab62-1a74ee0ed1a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Converting VIF {"id": "ff543781-9ab0-418a-ab62-1a74ee0ed1a9", "address": "fa:16:3e:04:e7:ab", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "vif_mac": "fa:16:3e:04:e7:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff543781-9a", "ovs_interfaceid": "ff543781-9ab0-418a-ab62-1a74ee0ed1a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:e7:ab,bridge_name='br-int',has_traffic_filtering=True,id=ff543781-9ab0-418a-ab62-1a74ee0ed1a9,network=Network(4bb9b9bb-4485-4fed-bf0e-f549b29f09da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff543781-9a') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG nova.objects.instance [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lazy-loading 'pci_devices' on Instance uuid 1879be4c-9226-4c8c-a56c-f8e37398851b {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG nova.objects.base [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Object Instance<1879be4c-9226-4c8c-a56c-f8e37398851b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:46:39 user nova-compute[74850]:   <uuid>1879be4c-9226-4c8c-a56c-f8e37398851b</uuid>
Nov 14 00:46:39 user nova-compute[74850]:   <name>instance-00000003</name>
Nov 14 00:46:39 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:46:39 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:46:39 user nova-compute[74850]:   <metadata>
Nov 14 00:46:39 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:46:39 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:46:39 user nova-compute[74850]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-298091161</nova:name>
Nov 14 00:46:39 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:46:39</nova:creationTime>
Nov 14 00:46:39 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:46:39 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:46:39 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:46:39 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:46:39 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:46:39 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:46:39 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:46:39 user nova-compute[74850]:       <nova:owner>
Nov 14 00:46:39 user nova-compute[74850]:         <nova:user uuid="84158c07e3344e01bf82e0e25e2a7244">tempest-ServerRescueNegativeTestJSON-103787426-project-member</nova:user>
Nov 14 00:46:39 user nova-compute[74850]:         <nova:project uuid="e933e8bc63bd442d882ff59243bd7faa">tempest-ServerRescueNegativeTestJSON-103787426</nova:project>
Nov 14 00:46:39 user nova-compute[74850]:       </nova:owner>
Nov 14 00:46:39 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:46:39 user nova-compute[74850]:       <nova:ports>
Nov 14 00:46:39 user nova-compute[74850]:         <nova:port uuid="ff543781-9ab0-418a-ab62-1a74ee0ed1a9">
Nov 14 00:46:39 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 00:46:39 user nova-compute[74850]:         </nova:port>
Nov 14 00:46:39 user nova-compute[74850]:       </nova:ports>
Nov 14 00:46:39 user nova-compute[74850]:     </nova:instance>
Nov 14 00:46:39 user nova-compute[74850]:   </metadata>
Nov 14 00:46:39 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:46:39 user nova-compute[74850]:     <system>
Nov 14 00:46:39 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:46:39 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:46:39 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:46:39 user nova-compute[74850]:       <entry name="serial">1879be4c-9226-4c8c-a56c-f8e37398851b</entry>
Nov 14 00:46:39 user nova-compute[74850]:       <entry name="uuid">1879be4c-9226-4c8c-a56c-f8e37398851b</entry>
Nov 14 00:46:39 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:46:39 user nova-compute[74850]:     </system>
Nov 14 00:46:39 user nova-compute[74850]:   </sysinfo>
Nov 14 00:46:39 user nova-compute[74850]:   <os>
Nov 14 00:46:39 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:46:39 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:46:39 user nova-compute[74850]:   </os>
Nov 14 00:46:39 user nova-compute[74850]:   <features>
Nov 14 00:46:39 user nova-compute[74850]:     <acpi/>
Nov 14 00:46:39 user nova-compute[74850]:     <apic/>
Nov 14 00:46:39 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:46:39 user nova-compute[74850]:   </features>
Nov 14 00:46:39 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:46:39 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:46:39 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:46:39 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:46:39 user nova-compute[74850]:   </clock>
Nov 14 00:46:39 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:46:39 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:46:39 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:46:39 user nova-compute[74850]:   </cpu>
Nov 14 00:46:39 user nova-compute[74850]:   <devices>
Nov 14 00:46:39 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 00:46:39 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:46:39 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue"/>
Nov 14 00:46:39 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:46:39 user nova-compute[74850]:     </disk>
Nov 14 00:46:39 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 00:46:39 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:46:39 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk"/>
Nov 14 00:46:39 user nova-compute[74850]:       <target dev="vdb" bus="virtio"/>
Nov 14 00:46:39 user nova-compute[74850]:     </disk>
Nov 14 00:46:39 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:46:39 user nova-compute[74850]:       <mac address="fa:16:3e:04:e7:ab"/>
Nov 14 00:46:39 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:46:39 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:46:39 user nova-compute[74850]:       <target dev="tapff543781-9a"/>
Nov 14 00:46:39 user nova-compute[74850]:     </interface>
Nov 14 00:46:39 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:46:39 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/console.log" append="off"/>
Nov 14 00:46:39 user nova-compute[74850]:     </serial>
Nov 14 00:46:39 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:46:39 user nova-compute[74850]:     <video>
Nov 14 00:46:39 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:46:39 user nova-compute[74850]:     </video>
Nov 14 00:46:39 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:46:39 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:46:39 user nova-compute[74850]:     </rng>
Nov 14 00:46:39 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:46:39 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:46:39 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:46:39 user nova-compute[74850]:     </memballoon>
Nov 14 00:46:39 user nova-compute[74850]:   </devices>
Nov 14 00:46:39 user nova-compute[74850]: </domain>
Nov 14 00:46:39 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:46:39 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Instance destroyed successfully.
Nov 14 00:46:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] No VIF found with MAC fa:16:3e:04:e7:ab, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:39 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 00:46:40 user nova-compute[74850]: DEBUG nova.compute.manager [req-5940f465-1578-4dc5-9f82-3fc1d7f8d0b2 req-6919840c-3f61-4978-a6af-4b69d5a4b26c service nova] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Received event network-vif-plugged-ff543781-9ab0-418a-ab62-1a74ee0ed1a9 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:46:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5940f465-1578-4dc5-9f82-3fc1d7f8d0b2 req-6919840c-3f61-4978-a6af-4b69d5a4b26c service nova] Acquiring lock "1879be4c-9226-4c8c-a56c-f8e37398851b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5940f465-1578-4dc5-9f82-3fc1d7f8d0b2 req-6919840c-3f61-4978-a6af-4b69d5a4b26c service nova] Lock "1879be4c-9226-4c8c-a56c-f8e37398851b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5940f465-1578-4dc5-9f82-3fc1d7f8d0b2 req-6919840c-3f61-4978-a6af-4b69d5a4b26c service nova] Lock "1879be4c-9226-4c8c-a56c-f8e37398851b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:40 user nova-compute[74850]: DEBUG nova.compute.manager [req-5940f465-1578-4dc5-9f82-3fc1d7f8d0b2 req-6919840c-3f61-4978-a6af-4b69d5a4b26c service nova] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] No waiting events found dispatching network-vif-plugged-ff543781-9ab0-418a-ab62-1a74ee0ed1a9 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:46:40 user nova-compute[74850]: WARNING nova.compute.manager [req-5940f465-1578-4dc5-9f82-3fc1d7f8d0b2 req-6919840c-3f61-4978-a6af-4b69d5a4b26c service nova] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Received unexpected event network-vif-plugged-ff543781-9ab0-418a-ab62-1a74ee0ed1a9 for instance with vm_state active and task_state rescuing.
Nov 14 00:46:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:41 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:46:41 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:46:41 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:46:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937d7470-ec86-4972-b975-257d626329dd/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937d7470-ec86-4972-b975-257d626329dd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937d7470-ec86-4972-b975-257d626329dd/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937d7470-ec86-4972-b975-257d626329dd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28212eec-99be-4171-97ed-7748bbb75c88/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28212eec-99be-4171-97ed-7748bbb75c88/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28212eec-99be-4171-97ed-7748bbb75c88/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28212eec-99be-4171-97ed-7748bbb75c88/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f1a88ea-83a3-447b-a83d-40b2c1c908f5/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f1a88ea-83a3-447b-a83d-40b2c1c908f5/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f1a88ea-83a3-447b-a83d-40b2c1c908f5/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f1a88ea-83a3-447b-a83d-40b2c1c908f5/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1282f7f3-c81e-4a6e-bd86-42459f49674f/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVTmMHPN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:46:42 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:46:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:46:42 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:46:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:46:42 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a40b99-d91f-49a1-8007-8cb723076d1e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 00:46:42 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1282f7f3-c81e-4a6e-bd86-42459f49674f/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1282f7f3-c81e-4a6e-bd86-42459f49674f/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c0cca9-f6aa-45d7-bbda-dc3bf07714b5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d] added
Nov 14 00:46:42 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG nova.compute.manager [req-2ff0d2d4-595e-42d7-8756-477d66332daa req-864cad40-c72d-469c-8a53-be634eec0eb4 service nova] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Received event network-vif-plugged-ff543781-9ab0-418a-ab62-1a74ee0ed1a9 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-2ff0d2d4-595e-42d7-8756-477d66332daa req-864cad40-c72d-469c-8a53-be634eec0eb4 service nova] Acquiring lock "1879be4c-9226-4c8c-a56c-f8e37398851b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-2ff0d2d4-595e-42d7-8756-477d66332daa req-864cad40-c72d-469c-8a53-be634eec0eb4 service nova] Lock "1879be4c-9226-4c8c-a56c-f8e37398851b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-2ff0d2d4-595e-42d7-8756-477d66332daa req-864cad40-c72d-469c-8a53-be634eec0eb4 service nova] Lock "1879be4c-9226-4c8c-a56c-f8e37398851b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG nova.compute.manager [req-2ff0d2d4-595e-42d7-8756-477d66332daa req-864cad40-c72d-469c-8a53-be634eec0eb4 service nova] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] No waiting events found dispatching network-vif-plugged-ff543781-9ab0-418a-ab62-1a74ee0ed1a9 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:46:42 user nova-compute[74850]: WARNING nova.compute.manager [req-2ff0d2d4-595e-42d7-8756-477d66332daa req-864cad40-c72d-469c-8a53-be634eec0eb4 service nova] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Received unexpected event network-vif-plugged-ff543781-9ab0-418a-ab62-1a74ee0ed1a9 for instance with vm_state active and task_state rescuing.
Nov 14 00:46:42 user nova-compute[74850]: DEBUG nova.compute.manager [req-2ff0d2d4-595e-42d7-8756-477d66332daa req-864cad40-c72d-469c-8a53-be634eec0eb4 service nova] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Received event network-vif-plugged-ff543781-9ab0-418a-ab62-1a74ee0ed1a9 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-2ff0d2d4-595e-42d7-8756-477d66332daa req-864cad40-c72d-469c-8a53-be634eec0eb4 service nova] Acquiring lock "1879be4c-9226-4c8c-a56c-f8e37398851b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-2ff0d2d4-595e-42d7-8756-477d66332daa req-864cad40-c72d-469c-8a53-be634eec0eb4 service nova] Lock "1879be4c-9226-4c8c-a56c-f8e37398851b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-2ff0d2d4-595e-42d7-8756-477d66332daa req-864cad40-c72d-469c-8a53-be634eec0eb4 service nova] Lock "1879be4c-9226-4c8c-a56c-f8e37398851b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG nova.compute.manager [req-2ff0d2d4-595e-42d7-8756-477d66332daa req-864cad40-c72d-469c-8a53-be634eec0eb4 service nova] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] No waiting events found dispatching network-vif-plugged-ff543781-9ab0-418a-ab62-1a74ee0ed1a9 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:46:42 user nova-compute[74850]: WARNING nova.compute.manager [req-2ff0d2d4-595e-42d7-8756-477d66332daa req-864cad40-c72d-469c-8a53-be634eec0eb4 service nova] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Received unexpected event network-vif-plugged-ff543781-9ab0-418a-ab62-1a74ee0ed1a9 for instance with vm_state active and task_state rescuing.
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[147a1886-97eb-4bc5-902e-3b8e5f3c2f29]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23ccf08-5de2-4fd3-aed1-a2c23c601e4a]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RVTmMHPN {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RVTmMHPN" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ecca0f-669d-4a9b-aff9-643b681e4587]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RVTmMHPN'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8671ee-00e8-42b4-8831-365ccd3c3a42]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c85f29c-b711-4b71-b330-d2bb96a11be5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:46:42 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:46:42 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:46:42 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:46:42 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:46:42 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:46:42 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:46:42 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:46:42 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:46:42 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:46:42 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:46:42 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:46:42 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:46:42 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:46:42 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1282f7f3-c81e-4a6e-bd86-42459f49674f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0109f1-957d-485b-b261-fc5e148d4a9d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d, portal: 172.16.0.220,3260]
Nov 14 00:46:42 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d, portal: 172.16.0.220,3260] successful.
Nov 14 00:46:42 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[512f2d78-c69d-470c-8bd6-25bde5644d91]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c70c11-4535-4c05-bfba-2b916f5f866d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:46:42 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:46:42 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:46:42 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:46:42 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:46:42 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:46:42 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:46:42 user nova-compute[74850]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d (non-flash)
Nov 14 00:46:42 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:46:42 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:46:42 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:46:42 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:46:42 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:46:42 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:46:42 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:46:42 user nova-compute[74850]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d (non-flash)
Nov 14 00:46:42 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG nova.compute.manager [None req-5b28ce71-2d2c-47c7-a42d-9f6327cc5291 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed40796-8768-4e30-85f4-0609782ab982]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVTmMHPN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faeb3377-d199-472b-9ee2-f504d5ac9ac4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faeb3377-d199-472b-9ee2-f504d5ac9ac4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faeb3377-d199-472b-9ee2-f504d5ac9ac4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faeb3377-d199-472b-9ee2-f504d5ac9ac4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c077bc-31f0-4794-b01e-08204e4301d4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:43 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.415s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:46:43 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] <== connect_volume: return (1419ms) {'type': 'block', 'scsi_wwn': '23065336365646431', 'path': '/dev/sdi'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:46:43 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065336365646431', 'path': '/dev/sdi'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 00:46:43 user nova-compute[74850]: DEBUG nova.objects.instance [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Lazy-loading 'flavor' on Instance uuid 1282f7f3-c81e-4a6e-bd86-42459f49674f {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:46:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 00:46:44 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:46:44 user nova-compute[74850]:   <source dev="/dev/sdi"/>
Nov 14 00:46:44 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:46:44 user nova-compute[74850]:   <serial>82c95e74-dd2e-475e-92eb-72a39002c90d</serial>
Nov 14 00:46:44 user nova-compute[74850]: </disk>
Nov 14 00:46:44 user nova-compute[74850]:  {{(pid=74850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 00:46:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c077bc-31f0-4794-b01e-08204e4301d4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c077bc-31f0-4794-b01e-08204e4301d4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c077bc-31f0-4794-b01e-08204e4301d4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2881e6-ee6e-4165-a6d9-35fda79c142d/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2881e6-ee6e-4165-a6d9-35fda79c142d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2881e6-ee6e-4165-a6d9-35fda79c142d/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:46:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:46:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] No VIF found with MAC fa:16:3e:56:7c:b6, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:46:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2881e6-ee6e-4165-a6d9-35fda79c142d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-932eac51-a3ad-4bc6-8abf-707078c3585f tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Lock "1282f7f3-c81e-4a6e-bd86-42459f49674f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.849s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:45 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:46:45 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:46:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=6849MB free_disk=25.44314193725586GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 00:46:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Acquiring lock "1282f7f3-c81e-4a6e-bd86-42459f49674f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Lock "1282f7f3-c81e-4a6e-bd86-42459f49674f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Acquiring lock "1282f7f3-c81e-4a6e-bd86-42459f49674f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Lock "1282f7f3-c81e-4a6e-bd86-42459f49674f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Lock "1282f7f3-c81e-4a6e-bd86-42459f49674f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:45 user nova-compute[74850]: INFO nova.compute.manager [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Terminating instance
Nov 14 00:46:45 user nova-compute[74850]: DEBUG nova.compute.manager [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 00:46:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance a70d0196-f90e-47c4-be67-bf7ef4c3d8c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:46:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 1282f7f3-c81e-4a6e-bd86-42459f49674f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:46:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 1879be4c-9226-4c8c-a56c-f8e37398851b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:46:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 7f1a88ea-83a3-447b-a83d-40b2c1c908f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:46:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 4a2881e6-ee6e-4165-a6d9-35fda79c142d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:46:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 28212eec-99be-4171-97ed-7748bbb75c88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:46:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 937d7470-ec86-4972-b975-257d626329dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:46:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance b54b37bc-8c90-4c48-a943-e489e830b93b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:46:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance faeb3377-d199-472b-9ee2-f504d5ac9ac4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:46:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 92c077bc-31f0-4794-b01e-08204e4301d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:46:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 7b1dc486-c6b5-4518-8da5-6042c97cbe55 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:46:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance cc072036-25dc-48a8-b430-5a2655fb473a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:46:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 00:46:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 00:46:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:45 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Refreshing inventories for resource provider fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 00:46:45 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Updating ProviderTree inventory for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 00:46:45 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Updating inventory in ProviderTree for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 00:46:45 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Refreshing aggregate associations for resource provider fe703abb-f68c-420d-a7f0-bf5240e23c54, aggregates: None {{(pid=74850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 00:46:45 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Refreshing trait associations for resource provider fe703abb-f68c-420d-a7f0-bf5240e23c54, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 00:46:45 user nova-compute[74850]: DEBUG nova.compute.manager [req-1f21a447-1af5-4083-9f1e-20cfa93b1842 req-31ead835-3782-480b-bfc3-2b3840d72cf8 service nova] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Received event network-vif-unplugged-792bf62b-99b4-4d65-a55b-4e97c64eb1c5 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:46:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-1f21a447-1af5-4083-9f1e-20cfa93b1842 req-31ead835-3782-480b-bfc3-2b3840d72cf8 service nova] Acquiring lock "1282f7f3-c81e-4a6e-bd86-42459f49674f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-1f21a447-1af5-4083-9f1e-20cfa93b1842 req-31ead835-3782-480b-bfc3-2b3840d72cf8 service nova] Lock "1282f7f3-c81e-4a6e-bd86-42459f49674f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-1f21a447-1af5-4083-9f1e-20cfa93b1842 req-31ead835-3782-480b-bfc3-2b3840d72cf8 service nova] Lock "1282f7f3-c81e-4a6e-bd86-42459f49674f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:45 user nova-compute[74850]: DEBUG nova.compute.manager [req-1f21a447-1af5-4083-9f1e-20cfa93b1842 req-31ead835-3782-480b-bfc3-2b3840d72cf8 service nova] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] No waiting events found dispatching network-vif-unplugged-792bf62b-99b4-4d65-a55b-4e97c64eb1c5 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:46:45 user nova-compute[74850]: DEBUG nova.compute.manager [req-1f21a447-1af5-4083-9f1e-20cfa93b1842 req-31ead835-3782-480b-bfc3-2b3840d72cf8 service nova] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Received event network-vif-unplugged-792bf62b-99b4-4d65-a55b-4e97c64eb1c5 for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.733s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:46 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Instance destroyed successfully.
Nov 14 00:46:46 user nova-compute[74850]: DEBUG nova.objects.instance [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Lazy-loading 'resources' on Instance uuid 1282f7f3-c81e-4a6e-bd86-42459f49674f {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:44:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1489627532',display_name='tempest-DeleteServersTestJSON-server-1489627532',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1489627532',id=2,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:44:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7cfd43e655ec42eebeae8f1b379138cf',ramdisk_id='',reservation_id='r-p6afbhx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1071534720',owner_user_name='tempest-DeleteServersTestJSON-1071534720-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:44:58Z,user_data=None,user_id='951c453212bf442795089fc1f59199ef',uuid=1282f7f3-c81e-4a6e-bd86-42459f49674f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "792bf62b-99b4-4d65-a55b-4e97c64eb1c5", "address": "fa:16:3e:56:7c:b6", "network": {"id": "1466749e-8ac2-47c1-881f-aaa26f1cfa07", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1181152542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cfd43e655ec42eebeae8f1b379138cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap792bf62b-99", "ovs_interfaceid": "792bf62b-99b4-4d65-a55b-4e97c64eb1c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Converting VIF {"id": "792bf62b-99b4-4d65-a55b-4e97c64eb1c5", "address": "fa:16:3e:56:7c:b6", "network": {"id": "1466749e-8ac2-47c1-881f-aaa26f1cfa07", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1181152542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cfd43e655ec42eebeae8f1b379138cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap792bf62b-99", "ovs_interfaceid": "792bf62b-99b4-4d65-a55b-4e97c64eb1c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:7c:b6,bridge_name='br-int',has_traffic_filtering=True,id=792bf62b-99b4-4d65-a55b-4e97c64eb1c5,network=Network(1466749e-8ac2-47c1-881f-aaa26f1cfa07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap792bf62b-99') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG os_vif [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:7c:b6,bridge_name='br-int',has_traffic_filtering=True,id=792bf62b-99b4-4d65-a55b-4e97c64eb1c5,network=Network(1466749e-8ac2-47c1-881f-aaa26f1cfa07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap792bf62b-99') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap792bf62b-99, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dfd72188-11e9-4702-9395-2bda92c78c41) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:46 user nova-compute[74850]: INFO os_vif [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:7c:b6,bridge_name='br-int',has_traffic_filtering=True,id=792bf62b-99b4-4d65-a55b-4e97c64eb1c5,network=Network(1466749e-8ac2-47c1-881f-aaa26f1cfa07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap792bf62b-99')
Nov 14 00:46:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVTmMHPN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:46:46 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:46:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5400ed8c-bba9-4475-bb7b-0525f6f9a9ee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 00:46:46 user nova-compute[74850]: No targets found.
Nov 14 00:46:46 user nova-compute[74850]: iSNS:
Nov 14 00:46:46 user nova-compute[74850]: No targets found.
Nov 14 00:46:46 user nova-compute[74850]: STATIC:
Nov 14 00:46:46 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606
Nov 14 00:46:46 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:46:46 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:46:46 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83
Nov 14 00:46:46 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:46:46 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:46:46 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8
Nov 14 00:46:46 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:46:46 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:46:46 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec
Nov 14 00:46:46 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:46:46 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:46:46 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d
Nov 14 00:46:46 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:46:46 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:46:46 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c
Nov 14 00:46:46 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:46:46 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:46:46 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732
Nov 14 00:46:46 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:46:46 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:46:46 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a
Nov 14 00:46:46 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:46:46 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:46:46 user nova-compute[74850]: FIRMWARE:
Nov 14 00:46:46 user nova-compute[74850]: No targets found.
Nov 14 00:46:46 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 00:46:46 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 00:46:46 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fece7ae7-704d-415f-98b5-5f1e047a146a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[707f69be-de0f-4575-bbeb-6e2a34717b96]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:46:46 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:46:46 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:46:46 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:46:46 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:46:46 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:46:46 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:46:46 user nova-compute[74850]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d (non-flash)
Nov 14 00:46:46 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:46:46 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:46:46 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:46:46 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:46:46 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:46:46 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:46:46 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:46:46 user nova-compute[74850]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d (non-flash)
Nov 14 00:46:46 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a69a2dfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d'): ({'sdi'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Removing single pathed devices sdi {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a25d83-bf96-45ad-9c11-e15c0e63ad8f]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad0544f-37e0-42e1-b299-1da7b3909c98]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Flushing IO for device /dev/sdi {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[75656f59-2694-42ee-8a9f-fda34d403980]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.042s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b97a7a-6c73-405a-8d1f-0eefd3e03fe8]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] SCSI volumes sdi have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c305f4-c668-453a-a2ab-8a2071dbabfa]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4248eb9f-0d89-4fb7-b74a-dd6020bca326]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d, portal: 172.16.0.220,3260]
Nov 14 00:46:46 user nova-compute[74850]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d, portal: 172.16.0.220,3260] successful.
Nov 14 00:46:46 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82c95e74-dd2e-475e-92eb-72a39002c90d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f74ac3-5baf-416a-b466-9c2d77832f0d]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] <== disconnect_volume: return (355ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 00:46:46 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Deleting instance files /opt/stack/data/nova/instances/1282f7f3-c81e-4a6e-bd86-42459f49674f_del
Nov 14 00:46:46 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Deletion of /opt/stack/data/nova/instances/1282f7f3-c81e-4a6e-bd86-42459f49674f_del complete
Nov 14 00:46:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74850) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 14 00:46:46 user nova-compute[74850]: INFO nova.virt.libvirt.host [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] UEFI support detected
Nov 14 00:46:46 user nova-compute[74850]: INFO nova.compute.manager [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 14 00:46:46 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 00:46:46 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 00:46:47 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:46:47 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:46:47 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:46:47 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 00:46:47 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:46:47 user nova-compute[74850]: DEBUG nova.compute.manager [req-91753759-c940-4975-9ba1-f971eef6fd6d req-f964117a-b450-4e12-9d80-7632d01ad489 service nova] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Received event network-vif-deleted-792bf62b-99b4-4d65-a55b-4e97c64eb1c5 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:46:47 user nova-compute[74850]: INFO nova.compute.manager [req-91753759-c940-4975-9ba1-f971eef6fd6d req-f964117a-b450-4e12-9d80-7632d01ad489 service nova] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Neutron deleted interface 792bf62b-99b4-4d65-a55b-4e97c64eb1c5; detaching it from the instance and deleting it from the info cache
Nov 14 00:46:47 user nova-compute[74850]: DEBUG nova.network.neutron [req-91753759-c940-4975-9ba1-f971eef6fd6d req-f964117a-b450-4e12-9d80-7632d01ad489 service nova] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:46:47 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Took 0.49 seconds to deallocate network for instance.
Nov 14 00:46:47 user nova-compute[74850]: DEBUG nova.compute.manager [req-91753759-c940-4975-9ba1-f971eef6fd6d req-f964117a-b450-4e12-9d80-7632d01ad489 service nova] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Detach interface failed, port_id=792bf62b-99b4-4d65-a55b-4e97c64eb1c5, reason: Instance 1282f7f3-c81e-4a6e-bd86-42459f49674f could not be found. {{(pid=74850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 00:46:47 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Skipping network cache update for instance because it is being deleted. {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Nov 14 00:46:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "refresh_cache-1879be4c-9226-4c8c-a56c-f8e37398851b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:46:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquired lock "refresh_cache-1879be4c-9226-4c8c-a56c-f8e37398851b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:46:47 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Forcefully refreshing network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 00:46:47 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Updating instance_info_cache with network_info: [{"id": "ff543781-9ab0-418a-ab62-1a74ee0ed1a9", "address": "fa:16:3e:04:e7:ab", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff543781-9a", "ovs_interfaceid": "ff543781-9ab0-418a-ab62-1a74ee0ed1a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:46:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Releasing lock "refresh_cache-1879be4c-9226-4c8c-a56c-f8e37398851b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:46:47 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Updated the network info_cache for instance {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 00:46:48 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:46:48 user nova-compute[74850]: DEBUG nova.compute.manager [req-cb6fa795-056e-4692-82b5-e99a7a3bd90f req-4df983f3-21b9-4837-a100-df543e7c179d service nova] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Received event network-vif-plugged-792bf62b-99b4-4d65-a55b-4e97c64eb1c5 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:46:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-cb6fa795-056e-4692-82b5-e99a7a3bd90f req-4df983f3-21b9-4837-a100-df543e7c179d service nova] Acquiring lock "1282f7f3-c81e-4a6e-bd86-42459f49674f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-cb6fa795-056e-4692-82b5-e99a7a3bd90f req-4df983f3-21b9-4837-a100-df543e7c179d service nova] Lock "1282f7f3-c81e-4a6e-bd86-42459f49674f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-cb6fa795-056e-4692-82b5-e99a7a3bd90f req-4df983f3-21b9-4837-a100-df543e7c179d service nova] Lock "1282f7f3-c81e-4a6e-bd86-42459f49674f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:48 user nova-compute[74850]: DEBUG nova.compute.manager [req-cb6fa795-056e-4692-82b5-e99a7a3bd90f req-4df983f3-21b9-4837-a100-df543e7c179d service nova] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] No waiting events found dispatching network-vif-plugged-792bf62b-99b4-4d65-a55b-4e97c64eb1c5 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:46:48 user nova-compute[74850]: WARNING nova.compute.manager [req-cb6fa795-056e-4692-82b5-e99a7a3bd90f req-4df983f3-21b9-4837-a100-df543e7c179d service nova] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Received unexpected event network-vif-plugged-792bf62b-99b4-4d65-a55b-4e97c64eb1c5 for instance with vm_state active and task_state deleting.
Nov 14 00:46:48 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:46:48 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:46:48 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:46:48 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:46:48 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:46:48 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 00:46:48 user nova-compute[74850]: INFO nova.compute.manager [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] [instance: 1282f7f3-c81e-4a6e-bd86-42459f49674f] Took 0.87 seconds to detach 1 volumes for instance.
Nov 14 00:46:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:48 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:46:48 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:46:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.332s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:48 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Deleted allocations for instance 1282f7f3-c81e-4a6e-bd86-42459f49674f
Nov 14 00:46:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2cce6bb2-e690-47ac-837d-6a408761d40d tempest-DeleteServersTestJSON-1071534720 tempest-DeleteServersTestJSON-1071534720-project-member] Lock "1282f7f3-c81e-4a6e-bd86-42459f49674f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.200s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:54 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:56 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1c257020-c095-47ef-90c5-b2e6179d808e tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Acquiring lock "7f1a88ea-83a3-447b-a83d-40b2c1c908f5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1c257020-c095-47ef-90c5-b2e6179d808e tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Lock "7f1a88ea-83a3-447b-a83d-40b2c1c908f5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1c257020-c095-47ef-90c5-b2e6179d808e tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Acquiring lock "7f1a88ea-83a3-447b-a83d-40b2c1c908f5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1c257020-c095-47ef-90c5-b2e6179d808e tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Lock "7f1a88ea-83a3-447b-a83d-40b2c1c908f5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1c257020-c095-47ef-90c5-b2e6179d808e tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Lock "7f1a88ea-83a3-447b-a83d-40b2c1c908f5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:59 user nova-compute[74850]: INFO nova.compute.manager [None req-1c257020-c095-47ef-90c5-b2e6179d808e tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Terminating instance
Nov 14 00:46:59 user nova-compute[74850]: DEBUG nova.compute.manager [None req-1c257020-c095-47ef-90c5-b2e6179d808e tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 00:46:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:59 user nova-compute[74850]: DEBUG nova.compute.manager [req-3c9f03b7-f8a3-4bc7-9cb3-868cb368d880 req-1dd084b1-58bc-4c4d-bda3-cfca9c3b0560 service nova] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Received event network-vif-unplugged-4a56ca60-9419-4150-8a41-81d8709e001c {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:46:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3c9f03b7-f8a3-4bc7-9cb3-868cb368d880 req-1dd084b1-58bc-4c4d-bda3-cfca9c3b0560 service nova] Acquiring lock "7f1a88ea-83a3-447b-a83d-40b2c1c908f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:46:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3c9f03b7-f8a3-4bc7-9cb3-868cb368d880 req-1dd084b1-58bc-4c4d-bda3-cfca9c3b0560 service nova] Lock "7f1a88ea-83a3-447b-a83d-40b2c1c908f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:46:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3c9f03b7-f8a3-4bc7-9cb3-868cb368d880 req-1dd084b1-58bc-4c4d-bda3-cfca9c3b0560 service nova] Lock "7f1a88ea-83a3-447b-a83d-40b2c1c908f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:46:59 user nova-compute[74850]: DEBUG nova.compute.manager [req-3c9f03b7-f8a3-4bc7-9cb3-868cb368d880 req-1dd084b1-58bc-4c4d-bda3-cfca9c3b0560 service nova] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] No waiting events found dispatching network-vif-unplugged-4a56ca60-9419-4150-8a41-81d8709e001c {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:46:59 user nova-compute[74850]: DEBUG nova.compute.manager [req-3c9f03b7-f8a3-4bc7-9cb3-868cb368d880 req-1dd084b1-58bc-4c4d-bda3-cfca9c3b0560 service nova] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Received event network-vif-unplugged-4a56ca60-9419-4150-8a41-81d8709e001c for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 00:46:59 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Instance destroyed successfully.
Nov 14 00:46:59 user nova-compute[74850]: DEBUG nova.objects.instance [None req-1c257020-c095-47ef-90c5-b2e6179d808e tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Lazy-loading 'resources' on Instance uuid 7f1a88ea-83a3-447b-a83d-40b2c1c908f5 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:46:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-1c257020-c095-47ef-90c5-b2e6179d808e tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1568629676',display_name='tempest-VolumesActionsTest-instance-1568629676',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1568629676',id=4,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:45:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8cae3e5d11c40f0b499837464422c86',ramdisk_id='',reservation_id='r-0b4jjfsf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-810325091',owner_user_name='tempest-VolumesActionsTest-810325091-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:45:25Z,user_data=None,user_id='895d12a3660d43ffbdbc8cd4d5e1b989',uuid=7f1a88ea-83a3-447b-a83d-40b2c1c908f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a56ca60-9419-4150-8a41-81d8709e001c", "address": "fa:16:3e:3f:05:00", "network": {"id": "a510ed73-2a44-4945-9e3c-685351d93486", "bridge": "br-int", "label": "tempest-VolumesActionsTest-957592581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8cae3e5d11c40f0b499837464422c86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a56ca60-94", "ovs_interfaceid": "4a56ca60-9419-4150-8a41-81d8709e001c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:46:59 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-1c257020-c095-47ef-90c5-b2e6179d808e tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Converting VIF {"id": "4a56ca60-9419-4150-8a41-81d8709e001c", "address": "fa:16:3e:3f:05:00", "network": {"id": "a510ed73-2a44-4945-9e3c-685351d93486", "bridge": "br-int", "label": "tempest-VolumesActionsTest-957592581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8cae3e5d11c40f0b499837464422c86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a56ca60-94", "ovs_interfaceid": "4a56ca60-9419-4150-8a41-81d8709e001c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:46:59 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-1c257020-c095-47ef-90c5-b2e6179d808e tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:05:00,bridge_name='br-int',has_traffic_filtering=True,id=4a56ca60-9419-4150-8a41-81d8709e001c,network=Network(a510ed73-2a44-4945-9e3c-685351d93486),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a56ca60-94') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:46:59 user nova-compute[74850]: DEBUG os_vif [None req-1c257020-c095-47ef-90c5-b2e6179d808e tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:05:00,bridge_name='br-int',has_traffic_filtering=True,id=4a56ca60-9419-4150-8a41-81d8709e001c,network=Network(a510ed73-2a44-4945-9e3c-685351d93486),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a56ca60-94') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:46:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a56ca60-94, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:46:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5cb375bf-63fe-4435-9853-7376a0b04d22) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:46:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:46:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:46:59 user nova-compute[74850]: INFO os_vif [None req-1c257020-c095-47ef-90c5-b2e6179d808e tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:05:00,bridge_name='br-int',has_traffic_filtering=True,id=4a56ca60-9419-4150-8a41-81d8709e001c,network=Network(a510ed73-2a44-4945-9e3c-685351d93486),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a56ca60-94')
Nov 14 00:46:59 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-1c257020-c095-47ef-90c5-b2e6179d808e tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Deleting instance files /opt/stack/data/nova/instances/7f1a88ea-83a3-447b-a83d-40b2c1c908f5_del
Nov 14 00:46:59 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-1c257020-c095-47ef-90c5-b2e6179d808e tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Deletion of /opt/stack/data/nova/instances/7f1a88ea-83a3-447b-a83d-40b2c1c908f5_del complete
Nov 14 00:46:59 user nova-compute[74850]: INFO nova.compute.manager [None req-1c257020-c095-47ef-90c5-b2e6179d808e tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 14 00:46:59 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-1c257020-c095-47ef-90c5-b2e6179d808e tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 00:46:59 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 00:46:59 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 00:46:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:00 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:47:00 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Took 0.47 seconds to deallocate network for instance.
Nov 14 00:47:00 user nova-compute[74850]: DEBUG nova.compute.manager [req-d9fa80db-815d-40bb-8591-c194356bc6ec req-cae10c06-5e0d-4027-b5db-ec22781ebad9 service nova] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Received event network-vif-deleted-4a56ca60-9419-4150-8a41-81d8709e001c {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:00 user nova-compute[74850]: INFO nova.compute.manager [req-d9fa80db-815d-40bb-8591-c194356bc6ec req-cae10c06-5e0d-4027-b5db-ec22781ebad9 service nova] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Neutron deleted interface 4a56ca60-9419-4150-8a41-81d8709e001c; detaching it from the instance and deleting it from the info cache
Nov 14 00:47:00 user nova-compute[74850]: DEBUG nova.network.neutron [req-d9fa80db-815d-40bb-8591-c194356bc6ec req-cae10c06-5e0d-4027-b5db-ec22781ebad9 service nova] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:47:00 user nova-compute[74850]: DEBUG nova.compute.manager [req-d9fa80db-815d-40bb-8591-c194356bc6ec req-cae10c06-5e0d-4027-b5db-ec22781ebad9 service nova] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Detach interface failed, port_id=4a56ca60-9419-4150-8a41-81d8709e001c, reason: Instance 7f1a88ea-83a3-447b-a83d-40b2c1c908f5 could not be found. {{(pid=74850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 00:47:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1c257020-c095-47ef-90c5-b2e6179d808e tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1c257020-c095-47ef-90c5-b2e6179d808e tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:00 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-1c257020-c095-47ef-90c5-b2e6179d808e tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:47:00 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-1c257020-c095-47ef-90c5-b2e6179d808e tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:47:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1c257020-c095-47ef-90c5-b2e6179d808e tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:00 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-1c257020-c095-47ef-90c5-b2e6179d808e tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Deleted allocations for instance 7f1a88ea-83a3-447b-a83d-40b2c1c908f5
Nov 14 00:47:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1c257020-c095-47ef-90c5-b2e6179d808e tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Lock "7f1a88ea-83a3-447b-a83d-40b2c1c908f5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.693s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:01 user nova-compute[74850]: DEBUG nova.compute.manager [req-de8725a1-f1b8-429d-b544-f898507fc9db req-6bfc9293-f06f-4a11-aa4f-3acb25978c0c service nova] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Received event network-vif-plugged-4a56ca60-9419-4150-8a41-81d8709e001c {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-de8725a1-f1b8-429d-b544-f898507fc9db req-6bfc9293-f06f-4a11-aa4f-3acb25978c0c service nova] Acquiring lock "7f1a88ea-83a3-447b-a83d-40b2c1c908f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-de8725a1-f1b8-429d-b544-f898507fc9db req-6bfc9293-f06f-4a11-aa4f-3acb25978c0c service nova] Lock "7f1a88ea-83a3-447b-a83d-40b2c1c908f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-de8725a1-f1b8-429d-b544-f898507fc9db req-6bfc9293-f06f-4a11-aa4f-3acb25978c0c service nova] Lock "7f1a88ea-83a3-447b-a83d-40b2c1c908f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:01 user nova-compute[74850]: DEBUG nova.compute.manager [req-de8725a1-f1b8-429d-b544-f898507fc9db req-6bfc9293-f06f-4a11-aa4f-3acb25978c0c service nova] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] No waiting events found dispatching network-vif-plugged-4a56ca60-9419-4150-8a41-81d8709e001c {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:47:01 user nova-compute[74850]: WARNING nova.compute.manager [req-de8725a1-f1b8-429d-b544-f898507fc9db req-6bfc9293-f06f-4a11-aa4f-3acb25978c0c service nova] [instance: 7f1a88ea-83a3-447b-a83d-40b2c1c908f5] Received unexpected event network-vif-plugged-4a56ca60-9419-4150-8a41-81d8709e001c for instance with vm_state deleted and task_state None.
Nov 14 00:47:01 user nova-compute[74850]: DEBUG nova.compute.manager [req-dc989970-7515-4fa0-9bcd-632a36aa2997 req-c35b71cd-3e77-4ecf-a617-b3955d341172 service nova] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Received event network-changed-f8d36bc2-b85b-4eaf-8c22-e58c9dae360d {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:01 user nova-compute[74850]: DEBUG nova.compute.manager [req-dc989970-7515-4fa0-9bcd-632a36aa2997 req-c35b71cd-3e77-4ecf-a617-b3955d341172 service nova] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Refreshing instance network info cache due to event network-changed-f8d36bc2-b85b-4eaf-8c22-e58c9dae360d. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:47:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-dc989970-7515-4fa0-9bcd-632a36aa2997 req-c35b71cd-3e77-4ecf-a617-b3955d341172 service nova] Acquiring lock "refresh_cache-4a2881e6-ee6e-4165-a6d9-35fda79c142d" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:47:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-dc989970-7515-4fa0-9bcd-632a36aa2997 req-c35b71cd-3e77-4ecf-a617-b3955d341172 service nova] Acquired lock "refresh_cache-4a2881e6-ee6e-4165-a6d9-35fda79c142d" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:47:01 user nova-compute[74850]: DEBUG nova.network.neutron [req-dc989970-7515-4fa0-9bcd-632a36aa2997 req-c35b71cd-3e77-4ecf-a617-b3955d341172 service nova] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Refreshing network info cache for port f8d36bc2-b85b-4eaf-8c22-e58c9dae360d {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:47:02 user nova-compute[74850]: DEBUG nova.network.neutron [req-dc989970-7515-4fa0-9bcd-632a36aa2997 req-c35b71cd-3e77-4ecf-a617-b3955d341172 service nova] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Updated VIF entry in instance network info cache for port f8d36bc2-b85b-4eaf-8c22-e58c9dae360d. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:47:02 user nova-compute[74850]: DEBUG nova.network.neutron [req-dc989970-7515-4fa0-9bcd-632a36aa2997 req-c35b71cd-3e77-4ecf-a617-b3955d341172 service nova] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Updating instance_info_cache with network_info: [{"id": "f8d36bc2-b85b-4eaf-8c22-e58c9dae360d", "address": "fa:16:3e:65:0b:b4", "network": {"id": "db670808-a8f8-441f-aa30-b55187e39c46", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-972081880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dd0e10c315346cabe45d8cb1596b3dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d36bc2-b8", "ovs_interfaceid": "f8d36bc2-b85b-4eaf-8c22-e58c9dae360d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:47:02 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-dc989970-7515-4fa0-9bcd-632a36aa2997 req-c35b71cd-3e77-4ecf-a617-b3955d341172 service nova] Releasing lock "refresh_cache-4a2881e6-ee6e-4165-a6d9-35fda79c142d" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:47:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Acquiring lock "4a2881e6-ee6e-4165-a6d9-35fda79c142d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Lock "4a2881e6-ee6e-4165-a6d9-35fda79c142d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:03 user nova-compute[74850]: DEBUG nova.objects.instance [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Lazy-loading 'flavor' on Instance uuid 4a2881e6-ee6e-4165-a6d9-35fda79c142d {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:47:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Lock "4a2881e6-ee6e-4165-a6d9-35fda79c142d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Acquiring lock "4a2881e6-ee6e-4165-a6d9-35fda79c142d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Lock "4a2881e6-ee6e-4165-a6d9-35fda79c142d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:03 user nova-compute[74850]: INFO nova.compute.manager [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Attaching volume f37e90cf-dbe9-4eb1-b389-af542a80c235 to /dev/sdc
Nov 14 00:47:03 user nova-compute[74850]: DEBUG os_brick.utils [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:47:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0af4eb-d8f2-4d90-9a07-c7ad0f2bb4f8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[46497d11-c377-49db-8bef-2225b669567d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a171bd-ae07-41af-8cc4-c3ebdbe2e9ca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d46b6d-27ce-4646-a183-47d38aae2d02]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:47:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 00:47:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:47:03 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 00:47:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[73668f42-ecb7-4906-8c70-50d0de0ee8e9]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 00:47:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 00:47:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 00:47:03 user nova-compute[74850]: DEBUG os_brick.utils [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:47:03 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Updating existing volume attachment record: 24206e9e-0326-4082-a064-29db07602535 {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 00:47:04 user nova-compute[74850]: DEBUG nova.compute.manager [req-dd88fc78-fede-45dc-bb9a-bed44a253c41 req-ba3bd4aa-5bab-4c21-81f2-0775dddbb40a service nova] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Received event network-changed-9df19d5e-989a-48d6-97ce-03b6a897a611 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:04 user nova-compute[74850]: DEBUG nova.compute.manager [req-dd88fc78-fede-45dc-bb9a-bed44a253c41 req-ba3bd4aa-5bab-4c21-81f2-0775dddbb40a service nova] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Refreshing instance network info cache due to event network-changed-9df19d5e-989a-48d6-97ce-03b6a897a611. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:47:04 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-dd88fc78-fede-45dc-bb9a-bed44a253c41 req-ba3bd4aa-5bab-4c21-81f2-0775dddbb40a service nova] Acquiring lock "refresh_cache-28212eec-99be-4171-97ed-7748bbb75c88" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:47:04 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-dd88fc78-fede-45dc-bb9a-bed44a253c41 req-ba3bd4aa-5bab-4c21-81f2-0775dddbb40a service nova] Acquired lock "refresh_cache-28212eec-99be-4171-97ed-7748bbb75c88" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:47:04 user nova-compute[74850]: DEBUG nova.network.neutron [req-dd88fc78-fede-45dc-bb9a-bed44a253c41 req-ba3bd4aa-5bab-4c21-81f2-0775dddbb40a service nova] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Refreshing network info cache for port 9df19d5e-989a-48d6-97ce-03b6a897a611 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:47:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:04 user nova-compute[74850]: DEBUG nova.network.neutron [req-dd88fc78-fede-45dc-bb9a-bed44a253c41 req-ba3bd4aa-5bab-4c21-81f2-0775dddbb40a service nova] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Updated VIF entry in instance network info cache for port 9df19d5e-989a-48d6-97ce-03b6a897a611. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:47:04 user nova-compute[74850]: DEBUG nova.network.neutron [req-dd88fc78-fede-45dc-bb9a-bed44a253c41 req-ba3bd4aa-5bab-4c21-81f2-0775dddbb40a service nova] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Updating instance_info_cache with network_info: [{"id": "9df19d5e-989a-48d6-97ce-03b6a897a611", "address": "fa:16:3e:0f:98:91", "network": {"id": "25547f45-3d27-4a3f-b2d2-6f0a0b4ae730", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-464974831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51c848440ceb46dabf1eb8cca6533f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df19d5e-98", "ovs_interfaceid": "9df19d5e-989a-48d6-97ce-03b6a897a611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:47:04 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-dd88fc78-fede-45dc-bb9a-bed44a253c41 req-ba3bd4aa-5bab-4c21-81f2-0775dddbb40a service nova] Releasing lock "refresh_cache-28212eec-99be-4171-97ed-7748bbb75c88" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:47:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Acquiring lock "937d7470-ec86-4972-b975-257d626329dd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Lock "937d7470-ec86-4972-b975-257d626329dd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:05 user nova-compute[74850]: DEBUG nova.objects.instance [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Lazy-loading 'flavor' on Instance uuid 937d7470-ec86-4972-b975-257d626329dd {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:47:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Lock "937d7470-ec86-4972-b975-257d626329dd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Acquiring lock "937d7470-ec86-4972-b975-257d626329dd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Lock "937d7470-ec86-4972-b975-257d626329dd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:05 user nova-compute[74850]: INFO nova.compute.manager [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Attaching volume 2daa0a31-2ec1-4ea6-81b7-4756aa1defdd to /dev/vdb
Nov 14 00:47:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Acquiring lock "28212eec-99be-4171-97ed-7748bbb75c88" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "28212eec-99be-4171-97ed-7748bbb75c88" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:05 user nova-compute[74850]: DEBUG nova.objects.instance [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lazy-loading 'flavor' on Instance uuid 28212eec-99be-4171-97ed-7748bbb75c88 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG os_brick.utils [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "28212eec-99be-4171-97ed-7748bbb75c88" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05414b9-9ed4-453f-95da-bc76250f76dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dafaf40-3af1-46a5-bd0b-f49df538f696]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0c5975-afc9-4cb9-a995-74db0ea8c0f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0569d3f-3293-47a6-acd6-9dce3822cd5d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:47:06 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 00:47:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb32cf4-be47-44f3-b806-8ad474f0ce70]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG os_brick.utils [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Updating existing volume attachment record: ea4a2e63-dd34-4ace-8c09-035b6ffbf662 {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Acquiring lock "28212eec-99be-4171-97ed-7748bbb75c88" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "28212eec-99be-4171-97ed-7748bbb75c88" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:06 user nova-compute[74850]: INFO nova.compute.manager [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Attaching volume f9137509-261e-4222-9682-d560cc1d53ab to /dev/vdb
Nov 14 00:47:06 user nova-compute[74850]: DEBUG os_brick.utils [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49370b9-98b4-4b42-ac74-088fc29b4849]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3cb97c-a268-4def-b6c8-f5e546866229]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa5744d-513f-4914-b972-20e3b1c21585]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e21cd55-829a-4736-880c-8a8cd16ae763]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:47:06 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 00:47:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd35d973-98bd-4344-b819-9d70d7b6faeb]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG os_brick.utils [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Updating existing volume attachment record: 33f387c4-6aa4-458e-8576-832ed2485599 {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG nova.compute.manager [req-7496266a-3c76-47a6-b631-82afed249c3e req-ca8dc8b0-8dc6-4f6f-b045-30666bd83ee1 service nova] [instance: 937d7470-ec86-4972-b975-257d626329dd] Received event network-changed-2df12354-6de2-49fd-812e-1354c7c87039 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG nova.compute.manager [req-7496266a-3c76-47a6-b631-82afed249c3e req-ca8dc8b0-8dc6-4f6f-b045-30666bd83ee1 service nova] [instance: 937d7470-ec86-4972-b975-257d626329dd] Refreshing instance network info cache due to event network-changed-2df12354-6de2-49fd-812e-1354c7c87039. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7496266a-3c76-47a6-b631-82afed249c3e req-ca8dc8b0-8dc6-4f6f-b045-30666bd83ee1 service nova] Acquiring lock "refresh_cache-937d7470-ec86-4972-b975-257d626329dd" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7496266a-3c76-47a6-b631-82afed249c3e req-ca8dc8b0-8dc6-4f6f-b045-30666bd83ee1 service nova] Acquired lock "refresh_cache-937d7470-ec86-4972-b975-257d626329dd" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG nova.network.neutron [req-7496266a-3c76-47a6-b631-82afed249c3e req-ca8dc8b0-8dc6-4f6f-b045-30666bd83ee1 service nova] [instance: 937d7470-ec86-4972-b975-257d626329dd] Refreshing network info cache for port 2df12354-6de2-49fd-812e-1354c7c87039 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG nova.network.neutron [req-7496266a-3c76-47a6-b631-82afed249c3e req-ca8dc8b0-8dc6-4f6f-b045-30666bd83ee1 service nova] [instance: 937d7470-ec86-4972-b975-257d626329dd] Updated VIF entry in instance network info cache for port 2df12354-6de2-49fd-812e-1354c7c87039. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG nova.network.neutron [req-7496266a-3c76-47a6-b631-82afed249c3e req-ca8dc8b0-8dc6-4f6f-b045-30666bd83ee1 service nova] [instance: 937d7470-ec86-4972-b975-257d626329dd] Updating instance_info_cache with network_info: [{"id": "2df12354-6de2-49fd-812e-1354c7c87039", "address": "fa:16:3e:4b:c7:91", "network": {"id": "dbe8caa9-0185-44cf-b45e-f5f0c0f3f81c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-413724990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ee2171e47543fa818dc601abc63ea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df12354-6d", "ovs_interfaceid": "2df12354-6de2-49fd-812e-1354c7c87039", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:47:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7496266a-3c76-47a6-b631-82afed249c3e req-ca8dc8b0-8dc6-4f6f-b045-30666bd83ee1 service nova] Releasing lock "refresh_cache-937d7470-ec86-4972-b975-257d626329dd" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:47:07 user nova-compute[74850]: DEBUG nova.compute.manager [req-c585393a-1ead-4e80-835d-3581c42e26f1 req-06f71d4a-4999-457f-a508-39861553958f service nova] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Received event network-changed-5db497e0-e507-4a13-b0ff-fb4f7608f94d {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:07 user nova-compute[74850]: DEBUG nova.compute.manager [req-c585393a-1ead-4e80-835d-3581c42e26f1 req-06f71d4a-4999-457f-a508-39861553958f service nova] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Refreshing instance network info cache due to event network-changed-5db497e0-e507-4a13-b0ff-fb4f7608f94d. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:47:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c585393a-1ead-4e80-835d-3581c42e26f1 req-06f71d4a-4999-457f-a508-39861553958f service nova] Acquiring lock "refresh_cache-b54b37bc-8c90-4c48-a943-e489e830b93b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:47:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c585393a-1ead-4e80-835d-3581c42e26f1 req-06f71d4a-4999-457f-a508-39861553958f service nova] Acquired lock "refresh_cache-b54b37bc-8c90-4c48-a943-e489e830b93b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:47:07 user nova-compute[74850]: DEBUG nova.network.neutron [req-c585393a-1ead-4e80-835d-3581c42e26f1 req-06f71d4a-4999-457f-a508-39861553958f service nova] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Refreshing network info cache for port 5db497e0-e507-4a13-b0ff-fb4f7608f94d {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:47:07 user nova-compute[74850]: DEBUG nova.network.neutron [req-c585393a-1ead-4e80-835d-3581c42e26f1 req-06f71d4a-4999-457f-a508-39861553958f service nova] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Updated VIF entry in instance network info cache for port 5db497e0-e507-4a13-b0ff-fb4f7608f94d. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:47:07 user nova-compute[74850]: DEBUG nova.network.neutron [req-c585393a-1ead-4e80-835d-3581c42e26f1 req-06f71d4a-4999-457f-a508-39861553958f service nova] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Updating instance_info_cache with network_info: [{"id": "5db497e0-e507-4a13-b0ff-fb4f7608f94d", "address": "fa:16:3e:75:22:ea", "network": {"id": "35cab925-9113-4bab-8203-a81035513ed6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036882895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c05ffa95fcf49d6a87d6dad2b3f0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db497e0-e5", "ovs_interfaceid": "5db497e0-e507-4a13-b0ff-fb4f7608f94d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:47:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c585393a-1ead-4e80-835d-3581c42e26f1 req-06f71d4a-4999-457f-a508-39861553958f service nova] Releasing lock "refresh_cache-b54b37bc-8c90-4c48-a943-e489e830b93b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OEzFBlvx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:47:08 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:47:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:47:08 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:47:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:47:08 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 00:47:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab55c236-44c6-441f-b87a-6f60db912960]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 00:47:08 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c067df58-4cdb-4767-b57a-bc843a8d9838]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235] added
Nov 14 00:47:08 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40896a2-58a1-4f23-82dc-773d65bade44]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6366178-43a8-451f-a18c-77728b1b0d3d]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OEzFBlvx {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OEzFBlvx" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[590846ef-e27b-4f03-b662-625c3a35ad0f]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OEzFBlvx'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a83e8d-22d4-4d89-9987-d45bab79e266]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[527aa81b-fcef-4325-8df7-b21bf0228075]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:08 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:08 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:47:08 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:08 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:08 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:08 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:08 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:08 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:08 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:47:08 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:08 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:08 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:08 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:08 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a42993a-38bf-4a8f-bcda-334790e6c5a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235, portal: 172.16.0.220,3260]
Nov 14 00:47:08 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235, portal: 172.16.0.220,3260] successful.
Nov 14 00:47:08 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aedb02f-0bed-4cae-ba58-2376f8fb550a]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9fde78-9b25-4aba-98b4-d0ec8b87b081]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 (non-flash)
Nov 14 00:47:08 user nova-compute[74850]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:08 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:08 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:47:08 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:08 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:08 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:08 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:08 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 (non-flash)
Nov 14 00:47:08 user nova-compute[74850]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:08 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:08 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:47:08 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:08 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:08 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:08 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:08 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa86b7f6-5854-4fb6-8d60-3c8722ed0a06]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:08 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: None {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:47:09 user nova-compute[74850]: INFO nova.compute.manager [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Rebuilding instance
Nov 14 00:47:09 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:47:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:09 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:47:09 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OEzFBlvx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 00:47:09 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:47:09 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23738363061303062', 'path': '/dev/sdi'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:47:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738363061303062', 'path': '/dev/sdi'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 00:47:09 user nova-compute[74850]: DEBUG nova.objects.instance [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Lazy-loading 'flavor' on Instance uuid 4a2881e6-ee6e-4165-a6d9-35fda79c142d {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:47:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 00:47:09 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:47:09 user nova-compute[74850]:   <source dev="/dev/sdi"/>
Nov 14 00:47:09 user nova-compute[74850]:   <target dev="sdc" bus="scsi"/>
Nov 14 00:47:09 user nova-compute[74850]:   <serial>f37e90cf-dbe9-4eb1-b389-af542a80c235</serial>
Nov 14 00:47:09 user nova-compute[74850]:   <address type="drive" controller="0" unit="2"/>
Nov 14 00:47:09 user nova-compute[74850]: </disk>
Nov 14 00:47:09 user nova-compute[74850]:  {{(pid=74850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 00:47:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:09 user nova-compute[74850]: DEBUG nova.compute.manager [req-b97ee893-c101-4e4b-98f7-2d9f02ab8def req-d254db5a-1c0c-424a-8ad8-a1ccf9dc6027 service nova] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Received event network-vif-unplugged-5db497e0-e507-4a13-b0ff-fb4f7608f94d {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b97ee893-c101-4e4b-98f7-2d9f02ab8def req-d254db5a-1c0c-424a-8ad8-a1ccf9dc6027 service nova] Acquiring lock "b54b37bc-8c90-4c48-a943-e489e830b93b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b97ee893-c101-4e4b-98f7-2d9f02ab8def req-d254db5a-1c0c-424a-8ad8-a1ccf9dc6027 service nova] Lock "b54b37bc-8c90-4c48-a943-e489e830b93b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b97ee893-c101-4e4b-98f7-2d9f02ab8def req-d254db5a-1c0c-424a-8ad8-a1ccf9dc6027 service nova] Lock "b54b37bc-8c90-4c48-a943-e489e830b93b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:09 user nova-compute[74850]: DEBUG nova.compute.manager [req-b97ee893-c101-4e4b-98f7-2d9f02ab8def req-d254db5a-1c0c-424a-8ad8-a1ccf9dc6027 service nova] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] No waiting events found dispatching network-vif-unplugged-5db497e0-e507-4a13-b0ff-fb4f7608f94d {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:47:09 user nova-compute[74850]: WARNING nova.compute.manager [req-b97ee893-c101-4e4b-98f7-2d9f02ab8def req-d254db5a-1c0c-424a-8ad8-a1ccf9dc6027 service nova] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Received unexpected event network-vif-unplugged-5db497e0-e507-4a13-b0ff-fb4f7608f94d for instance with vm_state active and task_state rebuilding.
Nov 14 00:47:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] No BDM found with device name sda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] No VIF found with MAC fa:16:3e:65:0b:b4, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-69bb3697-d779-4c2a-ba5a-05f2e8ac8b34 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Lock "4a2881e6-ee6e-4165-a6d9-35fda79c142d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.710s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:10 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Instance destroyed successfully.
Nov 14 00:47:10 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Instance destroyed successfully.
Nov 14 00:47:10 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:45:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1046338121',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1407646081',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6k6B6AwbocNisCO4Eq2JgavF/MwPMPgsSfJ4CZC+5MU8+G1Higk1jdnJvqwYlgQxsBYLb1AOlev2ixcNIA7eSaJMrT6i+cl48pJKEqDssTEhOLedhY/A00Q2wZRBoCKw==',key_name='tempest-keypair-1347631522',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:45:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9c05ffa95fcf49d6a87d6dad2b3f0983',ramdisk_id='',reservation_id='r-3ge02sav',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-676489401',owner_user_name='tempest-ServerActionsV293TestJSON-676489401-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:47:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a609a827db1a4e2ca232e7bc8880ed0b',uuid=b54b37bc-8c90-4c48-a943-e489e830b93b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5db497e0-e507-4a13-b0ff-fb4f7608f94d", "address": "fa:16:3e:75:22:ea", "network": {"id": "35cab925-9113-4bab-8203-a81035513ed6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036882895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c05ffa95fcf49d6a87d6dad2b3f0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db497e0-e5", "ovs_interfaceid": "5db497e0-e507-4a13-b0ff-fb4f7608f94d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Converting VIF {"id": "5db497e0-e507-4a13-b0ff-fb4f7608f94d", "address": "fa:16:3e:75:22:ea", "network": {"id": "35cab925-9113-4bab-8203-a81035513ed6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036882895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c05ffa95fcf49d6a87d6dad2b3f0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db497e0-e5", "ovs_interfaceid": "5db497e0-e507-4a13-b0ff-fb4f7608f94d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:22:ea,bridge_name='br-int',has_traffic_filtering=True,id=5db497e0-e507-4a13-b0ff-fb4f7608f94d,network=Network(35cab925-9113-4bab-8203-a81035513ed6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db497e0-e5') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG os_vif [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:22:ea,bridge_name='br-int',has_traffic_filtering=True,id=5db497e0-e507-4a13-b0ff-fb4f7608f94d,network=Network(35cab925-9113-4bab-8203-a81035513ed6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db497e0-e5') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5db497e0-e5, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=611b58ea-9dd8-419e-99ea-c3fc7da5bee6) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:47:10 user nova-compute[74850]: INFO os_vif [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:22:ea,bridge_name='br-int',has_traffic_filtering=True,id=5db497e0-e507-4a13-b0ff-fb4f7608f94d,network=Network(35cab925-9113-4bab-8203-a81035513ed6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db497e0-e5')
Nov 14 00:47:10 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lwKDFPxQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:47:10 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 00:47:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2181d63-71ce-4d63-b8fb-922ca2acf0bd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 00:47:10 user nova-compute[74850]: No targets found.
Nov 14 00:47:10 user nova-compute[74850]: iSNS:
Nov 14 00:47:10 user nova-compute[74850]: No targets found.
Nov 14 00:47:10 user nova-compute[74850]: STATIC:
Nov 14 00:47:10 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606
Nov 14 00:47:10 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:10 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:10 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235
Nov 14 00:47:10 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:10 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:10 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83
Nov 14 00:47:10 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:10 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:10 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8
Nov 14 00:47:10 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:10 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:10 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec
Nov 14 00:47:10 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:10 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:10 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c
Nov 14 00:47:10 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:10 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:10 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732
Nov 14 00:47:10 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:10 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:10 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a
Nov 14 00:47:10 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:10 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:10 user nova-compute[74850]: FIRMWARE:
Nov 14 00:47:10 user nova-compute[74850]: No targets found.
Nov 14 00:47:10 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 00:47:10 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 00:47:10 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[612b640a-3460-4bce-a974-7144e33a144c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[83536715-cb5d-4ca8-a39f-b28b27316f5c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 (non-flash)
Nov 14 00:47:10 user nova-compute[74850]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:10 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:10 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:47:10 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:10 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:10 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:10 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:10 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 (non-flash)
Nov 14 00:47:10 user nova-compute[74850]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:10 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:10 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:47:10 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:10 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:10 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:10 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:10 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a5c252e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a'): ({'sdb'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Removing single pathed devices sdb {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4df3208-686b-473f-9a5e-dc7a89cb131a]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac3ec28-6964-456c-a4df-cc6c4db7076f]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Flushing IO for device /dev/sdb {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89203f4-0037-46f4-930f-c6fa8225613e]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65decd1-ce6b-4e3a-b76f-cf4e2d064a7e]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO53c8f11d-8538281eadab9eea', '/dev/disk/by-id/scsi-23835333832383165', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_53c8f11d') {{(pid=84948) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[39211cb8-64c2-40e4-8622-1b83ef0562d3]: (4, None) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f553025-5bde-4b1c-8179-0596733f63b1]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0248de2b-3449-4cba-8c30-293db3926d28]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a, portal: 172.16.0.220,3260]
Nov 14 00:47:10 user nova-compute[74850]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a, portal: 172.16.0.220,3260] successful.
Nov 14 00:47:10 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69d01b2-ba97-4575-b677-f940ff76bb36]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] <== disconnect_volume: return (365ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 00:47:10 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Deleting instance files /opt/stack/data/nova/instances/b54b37bc-8c90-4c48-a943-e489e830b93b_del
Nov 14 00:47:10 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Deletion of /opt/stack/data/nova/instances/b54b37bc-8c90-4c48-a943-e489e830b93b_del complete
Nov 14 00:47:10 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EAeKbcZw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:47:10 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:47:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:47:10 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:47:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:47:10 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[077e0465-0705-4e27-8d8e-4a249b4124d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 00:47:10 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc717aed-c5fe-4a25-ac4f-70b4b9a724fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd] added
Nov 14 00:47:10 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e542f289-a666-445f-a5ba-69487bea896c]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf5a6f6-5505-4f01-a76d-339117441b02]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:10 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance b54b37bc-8c90-4c48-a943-e489e830b93b could not be found.
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EAeKbcZw {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EAeKbcZw" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1497fe2-9153-4619-b867-1239b2393539]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EAeKbcZw'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f2fe50a5-d3c5-4278-9060-f98e04ce3681 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Acquiring lock "4a2881e6-ee6e-4165-a6d9-35fda79c142d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f2fe50a5-d3c5-4278-9060-f98e04ce3681 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Lock "4a2881e6-ee6e-4165-a6d9-35fda79c142d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lwKDFPxQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:47:11 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 00:47:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[75478f20-d9fa-49ca-a518-42d422d04d3d]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:11 user nova-compute[74850]: INFO nova.compute.manager [None req-f2fe50a5-d3c5-4278-9060-f98e04ce3681 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Detaching volume f37e90cf-dbe9-4eb1-b389-af542a80c235
Nov 14 00:47:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[483e3aed-e732-452e-b56f-6538145103f1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 (non-flash)
Nov 14 00:47:11 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:11 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:47:11 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:11 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:11 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:11 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:11 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 (non-flash)
Nov 14 00:47:11 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:11 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:47:11 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:11 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:11 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:11 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:11 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:11 user nova-compute[74850]: INFO nova.virt.block_device [None req-f2fe50a5-d3c5-4278-9060-f98e04ce3681 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Attempting to driver detach volume f37e90cf-dbe9-4eb1-b389-af542a80c235 from mountpoint /dev/sdc
Nov 14 00:47:11 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-f2fe50a5-d3c5-4278-9060-f98e04ce3681 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Attempting to detach device sdc from instance 4a2881e6-ee6e-4165-a6d9-35fda79c142d from the persistent domain config. {{(pid=74850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-f2fe50a5-d3c5-4278-9060-f98e04ce3681 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 00:47:11 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:47:11 user nova-compute[74850]:   <source dev="/dev/sdi"/>
Nov 14 00:47:11 user nova-compute[74850]:   <target dev="sdc" bus="scsi"/>
Nov 14 00:47:11 user nova-compute[74850]:   <serial>f37e90cf-dbe9-4eb1-b389-af542a80c235</serial>
Nov 14 00:47:11 user nova-compute[74850]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 14 00:47:11 user nova-compute[74850]: </disk>
Nov 14 00:47:11 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 00:47:11 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-f2fe50a5-d3c5-4278-9060-f98e04ce3681 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Successfully detached device sdc from instance 4a2881e6-ee6e-4165-a6d9-35fda79c142d from the persistent domain config.
Nov 14 00:47:11 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-f2fe50a5-d3c5-4278-9060-f98e04ce3681 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 4a2881e6-ee6e-4165-a6d9-35fda79c142d from the live domain config. {{(pid=74850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-f2fe50a5-d3c5-4278-9060-f98e04ce3681 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 00:47:11 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:47:11 user nova-compute[74850]:   <source dev="/dev/sdi"/>
Nov 14 00:47:11 user nova-compute[74850]:   <target dev="sdc" bus="scsi"/>
Nov 14 00:47:11 user nova-compute[74850]:   <serial>f37e90cf-dbe9-4eb1-b389-af542a80c235</serial>
Nov 14 00:47:11 user nova-compute[74850]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 14 00:47:11 user nova-compute[74850]: </disk>
Nov 14 00:47:11 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[27be0a96-c3d5-473b-bf56-ac0854c7db8d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd, portal: 172.16.0.220,3260]
Nov 14 00:47:11 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd, portal: 172.16.0.220,3260] successful.
Nov 14 00:47:11 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aElnmDud', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:47:11 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:47:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da20521-b303-45ee-8de9-349acc94152b]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[74509bfe-0d94-42ec-90f1-fb7aed45106e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 (non-flash)
Nov 14 00:47:11 user nova-compute[74850]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)
Nov 14 00:47:11 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:11 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:47:11 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:11 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:11 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:11 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:11 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 (non-flash)
Nov 14 00:47:11 user nova-compute[74850]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)
Nov 14 00:47:11 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:11 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:47:11 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:11 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:11 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:11 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:11 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.430s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] HCTL ('33', '-', '-', 0) found on session 11 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[678f6ba1-1809-408a-afe6-418dd2075715]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EAeKbcZw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-f2fe50a5-d3c5-4278-9060-f98e04ce3681 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 4a2881e6-ee6e-4165-a6d9-35fda79c142d {{(pid=74850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG nova.compute.manager [req-84c4938b-3a09-45e8-a5d8-9f23990e2b1c req-b934dffc-e835-4c6f-9705-29a8c51fa9ea service nova] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Received event network-vif-plugged-5db497e0-e507-4a13-b0ff-fb4f7608f94d {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-84c4938b-3a09-45e8-a5d8-9f23990e2b1c req-b934dffc-e835-4c6f-9705-29a8c51fa9ea service nova] Acquiring lock "b54b37bc-8c90-4c48-a943-e489e830b93b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-84c4938b-3a09-45e8-a5d8-9f23990e2b1c req-b934dffc-e835-4c6f-9705-29a8c51fa9ea service nova] Lock "b54b37bc-8c90-4c48-a943-e489e830b93b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-84c4938b-3a09-45e8-a5d8-9f23990e2b1c req-b934dffc-e835-4c6f-9705-29a8c51fa9ea service nova] Lock "b54b37bc-8c90-4c48-a943-e489e830b93b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:11 user nova-compute[74850]: DEBUG nova.compute.manager [req-84c4938b-3a09-45e8-a5d8-9f23990e2b1c req-b934dffc-e835-4c6f-9705-29a8c51fa9ea service nova] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] No waiting events found dispatching network-vif-plugged-5db497e0-e507-4a13-b0ff-fb4f7608f94d {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:47:11 user nova-compute[74850]: WARNING nova.compute.manager [req-84c4938b-3a09-45e8-a5d8-9f23990e2b1c req-b934dffc-e835-4c6f-9705-29a8c51fa9ea service nova] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Received unexpected event network-vif-plugged-5db497e0-e507-4a13-b0ff-fb4f7608f94d for instance with vm_state active and task_state rebuilding.
Nov 14 00:47:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.462s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] <== connect_volume: return (1464ms) {'type': 'block', 'scsi_wwn': '23161643134626363', 'path': '/dev/sdb'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161643134626363', 'path': '/dev/sdb'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.236s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG nova.objects.instance [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Lazy-loading 'flavor' on Instance uuid 937d7470-ec86-4972-b975-257d626329dd {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[132a7858-5818-41c0-b3b2-ce89abb7dd6c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 00:47:12 user nova-compute[74850]: No targets found.
Nov 14 00:47:12 user nova-compute[74850]: iSNS:
Nov 14 00:47:12 user nova-compute[74850]: No targets found.
Nov 14 00:47:12 user nova-compute[74850]: STATIC:
Nov 14 00:47:12 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd
Nov 14 00:47:12 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:12 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:12 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606
Nov 14 00:47:12 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:12 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:12 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235
Nov 14 00:47:12 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:12 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:12 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83
Nov 14 00:47:12 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:12 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:12 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8
Nov 14 00:47:12 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:12 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:12 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec
Nov 14 00:47:12 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:12 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:12 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c
Nov 14 00:47:12 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:12 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:12 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732
Nov 14 00:47:12 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:12 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:12 user nova-compute[74850]: FIRMWARE:
Nov 14 00:47:12 user nova-compute[74850]: No targets found.
Nov 14 00:47:12 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 00:47:12 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 00:47:12 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 00:47:12 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:47:12 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 00:47:12 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:47:12 user nova-compute[74850]:   <serial>2daa0a31-2ec1-4ea6-81b7-4756aa1defdd</serial>
Nov 14 00:47:12 user nova-compute[74850]: </disk>
Nov 14 00:47:12 user nova-compute[74850]:  {{(pid=74850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdf596d-2c75-4782-88b2-103ba61ff95a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[825a9e76-eb97-4ce9-b7e1-b67568a098ee]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:12 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:12 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a5c2500d0>, {}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Disconnecting from: [] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.089s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] <== disconnect_volume: return (1325ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.166s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:47:12 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:47:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:47:12 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cd4f35-7c24-4975-afe3-935155e0c985]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 00:47:12 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb125848-d1d1-46fc-8043-b9540045e1ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab] added
Nov 14 00:47:12 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b870d0-d10a-4805-b04f-bc47721ed82c]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[564035ec-0848-4a6c-bde1-8705f3f3d896]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aElnmDud {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aElnmDud" returned: 0 in 0.031s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c644a43b-81c5-43c7-abb6-352a8d00512b]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aElnmDud'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[350c4802-4ed5-4019-bda5-6b56f6508f3b]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[712ad923-ea31-413c-a3a0-53eaa8a406ec]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:12 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:12 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9297740-a0ed-435e-9b50-a8997611eb85]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab, portal: 172.16.0.220,3260]
Nov 14 00:47:12 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab, portal: 172.16.0.220,3260] successful.
Nov 14 00:47:12 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf862e2-706f-45ae-a084-e421a6ebf509]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d136228e-1f77-465f-8105-90a04bcd479f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:12 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:12 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:12 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] HCTL ('41', '-', '-', 0) found on session 12 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] No VIF found with MAC fa:16:3e:4b:c7:91, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[af633124-d0e2-46f9-a174-dbb19060c5ec]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Searching for a device in session 12 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aElnmDud', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 00:47:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-889f3309-ece8-4872-88a9-5002bddda31a tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Lock "937d7470-ec86-4972-b975-257d626329dd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.852s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:13 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Preparing to wait for external event volume-reimaged-ef003978-0c16-4a36-b762-c86ac032e85a {{(pid=74850) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 14 00:47:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Acquiring lock "b54b37bc-8c90-4c48-a943-e489e830b93b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Lock "b54b37bc-8c90-4c48-a943-e489e830b93b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Lock "b54b37bc-8c90-4c48-a943-e489e830b93b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:13 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:47:13 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] <== connect_volume: return (2536ms) {'type': 'block', 'scsi_wwn': '23136343439366534', 'path': '/dev/sdj'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:47:13 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136343439366534', 'path': '/dev/sdj'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 00:47:13 user nova-compute[74850]: DEBUG nova.objects.instance [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lazy-loading 'flavor' on Instance uuid 28212eec-99be-4171-97ed-7748bbb75c88 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:47:13 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 00:47:13 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:47:13 user nova-compute[74850]:   <source dev="/dev/sdj"/>
Nov 14 00:47:13 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:47:13 user nova-compute[74850]:   <serial>f9137509-261e-4222-9682-d560cc1d53ab</serial>
Nov 14 00:47:13 user nova-compute[74850]: </disk>
Nov 14 00:47:13 user nova-compute[74850]:  {{(pid=74850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 00:47:14 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:47:14 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:47:14 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] No VIF found with MAC fa:16:3e:0f:98:91, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:47:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Acquiring lock "937d7470-ec86-4972-b975-257d626329dd" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Lock "937d7470-ec86-4972-b975-257d626329dd" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9aa1be68-1108-4fdb-97df-90250c60aae3 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "28212eec-99be-4171-97ed-7748bbb75c88" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.077s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:14 user nova-compute[74850]: DEBUG os_brick.utils [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:47:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:14 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[73517649-a127-48fb-96a8-25d345a1c991]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:14 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b31ddf-b860-4fc7-ac10-e0a2915da5df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:14 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[120b7f4a-9de9-4780-97c8-93ef61f5e91d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:14 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b194f08-dd25-4d95-a44e-52eedcbe5b32]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:47:14 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 00:47:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:47:14 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 00:47:14 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d5fc2e-febe-4971-a036-06e5bebc07c9]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:14 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 00:47:14 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 00:47:14 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 00:47:14 user nova-compute[74850]: DEBUG os_brick.utils [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:47:14 user nova-compute[74850]: INFO nova.compute.manager [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] [instance: 937d7470-ec86-4972-b975-257d626329dd] Swapping volume 2daa0a31-2ec1-4ea6-81b7-4756aa1defdd for 2f63338a-4acf-4574-b01e-b1785897d706
Nov 14 00:47:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:15 user nova-compute[74850]: DEBUG nova.compute.manager [req-ddfcef86-cef7-4e5d-bb4d-7bd8602f7179 req-667a0b48-4ea8-4ba3-8dde-847a29a22387 service nova] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Received event network-changed-e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:15 user nova-compute[74850]: DEBUG nova.compute.manager [req-ddfcef86-cef7-4e5d-bb4d-7bd8602f7179 req-667a0b48-4ea8-4ba3-8dde-847a29a22387 service nova] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Refreshing instance network info cache due to event network-changed-e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:47:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ddfcef86-cef7-4e5d-bb4d-7bd8602f7179 req-667a0b48-4ea8-4ba3-8dde-847a29a22387 service nova] Acquiring lock "refresh_cache-faeb3377-d199-472b-9ee2-f504d5ac9ac4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:47:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ddfcef86-cef7-4e5d-bb4d-7bd8602f7179 req-667a0b48-4ea8-4ba3-8dde-847a29a22387 service nova] Acquired lock "refresh_cache-faeb3377-d199-472b-9ee2-f504d5ac9ac4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:47:15 user nova-compute[74850]: DEBUG nova.network.neutron [req-ddfcef86-cef7-4e5d-bb4d-7bd8602f7179 req-667a0b48-4ea8-4ba3-8dde-847a29a22387 service nova] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Refreshing network info cache for port e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:47:15 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Acquiring lock "faeb3377-d199-472b-9ee2-f504d5ac9ac4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Lock "faeb3377-d199-472b-9ee2-f504d5ac9ac4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:15 user nova-compute[74850]: DEBUG nova.objects.instance [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Lazy-loading 'flavor' on Instance uuid faeb3377-d199-472b-9ee2-f504d5ac9ac4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:47:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Lock "faeb3377-d199-472b-9ee2-f504d5ac9ac4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2eae3eca-fa1a-4e97-bf69-88102980a8bc tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Acquiring lock "28212eec-99be-4171-97ed-7748bbb75c88" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2eae3eca-fa1a-4e97-bf69-88102980a8bc tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "28212eec-99be-4171-97ed-7748bbb75c88" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:15 user nova-compute[74850]: INFO nova.compute.manager [None req-2eae3eca-fa1a-4e97-bf69-88102980a8bc tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Detaching volume f9137509-261e-4222-9682-d560cc1d53ab
Nov 14 00:47:15 user nova-compute[74850]: INFO nova.virt.block_device [None req-2eae3eca-fa1a-4e97-bf69-88102980a8bc tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Attempting to driver detach volume f9137509-261e-4222-9682-d560cc1d53ab from mountpoint /dev/vdb
Nov 14 00:47:15 user nova-compute[74850]: DEBUG nova.network.neutron [req-ddfcef86-cef7-4e5d-bb4d-7bd8602f7179 req-667a0b48-4ea8-4ba3-8dde-847a29a22387 service nova] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Updated VIF entry in instance network info cache for port e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:47:15 user nova-compute[74850]: DEBUG nova.network.neutron [req-ddfcef86-cef7-4e5d-bb4d-7bd8602f7179 req-667a0b48-4ea8-4ba3-8dde-847a29a22387 service nova] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Updating instance_info_cache with network_info: [{"id": "e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa", "address": "fa:16:3e:f4:17:52", "network": {"id": "1e997e66-8753-4b3a-a6c9-26ba2a6152fa", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1625339302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa47b07cec543abbcfe0c27cb06e591", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5356eac-6f", "ovs_interfaceid": "e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:47:15 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2eae3eca-fa1a-4e97-bf69-88102980a8bc tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Attempting to detach device vdb from instance 28212eec-99be-4171-97ed-7748bbb75c88 from the persistent domain config. {{(pid=74850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 00:47:15 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-2eae3eca-fa1a-4e97-bf69-88102980a8bc tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 00:47:15 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:47:15 user nova-compute[74850]:   <source dev="/dev/sdj"/>
Nov 14 00:47:15 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:47:15 user nova-compute[74850]:   <serial>f9137509-261e-4222-9682-d560cc1d53ab</serial>
Nov 14 00:47:15 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 00:47:15 user nova-compute[74850]: </disk>
Nov 14 00:47:15 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 00:47:15 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-2eae3eca-fa1a-4e97-bf69-88102980a8bc tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Successfully detached device vdb from instance 28212eec-99be-4171-97ed-7748bbb75c88 from the persistent domain config.
Nov 14 00:47:15 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2eae3eca-fa1a-4e97-bf69-88102980a8bc tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 28212eec-99be-4171-97ed-7748bbb75c88 from the live domain config. {{(pid=74850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 00:47:15 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-2eae3eca-fa1a-4e97-bf69-88102980a8bc tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 00:47:15 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:47:15 user nova-compute[74850]:   <source dev="/dev/sdj"/>
Nov 14 00:47:15 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:47:15 user nova-compute[74850]:   <serial>f9137509-261e-4222-9682-d560cc1d53ab</serial>
Nov 14 00:47:15 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 00:47:15 user nova-compute[74850]: </disk>
Nov 14 00:47:15 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 00:47:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ddfcef86-cef7-4e5d-bb4d-7bd8602f7179 req-667a0b48-4ea8-4ba3-8dde-847a29a22387 service nova] Releasing lock "refresh_cache-faeb3377-d199-472b-9ee2-f504d5ac9ac4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:47:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Acquiring lock "faeb3377-d199-472b-9ee2-f504d5ac9ac4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Lock "faeb3377-d199-472b-9ee2-f504d5ac9ac4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:15 user nova-compute[74850]: INFO nova.compute.manager [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Attaching volume 8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 to /dev/vdb
Nov 14 00:47:15 user nova-compute[74850]: DEBUG os_brick.utils [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:47:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:15 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e088a24-4795-431f-991f-41ee2778a7fa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:15 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c157e0-9d4e-4cbb-bfcc-b0f6f4c57972]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:15 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6568f0d-198d-4138-beb7-bb79a0e7210b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:15 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a421b9-1da3-4f3a-958a-f6c51b869642]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:47:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 00:47:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:47:15 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 00:47:15 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9d5bec-d455-43d5-bb0c-afe8ed7ab741]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 00:47:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 00:47:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 00:47:15 user nova-compute[74850]: DEBUG os_brick.utils [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:47:15 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Updating existing volume attachment record: 8f2b9ea6-701a-45c7-b906-d855c73f47ea {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 00:47:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2eae3eca-fa1a-4e97-bf69-88102980a8bc tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 28212eec-99be-4171-97ed-7748bbb75c88 {{(pid=74850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG nova.compute.manager [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] [instance: 937d7470-ec86-4972-b975-257d626329dd] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UrfPgXNy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '937d7470-ec86-4972-b975-257d626329dd', 'attached_at': '', 'detached_at': '', 'volume_id': '2f63338a-4acf-4574-b01e-b1785897d706', 'serial': '2f63338a-4acf-4574-b01e-b1785897d706'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EAeKbcZw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '937d7470-ec86-4972-b975-257d626329dd', 'attached_at': '', 'detached_at': '', 'volume_id': '2daa0a31-2ec1-4ea6-81b7-4756aa1defdd', 'serial'} {{(pid=74850) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] [instance: 937d7470-ec86-4972-b975-257d626329dd] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UrfPgXNy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:47:19 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:47:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:47:19 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:47:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:47:19 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 00:47:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[71aa6054-3138-4118-964d-c83f3ad2536f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 00:47:19 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[64abd993-971b-4ed5-92d7-f1d7e7557c44]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706] added
Nov 14 00:47:19 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d39282c-ead7-4e57-9989-edf3574e5fc3]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[895bb685-7675-4261-ad66-724bced1a1b2]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UrfPgXNy {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UrfPgXNy" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0162ee55-5e7e-4b4f-afd6-35ad48d85171]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UrfPgXNy'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2412aa0-a139-462e-b3d7-b45c2a6df68d]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ec1221-fc05-43df-a46c-45f0b759bfca]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 (non-flash)
Nov 14 00:47:19 user nova-compute[74850]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)
Nov 14 00:47:19 user nova-compute[74850]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)
Nov 14 00:47:19 user nova-compute[74850]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:19 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:19 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:47:19 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:19 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:19 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:19 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:19 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 (non-flash)
Nov 14 00:47:19 user nova-compute[74850]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)
Nov 14 00:47:19 user nova-compute[74850]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)
Nov 14 00:47:19 user nova-compute[74850]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:19 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:19 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:47:19 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:19 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:19 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:19 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:19 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[874dabc4-78b0-4eaf-85bf-9ef51a4a38b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706, portal: 172.16.0.220,3260]
Nov 14 00:47:19 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706, portal: 172.16.0.220,3260] successful.
Nov 14 00:47:19 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42b3939-27cb-4d7b-8f9c-d0aeec3d0efe]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d67831-ac0c-4967-ad30-5e6d286b7a7c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 (non-flash)
Nov 14 00:47:19 user nova-compute[74850]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)
Nov 14 00:47:19 user nova-compute[74850]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)
Nov 14 00:47:19 user nova-compute[74850]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:19 user nova-compute[74850]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)
Nov 14 00:47:19 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:19 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:47:19 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:19 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:19 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:19 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:19 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 (non-flash)
Nov 14 00:47:19 user nova-compute[74850]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)
Nov 14 00:47:19 user nova-compute[74850]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)
Nov 14 00:47:19 user nova-compute[74850]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:19 user nova-compute[74850]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)
Nov 14 00:47:19 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:19 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:47:19 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:19 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:19 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:19 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:19 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] HCTL ('43', '-', '-', 0) found on session 14 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Scanning host 43 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb33fb6-be57-43bb-b456-401bf4ae9760]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Searching for a device in session 14 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UrfPgXNy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 00:47:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mfruNOxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:47:20 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:47:20 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '26530386230303338', 'path': '/dev/sdl'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] [instance: 937d7470-ec86-4972-b975-257d626329dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530386230303338', 'path': '/dev/sdl'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.123s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:47:20 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:47:20 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:47:20 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 00:47:20 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG nova.objects.instance [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Lazy-loading 'flavor' on Instance uuid 937d7470-ec86-4972-b975-257d626329dd {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30d1b53-7d79-4148-a697-09911c99dbe6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 00:47:20 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[049f4337-e526-4637-a62d-0e0f3c4eda7a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2] added
Nov 14 00:47:20 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b0c98a-7e23-40da-b3f0-2edcedcfbccb]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[65260342-835d-4d12-b666-a204df929a86]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mfruNOxe {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mfruNOxe" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[588916d2-b574-4806-8002-245968912946]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mfruNOxe'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9851520f-a8ba-468f-9584-ab5f75558429]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.079s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[962f51f5-dca5-4d07-8dc1-d6c5a9bcf148]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 (non-flash)
Nov 14 00:47:20 user nova-compute[74850]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)
Nov 14 00:47:20 user nova-compute[74850]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)
Nov 14 00:47:20 user nova-compute[74850]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:20 user nova-compute[74850]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)
Nov 14 00:47:20 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:20 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:47:20 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:20 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:20 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:20 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:20 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 (non-flash)
Nov 14 00:47:20 user nova-compute[74850]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)
Nov 14 00:47:20 user nova-compute[74850]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)
Nov 14 00:47:20 user nova-compute[74850]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:20 user nova-compute[74850]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)
Nov 14 00:47:20 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:20 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:47:20 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:20 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:20 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:20 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:20 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 -p 172.16.0.220:3260 --login" returned: 0 in 0.106s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8bb5e2-16a1-451b-8c83-1024d61048c9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:20 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2, portal: 172.16.0.220,3260]
Nov 14 00:47:20 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2, portal: 172.16.0.220,3260] successful.
Nov 14 00:47:20 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.146s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:21 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5e6b40-3465-49ba-a85c-50765e2487b2]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.053s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:21 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9295df78-ac0d-4fee-bc07-377c7e6210ab]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 (non-flash)
Nov 14 00:47:21 user nova-compute[74850]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)
Nov 14 00:47:21 user nova-compute[74850]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)
Nov 14 00:47:21 user nova-compute[74850]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:21 user nova-compute[74850]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)
Nov 14 00:47:21 user nova-compute[74850]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)
Nov 14 00:47:21 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:21 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:47:21 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:21 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:21 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:21 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:21 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 (non-flash)
Nov 14 00:47:21 user nova-compute[74850]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)
Nov 14 00:47:21 user nova-compute[74850]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)
Nov 14 00:47:21 user nova-compute[74850]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:21 user nova-compute[74850]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)
Nov 14 00:47:21 user nova-compute[74850]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)
Nov 14 00:47:21 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:21 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:47:21 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:21 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:21 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:21 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:21 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:47:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.623s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:47:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 00:47:21 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] HCTL ('44', '-', '-', 0) found on session 15 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 00:47:21 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Scanning host 44 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 00:47:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host44/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host44/scan" returned: 0 in 0.029s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:21 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1288b263-cff7-457f-90ce-c499b7e108dd]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:21 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Searching for a device in session 15 and hctl ['44', '*', '*', 0] yield: sdm {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:47:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Connected to sdm using {'target_iqn': 'iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mfruNOxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 00:47:21 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 00:47:21 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] COPY block job progress, current cursor: 150994944 final cursor: 1073741824 {{(pid=74850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 00:47:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.684s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:47:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] <== connect_volume: return (1808ms) {'type': 'block', 'scsi_wwn': '23563396632666163', 'path': '/dev/sdm'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:47:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563396632666163', 'path': '/dev/sdm'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 00:47:22 user nova-compute[74850]: DEBUG nova.objects.instance [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Lazy-loading 'flavor' on Instance uuid faeb3377-d199-472b-9ee2-f504d5ac9ac4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:47:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] COPY block job progress, current cursor: 286261248 final cursor: 1073741824 {{(pid=74850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 00:47:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] attach device xml: <disk type="block" device="disk">
Nov 14 00:47:22 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:47:22 user nova-compute[74850]:   <source dev="/dev/sdm"/>
Nov 14 00:47:22 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:47:22 user nova-compute[74850]:   <serial>8b3c8867-75a4-4117-8b2f-9e9491d4bfa2</serial>
Nov 14 00:47:22 user nova-compute[74850]: </disk>
Nov 14 00:47:22 user nova-compute[74850]:  {{(pid=74850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 00:47:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] COPY block job progress, current cursor: 424673280 final cursor: 1073741824 {{(pid=74850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 00:47:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:47:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:47:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] No VIF found with MAC fa:16:3e:f4:17:52, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:47:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9ef06a9f-99b5-4c8d-b8fa-422b7ca831ef tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Lock "faeb3377-d199-472b-9ee2-f504d5ac9ac4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.407s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:23 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] COPY block job progress, current cursor: 527433728 final cursor: 1073741824 {{(pid=74850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 00:47:23 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-c0715ab5-0210-43d3-a395-69faed67430a tempest-VolumesAssistedSnapshotsTest-1812766378 tempest-VolumesAssistedSnapshotsTest-1812766378-project] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] volume_snapshot_create: create_info: {'snapshot_id': '98ccf335-3ded-473f-b339-d7c52637b3da', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74850) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 14 00:47:23 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-c0715ab5-0210-43d3-a395-69faed67430a tempest-VolumesAssistedSnapshotsTest-1812766378 tempest-VolumesAssistedSnapshotsTest-1812766378-project] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] snap xml: <domainsnapshot>
Nov 14 00:47:23 user nova-compute[74850]:   <disks>
Nov 14 00:47:23 user nova-compute[74850]:     <disk name="/dev/sdm" snapshot="external" type="file">
Nov 14 00:47:23 user nova-compute[74850]:       <source file="/dev/new_file"/>
Nov 14 00:47:23 user nova-compute[74850]:     </disk>
Nov 14 00:47:23 user nova-compute[74850]:     <disk name="vda" snapshot="no"/>
Nov 14 00:47:23 user nova-compute[74850]:   </disks>
Nov 14 00:47:23 user nova-compute[74850]: </domainsnapshot>
Nov 14 00:47:23 user nova-compute[74850]:  {{(pid=74850) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 14 00:47:23 user nova-compute[74850]: DEBUG nova.objects.instance [None req-c0715ab5-0210-43d3-a395-69faed67430a tempest-VolumesAssistedSnapshotsTest-1812766378 tempest-VolumesAssistedSnapshotsTest-1812766378-project] Lazy-loading 'system_metadata' on Instance uuid faeb3377-d199-472b-9ee2-f504d5ac9ac4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:47:23 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] COPY block job progress, current cursor: 656408576 final cursor: 1073741824 {{(pid=74850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 00:47:23 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-c0715ab5-0210-43d3-a395-69faed67430a tempest-VolumesAssistedSnapshotsTest-1812766378 tempest-VolumesAssistedSnapshotsTest-1812766378-project] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 00:47:23 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-1f33ac93-24aa-411f-879a-50999fec03f0 tempest-VolumesAssistedSnapshotsTest-1812766378 tempest-VolumesAssistedSnapshotsTest-1812766378-project] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] volume_snapshot_delete: delete_info: {'volume_id': '8b3c8867-75a4-4117-8b2f-9e9491d4bfa2'} {{(pid=74850) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [None req-1f33ac93-24aa-411f-879a-50999fec03f0 tempest-VolumesAssistedSnapshotsTest-1812766378 tempest-VolumesAssistedSnapshotsTest-1812766378-project] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Traceback (most recent call last):
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4]     if delete_info['type'] != 'qcow2':
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] KeyError: 'type'
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] 
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [None req-c0715ab5-0210-43d3-a395-69faed67430a tempest-VolumesAssistedSnapshotsTest-1812766378 tempest-VolumesAssistedSnapshotsTest-1812766378-project] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Traceback (most recent call last):
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4]     rv = execute(f, *args, **kwargs)
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4]     six.reraise(c, e, tb)
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4]     raise value
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4]     rv = meth(*args, **kwargs)
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] 
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [None req-c0715ab5-0210-43d3-a395-69faed67430a tempest-VolumesAssistedSnapshotsTest-1812766378 tempest-VolumesAssistedSnapshotsTest-1812766378-project] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Traceback (most recent call last):
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4]     self._volume_snapshot_create(context, instance, guest,
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4]     rv = execute(f, *args, **kwargs)
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4]     six.reraise(c, e, tb)
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4]     raise value
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4]     rv = meth(*args, **kwargs)
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] 
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [None req-1f33ac93-24aa-411f-879a-50999fec03f0 tempest-VolumesAssistedSnapshotsTest-1812766378 tempest-VolumesAssistedSnapshotsTest-1812766378-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver 
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver 
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-f9ee1947-103a-430b-bd80-46c9d3c6701a)
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver 
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver 
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver 
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server [None req-1f33ac93-24aa-411f-879a-50999fec03f0 tempest-VolumesAssistedSnapshotsTest-1812766378 tempest-VolumesAssistedSnapshotsTest-1812766378-project] Exception during message handling: KeyError: 'type'
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server 
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver [None req-c0715ab5-0210-43d3-a395-69faed67430a tempest-VolumesAssistedSnapshotsTest-1812766378 tempest-VolumesAssistedSnapshotsTest-1812766378-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 98ccf335-3ded-473f-b339-d7c52637b3da could not be found.
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     raise value
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver 
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver 
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 98ccf335-3ded-473f-b339-d7c52637b3da could not be found. (HTTP 404) (Request-ID: req-bab6c2c1-3d03-4085-b3d2-083b55b20d5c)
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver 
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver 
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 98ccf335-3ded-473f-b339-d7c52637b3da could not be found.
Nov 14 00:47:23 user nova-compute[74850]: ERROR nova.virt.libvirt.driver 
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server [None req-c0715ab5-0210-43d3-a395-69faed67430a tempest-VolumesAssistedSnapshotsTest-1812766378 tempest-VolumesAssistedSnapshotsTest-1812766378-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server     raise value
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 00:47:23 user nova-compute[74850]: ERROR oslo_messaging.rpc.server 
Nov 14 00:47:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-864ddbd4-f526-40e3-97d9-cc13cc148563 tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Acquiring lock "faeb3377-d199-472b-9ee2-f504d5ac9ac4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-864ddbd4-f526-40e3-97d9-cc13cc148563 tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Lock "faeb3377-d199-472b-9ee2-f504d5ac9ac4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:24 user nova-compute[74850]: INFO nova.compute.manager [None req-864ddbd4-f526-40e3-97d9-cc13cc148563 tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Detaching volume 8b3c8867-75a4-4117-8b2f-9e9491d4bfa2
Nov 14 00:47:24 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] COPY block job progress, current cursor: 735051776 final cursor: 1073741824 {{(pid=74850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 00:47:24 user nova-compute[74850]: INFO nova.virt.block_device [None req-864ddbd4-f526-40e3-97d9-cc13cc148563 tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Attempting to driver detach volume 8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 from mountpoint /dev/vdb
Nov 14 00:47:24 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-864ddbd4-f526-40e3-97d9-cc13cc148563 tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Attempting to detach device vdb from instance faeb3377-d199-472b-9ee2-f504d5ac9ac4 from the persistent domain config. {{(pid=74850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 00:47:24 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-864ddbd4-f526-40e3-97d9-cc13cc148563 tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] detach device xml: <disk type="block" device="disk">
Nov 14 00:47:24 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:47:24 user nova-compute[74850]:   <source dev="/dev/sdm"/>
Nov 14 00:47:24 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:47:24 user nova-compute[74850]:   <serial>8b3c8867-75a4-4117-8b2f-9e9491d4bfa2</serial>
Nov 14 00:47:24 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 00:47:24 user nova-compute[74850]: </disk>
Nov 14 00:47:24 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 00:47:24 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-864ddbd4-f526-40e3-97d9-cc13cc148563 tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Successfully detached device vdb from instance faeb3377-d199-472b-9ee2-f504d5ac9ac4 from the persistent domain config.
Nov 14 00:47:24 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-864ddbd4-f526-40e3-97d9-cc13cc148563 tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance faeb3377-d199-472b-9ee2-f504d5ac9ac4 from the live domain config. {{(pid=74850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 00:47:24 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-864ddbd4-f526-40e3-97d9-cc13cc148563 tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] detach device xml: <disk type="block" device="disk">
Nov 14 00:47:24 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:47:24 user nova-compute[74850]:   <source dev="/dev/sdm"/>
Nov 14 00:47:24 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:47:24 user nova-compute[74850]:   <serial>8b3c8867-75a4-4117-8b2f-9e9491d4bfa2</serial>
Nov 14 00:47:24 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 00:47:24 user nova-compute[74850]: </disk>
Nov 14 00:47:24 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 00:47:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-16a9f3c7-8dcb-4305-9e69-63a862a40a72 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Acquiring lock "92c077bc-31f0-4794-b01e-08204e4301d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-16a9f3c7-8dcb-4305-9e69-63a862a40a72 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Lock "92c077bc-31f0-4794-b01e-08204e4301d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-16a9f3c7-8dcb-4305-9e69-63a862a40a72 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Acquiring lock "92c077bc-31f0-4794-b01e-08204e4301d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-16a9f3c7-8dcb-4305-9e69-63a862a40a72 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Lock "92c077bc-31f0-4794-b01e-08204e4301d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-16a9f3c7-8dcb-4305-9e69-63a862a40a72 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Lock "92c077bc-31f0-4794-b01e-08204e4301d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:24 user nova-compute[74850]: INFO nova.compute.manager [None req-16a9f3c7-8dcb-4305-9e69-63a862a40a72 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Terminating instance
Nov 14 00:47:24 user nova-compute[74850]: DEBUG nova.compute.manager [None req-16a9f3c7-8dcb-4305-9e69-63a862a40a72 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 00:47:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:24 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] COPY block job progress, current cursor: 842006528 final cursor: 1073741824 {{(pid=74850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 00:47:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:24 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-864ddbd4-f526-40e3-97d9-cc13cc148563 tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance faeb3377-d199-472b-9ee2-f504d5ac9ac4 {{(pid=74850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 00:47:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG nova.compute.manager [req-2405347b-6656-4216-8de3-086ac7fc6a5e req-c5eb632e-e9fc-4b74-8888-c194c1d8b76b service nova] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Received event network-vif-unplugged-56b44336-14e2-4a85-8169-2440ba5be7a3 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-2405347b-6656-4216-8de3-086ac7fc6a5e req-c5eb632e-e9fc-4b74-8888-c194c1d8b76b service nova] Acquiring lock "92c077bc-31f0-4794-b01e-08204e4301d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-2405347b-6656-4216-8de3-086ac7fc6a5e req-c5eb632e-e9fc-4b74-8888-c194c1d8b76b service nova] Lock "92c077bc-31f0-4794-b01e-08204e4301d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-2405347b-6656-4216-8de3-086ac7fc6a5e req-c5eb632e-e9fc-4b74-8888-c194c1d8b76b service nova] Lock "92c077bc-31f0-4794-b01e-08204e4301d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG nova.compute.manager [req-2405347b-6656-4216-8de3-086ac7fc6a5e req-c5eb632e-e9fc-4b74-8888-c194c1d8b76b service nova] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] No waiting events found dispatching network-vif-unplugged-56b44336-14e2-4a85-8169-2440ba5be7a3 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG nova.compute.manager [req-2405347b-6656-4216-8de3-086ac7fc6a5e req-c5eb632e-e9fc-4b74-8888-c194c1d8b76b service nova] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Received event network-vif-unplugged-56b44336-14e2-4a85-8169-2440ba5be7a3 for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] COPY block job progress, current cursor: 979369984 final cursor: 1073741824 {{(pid=74850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 00:47:25 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Instance destroyed successfully.
Nov 14 00:47:25 user nova-compute[74850]: DEBUG nova.objects.instance [None req-16a9f3c7-8dcb-4305-9e69-63a862a40a72 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Lazy-loading 'resources' on Instance uuid 92c077bc-31f0-4794-b01e-08204e4301d4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-16a9f3c7-8dcb-4305-9e69-63a862a40a72 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:45:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-797201859',display_name='tempest-VolumesActionsTest-instance-797201859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-797201859',id=10,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:45:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63909e1ffa674423bbe253437baf8a4d',ramdisk_id='',reservation_id='r-o5dcsyqq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-629891446',owner_user_name='tempest-VolumesActionsTest-629891446-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:45:39Z,user_data=None,user_id='59bff1f8623746b082df98f5558a39c4',uuid=92c077bc-31f0-4794-b01e-08204e4301d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56b44336-14e2-4a85-8169-2440ba5be7a3", "address": "fa:16:3e:8f:7d:4d", "network": {"id": "866703c2-2e61-4b23-8605-393efcefa615", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1265400193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63909e1ffa674423bbe253437baf8a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b44336-14", "ovs_interfaceid": "56b44336-14e2-4a85-8169-2440ba5be7a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-16a9f3c7-8dcb-4305-9e69-63a862a40a72 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Converting VIF {"id": "56b44336-14e2-4a85-8169-2440ba5be7a3", "address": "fa:16:3e:8f:7d:4d", "network": {"id": "866703c2-2e61-4b23-8605-393efcefa615", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1265400193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63909e1ffa674423bbe253437baf8a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b44336-14", "ovs_interfaceid": "56b44336-14e2-4a85-8169-2440ba5be7a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-16a9f3c7-8dcb-4305-9e69-63a862a40a72 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:7d:4d,bridge_name='br-int',has_traffic_filtering=True,id=56b44336-14e2-4a85-8169-2440ba5be7a3,network=Network(866703c2-2e61-4b23-8605-393efcefa615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56b44336-14') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG os_vif [None req-16a9f3c7-8dcb-4305-9e69-63a862a40a72 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:7d:4d,bridge_name='br-int',has_traffic_filtering=True,id=56b44336-14e2-4a85-8169-2440ba5be7a3,network=Network(866703c2-2e61-4b23-8605-393efcefa615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56b44336-14') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56b44336-14, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=85bdbeeb-ebb9-48c6-9d58-d49541fd63a2) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:25 user nova-compute[74850]: INFO os_vif [None req-16a9f3c7-8dcb-4305-9e69-63a862a40a72 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:7d:4d,bridge_name='br-int',has_traffic_filtering=True,id=56b44336-14e2-4a85-8169-2440ba5be7a3,network=Network(866703c2-2e61-4b23-8605-393efcefa615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56b44336-14')
Nov 14 00:47:25 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-16a9f3c7-8dcb-4305-9e69-63a862a40a72 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Deleting instance files /opt/stack/data/nova/instances/92c077bc-31f0-4794-b01e-08204e4301d4_del
Nov 14 00:47:25 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-16a9f3c7-8dcb-4305-9e69-63a862a40a72 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Deletion of /opt/stack/data/nova/instances/92c077bc-31f0-4794-b01e-08204e4301d4_del complete
Nov 14 00:47:25 user nova-compute[74850]: INFO nova.compute.manager [None req-16a9f3c7-8dcb-4305-9e69-63a862a40a72 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 14 00:47:25 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-16a9f3c7-8dcb-4305-9e69-63a862a40a72 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] [instance: 937d7470-ec86-4972-b975-257d626329dd] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EAeKbcZw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:47:25 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:47:25 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:47:25 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Took 0.44 seconds to deallocate network for instance.
Nov 14 00:47:25 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c918b40-b186-4678-a9ca-2a56cdd2b1e1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 00:47:25 user nova-compute[74850]: No targets found.
Nov 14 00:47:25 user nova-compute[74850]: iSNS:
Nov 14 00:47:25 user nova-compute[74850]: No targets found.
Nov 14 00:47:25 user nova-compute[74850]: STATIC:
Nov 14 00:47:25 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd
Nov 14 00:47:25 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:25 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:25 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606
Nov 14 00:47:25 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:25 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:25 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235
Nov 14 00:47:25 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:25 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:25 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83
Nov 14 00:47:25 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:25 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:25 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8
Nov 14 00:47:25 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:25 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:25 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706
Nov 14 00:47:25 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:25 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:25 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec
Nov 14 00:47:25 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:25 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:25 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab
Nov 14 00:47:25 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:25 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:25 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2
Nov 14 00:47:25 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:25 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:25 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c
Nov 14 00:47:25 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:25 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:25 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732
Nov 14 00:47:25 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:25 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:25 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a
Nov 14 00:47:25 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:25 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:25 user nova-compute[74850]: FIRMWARE:
Nov 14 00:47:25 user nova-compute[74850]: No targets found.
Nov 14 00:47:25 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 00:47:25 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 00:47:25 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1518a0-c69f-4c93-833c-fa00a592774d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-16a9f3c7-8dcb-4305-9e69-63a862a40a72 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-16a9f3c7-8dcb-4305-9e69-63a862a40a72 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cdff5e5-3a7e-4242-9937-ddd68d6d4dd3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 (non-flash)
Nov 14 00:47:25 user nova-compute[74850]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)
Nov 14 00:47:25 user nova-compute[74850]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)
Nov 14 00:47:25 user nova-compute[74850]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:25 user nova-compute[74850]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)
Nov 14 00:47:25 user nova-compute[74850]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)
Nov 14 00:47:25 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:25 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:47:25 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:25 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:25 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:25 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:25 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:25 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 (non-flash)
Nov 14 00:47:25 user nova-compute[74850]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)
Nov 14 00:47:25 user nova-compute[74850]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)
Nov 14 00:47:25 user nova-compute[74850]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:25 user nova-compute[74850]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)
Nov 14 00:47:25 user nova-compute[74850]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)
Nov 14 00:47:25 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:25 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:47:25 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:25 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:25 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:25 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:25 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:47:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a5c25e170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd'): ({'sdb'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 00:47:26 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Removing single pathed devices sdb {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 00:47:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:26 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a64f858-3fa5-458b-bddb-8b1f0431469a]: (4, ('path checker states:\nup                  12\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:26 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[651e490c-3adb-4549-92ec-93873bbd0a30]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:26 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Flushing IO for device /dev/sdb {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 00:47:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:26 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bfe670-dd23-44eb-9aa8-bf6e46948c4c]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:26 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 00:47:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:26 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1891796-88dd-4e86-b518-e63a0703b60f]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:26 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 00:47:26 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 00:47:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 00:47:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:26 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a364f8a-2fa5-4c14-92b8-e2a608e89f17]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:26 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-16a9f3c7-8dcb-4305-9e69-63a862a40a72 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:47:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:26 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11c939b-17c9-497e-be82-0ee36c5e95fe]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd, portal: 172.16.0.220,3260]
Nov 14 00:47:26 user nova-compute[74850]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd, portal: 172.16.0.220,3260] successful.
Nov 14 00:47:26 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:26 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-16a9f3c7-8dcb-4305-9e69-63a862a40a72 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:47:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:26 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bbba7d-f6c2-404a-a1ae-679468e3b9e7]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.422s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:47:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] <== disconnect_volume: return (423ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:47:26 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] [instance: 937d7470-ec86-4972-b975-257d626329dd] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 00:47:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-16a9f3c7-8dcb-4305-9e69-63a862a40a72 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:26 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-16a9f3c7-8dcb-4305-9e69-63a862a40a72 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Deleted allocations for instance 92c077bc-31f0-4794-b01e-08204e4301d4
Nov 14 00:47:26 user nova-compute[74850]: DEBUG nova.compute.manager [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UrfPgXNy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, 'status': 'reserved', 'instance': '937d7470-ec86-4972-b975-257d626329dd', 'attached_at': '', 'detached_at': '', 'volume_id': '2f63338a-4acf-4574-b01e-b1785897d706', 'serial'} {{(pid=74850) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 14 00:47:26 user nova-compute[74850]: DEBUG nova.compute.manager [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] [instance: 937d7470-ec86-4972-b975-257d626329dd] swap_volume: removing Cinder connection for volume 2daa0a31-2ec1-4ea6-81b7-4756aa1defdd {{(pid=74850) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 14 00:47:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-16a9f3c7-8dcb-4305-9e69-63a862a40a72 tempest-VolumesActionsTest-629891446 tempest-VolumesActionsTest-629891446-project-member] Lock "92c077bc-31f0-4794-b01e-08204e4301d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.855s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:27 user nova-compute[74850]: DEBUG nova.compute.manager [req-4ee6fafb-4084-48f5-8fdf-6927fd66710c req-d6adcb8e-1c8a-4ebe-8393-dddb4491b314 service nova] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Received event network-vif-plugged-56b44336-14e2-4a85-8169-2440ba5be7a3 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-4ee6fafb-4084-48f5-8fdf-6927fd66710c req-d6adcb8e-1c8a-4ebe-8393-dddb4491b314 service nova] Acquiring lock "92c077bc-31f0-4794-b01e-08204e4301d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-4ee6fafb-4084-48f5-8fdf-6927fd66710c req-d6adcb8e-1c8a-4ebe-8393-dddb4491b314 service nova] Lock "92c077bc-31f0-4794-b01e-08204e4301d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-4ee6fafb-4084-48f5-8fdf-6927fd66710c req-d6adcb8e-1c8a-4ebe-8393-dddb4491b314 service nova] Lock "92c077bc-31f0-4794-b01e-08204e4301d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:27 user nova-compute[74850]: DEBUG nova.compute.manager [req-4ee6fafb-4084-48f5-8fdf-6927fd66710c req-d6adcb8e-1c8a-4ebe-8393-dddb4491b314 service nova] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] No waiting events found dispatching network-vif-plugged-56b44336-14e2-4a85-8169-2440ba5be7a3 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:47:27 user nova-compute[74850]: WARNING nova.compute.manager [req-4ee6fafb-4084-48f5-8fdf-6927fd66710c req-d6adcb8e-1c8a-4ebe-8393-dddb4491b314 service nova] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Received unexpected event network-vif-plugged-56b44336-14e2-4a85-8169-2440ba5be7a3 for instance with vm_state deleted and task_state None.
Nov 14 00:47:27 user nova-compute[74850]: DEBUG nova.compute.manager [req-4ee6fafb-4084-48f5-8fdf-6927fd66710c req-d6adcb8e-1c8a-4ebe-8393-dddb4491b314 service nova] [instance: 92c077bc-31f0-4794-b01e-08204e4301d4] Received event network-vif-deleted-56b44336-14e2-4a85-8169-2440ba5be7a3 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:27 user nova-compute[74850]: DEBUG nova.compute.manager [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] [instance: 937d7470-ec86-4972-b975-257d626329dd] swap_volume: Updating volume 2daa0a31-2ec1-4ea6-81b7-4756aa1defdd BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "UrfPgXNy", "auth_password": "pqaT32Xjt4H8yw", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdl", "volume_id": "2f63338a-4acf-4574-b01e-b1785897d706"}, "status": "reserved", "instance": "937d7470-ec86-4972-b975-257d626329dd", "attached_at": "", "detached_at": "", "volume_id": "2f63338a-4acf-4574-b01e-b1785897d706", "serial": "2f63338a-4acf-4574-b01e-b1785897d706"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '2f63338a-4acf-4574-b01e-b1785897d706', 'no_device': None, 'attachment_id': '56ff9207-1c85-4cfa-a012-0b955b9773de'} {{(pid=74850) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 14 00:47:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-315aadf4-2813-4be5-9c22-f243bc0b0213 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Lock "937d7470-ec86-4972-b975-257d626329dd" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.980s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:27 user nova-compute[74850]: DEBUG nova.compute.manager [req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 req-8201aac6-73ae-428c-9fe9-bff331cc7be7 service nova] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Received event volume-reimaged-ef003978-0c16-4a36-b762-c86ac032e85a {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 req-8201aac6-73ae-428c-9fe9-bff331cc7be7 service nova] Acquiring lock "b54b37bc-8c90-4c48-a943-e489e830b93b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 req-8201aac6-73ae-428c-9fe9-bff331cc7be7 service nova] Lock "b54b37bc-8c90-4c48-a943-e489e830b93b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 req-8201aac6-73ae-428c-9fe9-bff331cc7be7 service nova] Lock "b54b37bc-8c90-4c48-a943-e489e830b93b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:27 user nova-compute[74850]: DEBUG nova.compute.manager [req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 req-8201aac6-73ae-428c-9fe9-bff331cc7be7 service nova] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Processing event volume-reimaged-ef003978-0c16-4a36-b762-c86ac032e85a {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 14 00:47:27 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Instance event wait completed in 14 seconds for volume-reimaged {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:47:27 user nova-compute[74850]: INFO nova.virt.block_device [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Booting with volume ef003978-0c16-4a36-b762-c86ac032e85a at /dev/vda
Nov 14 00:47:27 user nova-compute[74850]: DEBUG os_brick.utils [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:47:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:27 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[426f1cd2-55b7-4239-aeaf-7b1bb99690a3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:27 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e56178-6e08-45cd-8476-0d4e364b8ea1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:27 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7a1ccf-15d4-4275-8c94-35be09f1e65c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:27 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[639e385d-0d6d-469c-bdae-ef1bfd3c3765]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:47:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 00:47:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:47:27 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 00:47:27 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a9ea39-7c55-4090-9b68-9aa98f0f6d7e]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 00:47:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 00:47:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 00:47:27 user nova-compute[74850]: DEBUG os_brick.utils [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:47:27 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Updating existing volume attachment record: a22dc37b-12c7-4263-b095-f639cc511635 {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 00:47:28 user nova-compute[74850]: DEBUG nova.compute.manager [req-91e63f73-f95d-4958-b4d7-34f3dfe1105e req-c49b3b05-5c5a-472b-8cef-9ee77ce25d59 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-changed-04f4b3e3-634c-4285-b389-785cff1205ea {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:28 user nova-compute[74850]: DEBUG nova.compute.manager [req-91e63f73-f95d-4958-b4d7-34f3dfe1105e req-c49b3b05-5c5a-472b-8cef-9ee77ce25d59 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Refreshing instance network info cache due to event network-changed-04f4b3e3-634c-4285-b389-785cff1205ea. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:47:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-91e63f73-f95d-4958-b4d7-34f3dfe1105e req-c49b3b05-5c5a-472b-8cef-9ee77ce25d59 service nova] Acquiring lock "refresh_cache-7b1dc486-c6b5-4518-8da5-6042c97cbe55" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:47:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-91e63f73-f95d-4958-b4d7-34f3dfe1105e req-c49b3b05-5c5a-472b-8cef-9ee77ce25d59 service nova] Acquired lock "refresh_cache-7b1dc486-c6b5-4518-8da5-6042c97cbe55" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:47:28 user nova-compute[74850]: DEBUG nova.network.neutron [req-91e63f73-f95d-4958-b4d7-34f3dfe1105e req-c49b3b05-5c5a-472b-8cef-9ee77ce25d59 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Refreshing network info cache for port 04f4b3e3-634c-4285-b389-785cff1205ea {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:47:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Acquiring lock "937d7470-ec86-4972-b975-257d626329dd" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Lock "937d7470-ec86-4972-b975-257d626329dd" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:28 user nova-compute[74850]: DEBUG os_brick.utils [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:47:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:28 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[30636686-b467-4c53-b0e2-1529a2744831]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:28 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f223a97f-a52f-4ced-a495-4df96ad27917]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:28 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f40a1c-73d2-4ad7-a201-2d54c4205365]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:28 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ced390-ac41-4879-b782-74864d11a166]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:47:28 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 00:47:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:47:28 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 00:47:28 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[307e2ee5-cc09-47aa-9a13-5f76e34b6131]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:28 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 00:47:28 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 00:47:28 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 00:47:28 user nova-compute[74850]: DEBUG os_brick.utils [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:47:28 user nova-compute[74850]: INFO nova.compute.manager [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] [instance: 937d7470-ec86-4972-b975-257d626329dd] Swapping volume 2f63338a-4acf-4574-b01e-b1785897d706 for 2daa0a31-2ec1-4ea6-81b7-4756aa1defdd
Nov 14 00:47:29 user nova-compute[74850]: DEBUG nova.network.neutron [req-91e63f73-f95d-4958-b4d7-34f3dfe1105e req-c49b3b05-5c5a-472b-8cef-9ee77ce25d59 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Updated VIF entry in instance network info cache for port 04f4b3e3-634c-4285-b389-785cff1205ea. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:47:29 user nova-compute[74850]: DEBUG nova.network.neutron [req-91e63f73-f95d-4958-b4d7-34f3dfe1105e req-c49b3b05-5c5a-472b-8cef-9ee77ce25d59 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Updating instance_info_cache with network_info: [{"id": "04f4b3e3-634c-4285-b389-785cff1205ea", "address": "fa:16:3e:c0:42:3b", "network": {"id": "7b7555f1-01f5-4ec4-a537-8dba31d7bcc0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1180089476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f4b3e3-63", "ovs_interfaceid": "04f4b3e3-634c-4285-b389-785cff1205ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78e098ef-09f4-4007-9e14-ebff143a4ba1", "address": "fa:16:3e:92:05:67", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78e098ef-09", "ovs_interfaceid": "78e098ef-09f4-4007-9e14-ebff143a4ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0bbb73c1-6eda-416d-a9c8-6592c2abbea4", "address": "fa:16:3e:e8:f0:5f", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbb73c1-6e", "ovs_interfaceid": "0bbb73c1-6eda-416d-a9c8-6592c2abbea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ab41a728-624a-46a0-9fd6-0268c0b35f55", "address": "fa:16:3e:f1:76:22", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab41a728-62", "ovs_interfaceid": "ab41a728-624a-46a0-9fd6-0268c0b35f55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "091cb215-5fc9-4eb5-9aca-0751d5e41ea4", "address": "fa:16:3e:1f:ed:c6", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091cb215-5f", "ovs_interfaceid": "091cb215-5fc9-4eb5-9aca-0751d5e41ea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5fdd3936-9253-49a5-9f2d-6c2fdce456ea", "address": "fa:16:3e:e3:e9:a7", "network": {"id": "947450c5-5cd3-4c59-89ef-c5ac64194c29", "bridge": "br-int", "label": "tempest-device-tagging-net2-516735970", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdd3936-92", "ovs_interfaceid": "5fdd3936-9253-49a5-9f2d-6c2fdce456ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dff8eb7c-ea5d-459e-a836-440097829dfd", "address": "fa:16:3e:61:a0:19", "network": {"id": "947450c5-5cd3-4c59-89ef-c5ac64194c29", "bridge": "br-int", "label": "tempest-device-tagging-net2-516735970", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff8eb7c-ea", "ovs_interfaceid": "dff8eb7c-ea5d-459e-a836-440097829dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:47:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-91e63f73-f95d-4958-b4d7-34f3dfe1105e req-c49b3b05-5c5a-472b-8cef-9ee77ce25d59 service nova] Releasing lock "refresh_cache-7b1dc486-c6b5-4518-8da5-6042c97cbe55" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:47:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:30 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Acquiring lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Acquiring lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:31 user nova-compute[74850]: INFO nova.compute.manager [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Terminating instance
Nov 14 00:47:31 user nova-compute[74850]: DEBUG nova.compute.manager [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG nova.compute.manager [req-b856ca93-7838-4fd1-868f-e3eee2c7bbbd req-38ea2813-2a15-4290-be7b-7da9b0b8927f service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-unplugged-04f4b3e3-634c-4285-b389-785cff1205ea {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b856ca93-7838-4fd1-868f-e3eee2c7bbbd req-38ea2813-2a15-4290-be7b-7da9b0b8927f service nova] Acquiring lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b856ca93-7838-4fd1-868f-e3eee2c7bbbd req-38ea2813-2a15-4290-be7b-7da9b0b8927f service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b856ca93-7838-4fd1-868f-e3eee2c7bbbd req-38ea2813-2a15-4290-be7b-7da9b0b8927f service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG nova.compute.manager [req-b856ca93-7838-4fd1-868f-e3eee2c7bbbd req-38ea2813-2a15-4290-be7b-7da9b0b8927f service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] No waiting events found dispatching network-vif-unplugged-04f4b3e3-634c-4285-b389-785cff1205ea {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG nova.compute.manager [req-b856ca93-7838-4fd1-868f-e3eee2c7bbbd req-38ea2813-2a15-4290-be7b-7da9b0b8927f service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-unplugged-04f4b3e3-634c-4285-b389-785cff1205ea for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:31 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-f2fe50a5-d3c5-4278-9060-f98e04ce3681 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 4a2881e6-ee6e-4165-a6d9-35fda79c142d is timed out.
Nov 14 00:47:31 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-f2fe50a5-d3c5-4278-9060-f98e04ce3681 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Successfully detached device sdc from instance 4a2881e6-ee6e-4165-a6d9-35fda79c142d from the live domain config.
Nov 14 00:47:31 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2fe50a5-d3c5-4278-9060-f98e04ce3681 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fe50a5-d3c5-4278-9060-f98e04ce3681 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OEzFBlvx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:47:31 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-f2fe50a5-d3c5-4278-9060-f98e04ce3681 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:47:31 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-f2fe50a5-d3c5-4278-9060-f98e04ce3681 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-f2fe50a5-d3c5-4278-9060-f98e04ce3681 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.034s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[473fff42-2ce3-4190-9b31-5d756a15d9bc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fe50a5-d3c5-4278-9060-f98e04ce3681 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 00:47:31 user nova-compute[74850]: No targets found.
Nov 14 00:47:31 user nova-compute[74850]: iSNS:
Nov 14 00:47:31 user nova-compute[74850]: No targets found.
Nov 14 00:47:31 user nova-compute[74850]: STATIC:
Nov 14 00:47:31 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606
Nov 14 00:47:31 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:31 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:31 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235
Nov 14 00:47:31 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:31 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:31 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83
Nov 14 00:47:31 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:31 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:31 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8
Nov 14 00:47:31 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:31 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:31 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706
Nov 14 00:47:31 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:31 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:31 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec
Nov 14 00:47:31 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:31 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:31 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab
Nov 14 00:47:31 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:31 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:31 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2
Nov 14 00:47:31 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:31 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:31 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c
Nov 14 00:47:31 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:31 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:31 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732
Nov 14 00:47:31 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:31 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:31 user nova-compute[74850]: FIRMWARE:
Nov 14 00:47:31 user nova-compute[74850]: No targets found.
Nov 14 00:47:31 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fe50a5-d3c5-4278-9060-f98e04ce3681 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 00:47:31 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 00:47:31 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fe50a5-d3c5-4278-9060-f98e04ce3681 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG nova.compute.manager [req-cb2e4101-4b8f-476f-b1dd-ee9aad27317e req-35fae746-a852-445a-9622-be69a343fd1d service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-unplugged-78e098ef-09f4-4007-9e14-ebff143a4ba1 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-cb2e4101-4b8f-476f-b1dd-ee9aad27317e req-35fae746-a852-445a-9622-be69a343fd1d service nova] Acquiring lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-cb2e4101-4b8f-476f-b1dd-ee9aad27317e req-35fae746-a852-445a-9622-be69a343fd1d service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-cb2e4101-4b8f-476f-b1dd-ee9aad27317e req-35fae746-a852-445a-9622-be69a343fd1d service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG nova.compute.manager [req-cb2e4101-4b8f-476f-b1dd-ee9aad27317e req-35fae746-a852-445a-9622-be69a343fd1d service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] No waiting events found dispatching network-vif-unplugged-78e098ef-09f4-4007-9e14-ebff143a4ba1 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG nova.compute.manager [req-cb2e4101-4b8f-476f-b1dd-ee9aad27317e req-35fae746-a852-445a-9622-be69a343fd1d service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-unplugged-78e098ef-09f4-4007-9e14-ebff143a4ba1 for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.045s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3a0ea7-a651-4984-b8e5-cdbc2501d1b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24b663d-5d9c-4c70-8359-2408eb15ae5c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fe50a5-d3c5-4278-9060-f98e04ce3681 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 (non-flash)
Nov 14 00:47:31 user nova-compute[74850]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)
Nov 14 00:47:31 user nova-compute[74850]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)
Nov 14 00:47:31 user nova-compute[74850]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)
Nov 14 00:47:31 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:31 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:47:31 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:31 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:31 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:31 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:31 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fe50a5-d3c5-4278-9060-f98e04ce3681 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 (non-flash)
Nov 14 00:47:31 user nova-compute[74850]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)
Nov 14 00:47:31 user nova-compute[74850]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)
Nov 14 00:47:31 user nova-compute[74850]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)
Nov 14 00:47:31 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:31 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:47:31 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:31 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:31 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:31 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:31 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fe50a5-d3c5-4278-9060-f98e04ce3681 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a5c1b9240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235'): ({'sdi'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-f2fe50a5-d3c5-4278-9060-f98e04ce3681 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Removing single pathed devices sdi {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b405b3e4-de0c-4ff6-94ca-920734bedee0]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.035s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4b51c7-a299-4c42-968d-711cde1532de]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-f2fe50a5-d3c5-4278-9060-f98e04ce3681 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Flushing IO for device /dev/sdi {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG nova.compute.manager [req-b822eb9e-6eb5-4022-b6c5-d5e08c655e99 req-c0bdd90d-c324-4ae4-9c41-9bd088cb59f3 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-unplugged-0bbb73c1-6eda-416d-a9c8-6592c2abbea4 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b822eb9e-6eb5-4022-b6c5-d5e08c655e99 req-c0bdd90d-c324-4ae4-9c41-9bd088cb59f3 service nova] Acquiring lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b822eb9e-6eb5-4022-b6c5-d5e08c655e99 req-c0bdd90d-c324-4ae4-9c41-9bd088cb59f3 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b822eb9e-6eb5-4022-b6c5-d5e08c655e99 req-c0bdd90d-c324-4ae4-9c41-9bd088cb59f3 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG nova.compute.manager [req-b822eb9e-6eb5-4022-b6c5-d5e08c655e99 req-c0bdd90d-c324-4ae4-9c41-9bd088cb59f3 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] No waiting events found dispatching network-vif-unplugged-0bbb73c1-6eda-416d-a9c8-6592c2abbea4 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG nova.compute.manager [req-b822eb9e-6eb5-4022-b6c5-d5e08c655e99 req-c0bdd90d-c324-4ae4-9c41-9bd088cb59f3 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-unplugged-0bbb73c1-6eda-416d-a9c8-6592c2abbea4 for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41f8bd1-6a0f-42f8-8b07-eed11fa0d5bc]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-f2fe50a5-d3c5-4278-9060-f98e04ce3681 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.038s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4713a76-571b-4413-8d77-3797187baab4]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-f2fe50a5-d3c5-4278-9060-f98e04ce3681 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-f2fe50a5-d3c5-4278-9060-f98e04ce3681 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] SCSI volumes sdi have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fe50a5-d3c5-4278-9060-f98e04ce3681 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[50948a2b-741a-462f-8f02-3d24e153b4b2]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fe50a5-d3c5-4278-9060-f98e04ce3681 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 -p 172.16.0.220:3260 --logout" returned: 0 in 0.120s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d4ee27-e418-4673-b0e2-4834e601d58c]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fe50a5-d3c5-4278-9060-f98e04ce3681 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235, portal: 172.16.0.220,3260]
Nov 14 00:47:31 user nova-compute[74850]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235, portal: 172.16.0.220,3260] successful.
Nov 14 00:47:31 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37e90cf-dbe9-4eb1-b389-af542a80c235 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc81ea82-ae50-4908-b439-ebca5fb90e0a]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fe50a5-d3c5-4278-9060-f98e04ce3681 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-f2fe50a5-d3c5-4278-9060-f98e04ce3681 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.492s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fe50a5-d3c5-4278-9060-f98e04ce3681 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] <== disconnect_volume: return (495ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2fe50a5-d3c5-4278-9060-f98e04ce3681 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:32 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Instance destroyed successfully.
Nov 14 00:47:32 user nova-compute[74850]: DEBUG nova.objects.instance [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Lazy-loading 'resources' on Instance uuid 7b1dc486-c6b5-4518-8da5-6042c97cbe55 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780227733',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780227733',id=11,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF57Qp6LzTZet9KO3h8AMaiCGc7mfI+8CAEfeVIWHvfo6+I5KOzjDqG6/Zv0iKBqb9dwSRVKram/F70Gwho1DzWHcABMdG5wg6wHBH7XqUEw1cWGufHs21TbIjLtuj9MVQ==',key_name='tempest-keypair-1977090372',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:46:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f380efb37074b3399411fafb1deaa00',ramdisk_id='',reservation_id='r-x0omn3lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1105688157',owner_user_name='tempest-TaggedBootDevicesTest-1105688157-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:46:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb387c6b56014059a5ce18ffe642c3a0',uuid=7b1dc486-c6b5-4518-8da5-6042c97cbe55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04f4b3e3-634c-4285-b389-785cff1205ea", "address": "fa:16:3e:c0:42:3b", "network": {"id": "7b7555f1-01f5-4ec4-a537-8dba31d7bcc0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1180089476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f4b3e3-63", "ovs_interfaceid": "04f4b3e3-634c-4285-b389-785cff1205ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converting VIF {"id": "04f4b3e3-634c-4285-b389-785cff1205ea", "address": "fa:16:3e:c0:42:3b", "network": {"id": "7b7555f1-01f5-4ec4-a537-8dba31d7bcc0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1180089476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f4b3e3-63", "ovs_interfaceid": "04f4b3e3-634c-4285-b389-785cff1205ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:42:3b,bridge_name='br-int',has_traffic_filtering=True,id=04f4b3e3-634c-4285-b389-785cff1205ea,network=Network(7b7555f1-01f5-4ec4-a537-8dba31d7bcc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04f4b3e3-63') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG os_vif [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:42:3b,bridge_name='br-int',has_traffic_filtering=True,id=04f4b3e3-634c-4285-b389-785cff1205ea,network=Network(7b7555f1-01f5-4ec4-a537-8dba31d7bcc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04f4b3e3-63') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04f4b3e3-63, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 00:47:32 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Creating image(s)
Nov 14 00:47:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Did not create local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Ensure instance console log exists: /opt/stack/data/nova/instances/b54b37bc-8c90-4c48-a943-e489e830b93b/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Start _get_guest_xml network_info=[{"id": "5db497e0-e507-4a13-b0ff-fb4f7608f94d", "address": "fa:16:3e:75:22:ea", "network": {"id": "35cab925-9113-4bab-8203-a81035513ed6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036882895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c05ffa95fcf49d6a87d6dad2b3f0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db497e0-e5", "ovs_interfaceid": "5db497e0-e507-4a13-b0ff-fb4f7608f94d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a22dc37b-12c7-4263-b095-f639cc511635', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lwKDFPxQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b54b37bc-8c90-4c48-a943-e489e830b93b', 'attached_at': '', 'detached_at': '', 'volume_id': 'ef003978-0c16-4a36-b762-c86ac032e85a', 'serial': 'ef003978-0c16-4a36-b762-c86ac032e85a'}, 'volume_type': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:47:32 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 00:47:32 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 00:47:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG nova.objects.instance [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Lazy-loading 'vcpu_model' on Instance uuid b54b37bc-8c90-4c48-a943-e489e830b93b {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b4c071cf-6dcf-4d2d-b7ce-2d1596e65c61) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lwKDFPxQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:47:32 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 00:47:32 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:47:32 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 00:47:32 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:47:32 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 00:47:32 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[906e9ec1-c58c-45d7-832c-101ab982d308]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 00:47:32 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9aaaa7-3f1f-4198-98cc-cf3f4138ea7a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a] added
Nov 14 00:47:32 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:32 user nova-compute[74850]: INFO os_vif [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:42:3b,bridge_name='br-int',has_traffic_filtering=True,id=04f4b3e3-634c-4285-b389-785cff1205ea,network=Network(7b7555f1-01f5-4ec4-a537-8dba31d7bcc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04f4b3e3-63')
Nov 14 00:47:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780227733',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780227733',id=11,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF57Qp6LzTZet9KO3h8AMaiCGc7mfI+8CAEfeVIWHvfo6+I5KOzjDqG6/Zv0iKBqb9dwSRVKram/F70Gwho1DzWHcABMdG5wg6wHBH7XqUEw1cWGufHs21TbIjLtuj9MVQ==',key_name='tempest-keypair-1977090372',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:46:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f380efb37074b3399411fafb1deaa00',ramdisk_id='',reservation_id='r-x0omn3lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1105688157',owner_user_name='tempest-TaggedBootDevicesTest-1105688157-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:46:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb387c6b56014059a5ce18ffe642c3a0',uuid=7b1dc486-c6b5-4518-8da5-6042c97cbe55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78e098ef-09f4-4007-9e14-ebff143a4ba1", "address": "fa:16:3e:92:05:67", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78e098ef-09", "ovs_interfaceid": "78e098ef-09f4-4007-9e14-ebff143a4ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converting VIF {"id": "78e098ef-09f4-4007-9e14-ebff143a4ba1", "address": "fa:16:3e:92:05:67", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78e098ef-09", "ovs_interfaceid": "78e098ef-09f4-4007-9e14-ebff143a4ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:05:67,bridge_name='br-int',has_traffic_filtering=True,id=78e098ef-09f4-4007-9e14-ebff143a4ba1,network=Network(2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap78e098ef-09') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG os_vif [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:05:67,bridge_name='br-int',has_traffic_filtering=True,id=78e098ef-09f4-4007-9e14-ebff143a4ba1,network=Network(2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap78e098ef-09') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78e098ef-09, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cece0a8-1ebf-4ddf-899a-0fb066fb24c0]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:32 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1ba4d8-3ac1-4835-a53a-67d044ac6da1]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lwKDFPxQ {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9d3f289f-68e4-40af-9a1e-bcc21f943706) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lwKDFPxQ" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[65136497-cc12-4e2d-b9b7-534b594ecbb1]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lwKDFPxQ'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d32a4a-637b-47b3-a303-ab2febb899e1]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.objects.instance [None req-f2fe50a5-d3c5-4278-9060-f98e04ce3681 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Lazy-loading 'flavor' on Instance uuid 4a2881e6-ee6e-4165-a6d9-35fda79c142d {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:33 user nova-compute[74850]: INFO os_vif [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:05:67,bridge_name='br-int',has_traffic_filtering=True,id=78e098ef-09f4-4007-9e14-ebff143a4ba1,network=Network(2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap78e098ef-09')
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780227733',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780227733',id=11,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF57Qp6LzTZet9KO3h8AMaiCGc7mfI+8CAEfeVIWHvfo6+I5KOzjDqG6/Zv0iKBqb9dwSRVKram/F70Gwho1DzWHcABMdG5wg6wHBH7XqUEw1cWGufHs21TbIjLtuj9MVQ==',key_name='tempest-keypair-1977090372',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:46:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f380efb37074b3399411fafb1deaa00',ramdisk_id='',reservation_id='r-x0omn3lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1105688157',owner_user_name='tempest-TaggedBootDevicesTest-1105688157-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:46:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb387c6b56014059a5ce18ffe642c3a0',uuid=7b1dc486-c6b5-4518-8da5-6042c97cbe55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0bbb73c1-6eda-416d-a9c8-6592c2abbea4", "address": "fa:16:3e:e8:f0:5f", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbb73c1-6e", "ovs_interfaceid": "0bbb73c1-6eda-416d-a9c8-6592c2abbea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converting VIF {"id": "0bbb73c1-6eda-416d-a9c8-6592c2abbea4", "address": "fa:16:3e:e8:f0:5f", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbb73c1-6e", "ovs_interfaceid": "0bbb73c1-6eda-416d-a9c8-6592c2abbea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:f0:5f,bridge_name='br-int',has_traffic_filtering=True,id=0bbb73c1-6eda-416d-a9c8-6592c2abbea4,network=Network(2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0bbb73c1-6e') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG os_vif [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:f0:5f,bridge_name='br-int',has_traffic_filtering=True,id=0bbb73c1-6eda-416d-a9c8-6592c2abbea4,network=Network(2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0bbb73c1-6e') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0bbb73c1-6e, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d29378-ca70-41aa-ba9a-24a06067e375]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)
Nov 14 00:47:33 user nova-compute[74850]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)
Nov 14 00:47:33 user nova-compute[74850]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)
Nov 14 00:47:33 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:33 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:47:33 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:33 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:33 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:33 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:33 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)
Nov 14 00:47:33 user nova-compute[74850]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)
Nov 14 00:47:33 user nova-compute[74850]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)
Nov 14 00:47:33 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:33 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:47:33 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:33 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:33 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:33 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:33 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f2fe50a5-d3c5-4278-9060-f98e04ce3681 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Lock "4a2881e6-ee6e-4165-a6d9-35fda79c142d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.130s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cdef3a26-45de-4b5a-8e3a-774dfa851729) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:33 user nova-compute[74850]: INFO os_vif [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:f0:5f,bridge_name='br-int',has_traffic_filtering=True,id=0bbb73c1-6eda-416d-a9c8-6592c2abbea4,network=Network(2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0bbb73c1-6e')
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780227733',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780227733',id=11,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF57Qp6LzTZet9KO3h8AMaiCGc7mfI+8CAEfeVIWHvfo6+I5KOzjDqG6/Zv0iKBqb9dwSRVKram/F70Gwho1DzWHcABMdG5wg6wHBH7XqUEw1cWGufHs21TbIjLtuj9MVQ==',key_name='tempest-keypair-1977090372',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:46:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f380efb37074b3399411fafb1deaa00',ramdisk_id='',reservation_id='r-x0omn3lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1105688157',owner_user_name='tempest-TaggedBootDevicesTest-1105688157-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:46:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb387c6b56014059a5ce18ffe642c3a0',uuid=7b1dc486-c6b5-4518-8da5-6042c97cbe55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab41a728-624a-46a0-9fd6-0268c0b35f55", "address": "fa:16:3e:f1:76:22", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab41a728-62", "ovs_interfaceid": "ab41a728-624a-46a0-9fd6-0268c0b35f55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converting VIF {"id": "ab41a728-624a-46a0-9fd6-0268c0b35f55", "address": "fa:16:3e:f1:76:22", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab41a728-62", "ovs_interfaceid": "ab41a728-624a-46a0-9fd6-0268c0b35f55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:76:22,bridge_name='br-int',has_traffic_filtering=True,id=ab41a728-624a-46a0-9fd6-0268c0b35f55,network=Network(2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab41a728-62') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG os_vif [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:76:22,bridge_name='br-int',has_traffic_filtering=True,id=ab41a728-624a-46a0-9fd6-0268c0b35f55,network=Network(2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab41a728-62') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab41a728-62, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --login" returned: 0 in 0.103s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48e03a6-1851-4a06-b423-0b0a1b54946d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a, portal: 172.16.0.220,3260]
Nov 14 00:47:33 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a, portal: 172.16.0.220,3260] successful.
Nov 14 00:47:33 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=82323faa-aa28-4670-bef2-593fdc9b1f8f) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1780474c-3a73-409c-a36d-ce7ad0af9bd0]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:33 user nova-compute[74850]: INFO os_vif [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:76:22,bridge_name='br-int',has_traffic_filtering=True,id=ab41a728-624a-46a0-9fd6-0268c0b35f55,network=Network(2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab41a728-62')
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780227733',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780227733',id=11,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF57Qp6LzTZet9KO3h8AMaiCGc7mfI+8CAEfeVIWHvfo6+I5KOzjDqG6/Zv0iKBqb9dwSRVKram/F70Gwho1DzWHcABMdG5wg6wHBH7XqUEw1cWGufHs21TbIjLtuj9MVQ==',key_name='tempest-keypair-1977090372',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:46:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f380efb37074b3399411fafb1deaa00',ramdisk_id='',reservation_id='r-x0omn3lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1105688157',owner_user_name='tempest-TaggedBootDevicesTest-1105688157-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:46:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb387c6b56014059a5ce18ffe642c3a0',uuid=7b1dc486-c6b5-4518-8da5-6042c97cbe55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "091cb215-5fc9-4eb5-9aca-0751d5e41ea4", "address": "fa:16:3e:1f:ed:c6", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091cb215-5f", "ovs_interfaceid": "091cb215-5fc9-4eb5-9aca-0751d5e41ea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converting VIF {"id": "091cb215-5fc9-4eb5-9aca-0751d5e41ea4", "address": "fa:16:3e:1f:ed:c6", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091cb215-5f", "ovs_interfaceid": "091cb215-5fc9-4eb5-9aca-0751d5e41ea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:ed:c6,bridge_name='br-int',has_traffic_filtering=True,id=091cb215-5fc9-4eb5-9aca-0751d5e41ea4,network=Network(2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091cb215-5f') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG os_vif [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:ed:c6,bridge_name='br-int',has_traffic_filtering=True,id=091cb215-5fc9-4eb5-9aca-0751d5e41ea4,network=Network(2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091cb215-5f') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap091cb215-5f, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[24015c6d-0fd5-4f42-ad58-96fdb904eb4a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)
Nov 14 00:47:33 user nova-compute[74850]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)
Nov 14 00:47:33 user nova-compute[74850]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)
Nov 14 00:47:33 user nova-compute[74850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:33 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:33 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:47:33 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:33 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:33 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:33 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:33 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)
Nov 14 00:47:33 user nova-compute[74850]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)
Nov 14 00:47:33 user nova-compute[74850]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)
Nov 14 00:47:33 user nova-compute[74850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:33 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:33 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:47:33 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:33 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:33 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:33 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:33 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.380s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e8fa6c52-1abc-411a-8d62-c5d089c9d9df) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[28551ea5-cf34-4932-837d-fd2e7a813ef1]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lwKDFPxQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:33 user nova-compute[74850]: INFO os_vif [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:ed:c6,bridge_name='br-int',has_traffic_filtering=True,id=091cb215-5fc9-4eb5-9aca-0751d5e41ea4,network=Network(2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091cb215-5f')
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780227733',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780227733',id=11,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF57Qp6LzTZet9KO3h8AMaiCGc7mfI+8CAEfeVIWHvfo6+I5KOzjDqG6/Zv0iKBqb9dwSRVKram/F70Gwho1DzWHcABMdG5wg6wHBH7XqUEw1cWGufHs21TbIjLtuj9MVQ==',key_name='tempest-keypair-1977090372',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:46:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f380efb37074b3399411fafb1deaa00',ramdisk_id='',reservation_id='r-x0omn3lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1105688157',owner_user_name='tempest-TaggedBootDevicesTest-1105688157-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:46:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb387c6b56014059a5ce18ffe642c3a0',uuid=7b1dc486-c6b5-4518-8da5-6042c97cbe55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5fdd3936-9253-49a5-9f2d-6c2fdce456ea", "address": "fa:16:3e:e3:e9:a7", "network": {"id": "947450c5-5cd3-4c59-89ef-c5ac64194c29", "bridge": "br-int", "label": "tempest-device-tagging-net2-516735970", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdd3936-92", "ovs_interfaceid": "5fdd3936-9253-49a5-9f2d-6c2fdce456ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converting VIF {"id": "5fdd3936-9253-49a5-9f2d-6c2fdce456ea", "address": "fa:16:3e:e3:e9:a7", "network": {"id": "947450c5-5cd3-4c59-89ef-c5ac64194c29", "bridge": "br-int", "label": "tempest-device-tagging-net2-516735970", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdd3936-92", "ovs_interfaceid": "5fdd3936-9253-49a5-9f2d-6c2fdce456ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:e9:a7,bridge_name='br-int',has_traffic_filtering=True,id=5fdd3936-9253-49a5-9f2d-6c2fdce456ea,network=Network(947450c5-5cd3-4c59-89ef-c5ac64194c29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fdd3936-92') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG os_vif [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:e9:a7,bridge_name='br-int',has_traffic_filtering=True,id=5fdd3936-9253-49a5-9f2d-6c2fdce456ea,network=Network(947450c5-5cd3-4c59-89ef-c5ac64194c29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fdd3936-92') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5fdd3936-92, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4ed4768d-793e-4d7d-8582-d34db799eb0a) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:33 user nova-compute[74850]: INFO os_vif [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:e9:a7,bridge_name='br-int',has_traffic_filtering=True,id=5fdd3936-9253-49a5-9f2d-6c2fdce456ea,network=Network(947450c5-5cd3-4c59-89ef-c5ac64194c29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fdd3936-92')
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780227733',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780227733',id=11,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF57Qp6LzTZet9KO3h8AMaiCGc7mfI+8CAEfeVIWHvfo6+I5KOzjDqG6/Zv0iKBqb9dwSRVKram/F70Gwho1DzWHcABMdG5wg6wHBH7XqUEw1cWGufHs21TbIjLtuj9MVQ==',key_name='tempest-keypair-1977090372',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:46:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f380efb37074b3399411fafb1deaa00',ramdisk_id='',reservation_id='r-x0omn3lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1105688157',owner_user_name='tempest-TaggedBootDevicesTest-1105688157-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:46:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb387c6b56014059a5ce18ffe642c3a0',uuid=7b1dc486-c6b5-4518-8da5-6042c97cbe55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dff8eb7c-ea5d-459e-a836-440097829dfd", "address": "fa:16:3e:61:a0:19", "network": {"id": "947450c5-5cd3-4c59-89ef-c5ac64194c29", "bridge": "br-int", "label": "tempest-device-tagging-net2-516735970", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff8eb7c-ea", "ovs_interfaceid": "dff8eb7c-ea5d-459e-a836-440097829dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converting VIF {"id": "dff8eb7c-ea5d-459e-a836-440097829dfd", "address": "fa:16:3e:61:a0:19", "network": {"id": "947450c5-5cd3-4c59-89ef-c5ac64194c29", "bridge": "br-int", "label": "tempest-device-tagging-net2-516735970", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff8eb7c-ea", "ovs_interfaceid": "dff8eb7c-ea5d-459e-a836-440097829dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:a0:19,bridge_name='br-int',has_traffic_filtering=True,id=dff8eb7c-ea5d-459e-a836-440097829dfd,network=Network(947450c5-5cd3-4c59-89ef-c5ac64194c29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff8eb7c-ea') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG os_vif [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:a0:19,bridge_name='br-int',has_traffic_filtering=True,id=dff8eb7c-ea5d-459e-a836-440097829dfd,network=Network(947450c5-5cd3-4c59-89ef-c5ac64194c29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff8eb7c-ea') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdff8eb7c-ea, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9c6069c1-8081-433e-bbce-3f5ca52f5683) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:33 user nova-compute[74850]: INFO os_vif [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:a0:19,bridge_name='br-int',has_traffic_filtering=True,id=dff8eb7c-ea5d-459e-a836-440097829dfd,network=Network(947450c5-5cd3-4c59-89ef-c5ac64194c29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff8eb7c-ea')
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDxXVrwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:47:33 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:47:33 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.compute.manager [req-c0d27e5c-a315-48cc-a539-21a08b4398e5 req-7e5b98c6-1641-4eb7-9b03-21303ff35be1 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-plugged-04f4b3e3-634c-4285-b389-785cff1205ea {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c0d27e5c-a315-48cc-a539-21a08b4398e5 req-7e5b98c6-1641-4eb7-9b03-21303ff35be1 service nova] Acquiring lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c0d27e5c-a315-48cc-a539-21a08b4398e5 req-7e5b98c6-1641-4eb7-9b03-21303ff35be1 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c0d27e5c-a315-48cc-a539-21a08b4398e5 req-7e5b98c6-1641-4eb7-9b03-21303ff35be1 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.compute.manager [req-c0d27e5c-a315-48cc-a539-21a08b4398e5 req-7e5b98c6-1641-4eb7-9b03-21303ff35be1 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] No waiting events found dispatching network-vif-plugged-04f4b3e3-634c-4285-b389-785cff1205ea {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:47:33 user nova-compute[74850]: WARNING nova.compute.manager [req-c0d27e5c-a315-48cc-a539-21a08b4398e5 req-7e5b98c6-1641-4eb7-9b03-21303ff35be1 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received unexpected event network-vif-plugged-04f4b3e3-634c-4285-b389-785cff1205ea for instance with vm_state active and task_state deleting.
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.compute.manager [req-c0d27e5c-a315-48cc-a539-21a08b4398e5 req-7e5b98c6-1641-4eb7-9b03-21303ff35be1 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-unplugged-ab41a728-624a-46a0-9fd6-0268c0b35f55 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c0d27e5c-a315-48cc-a539-21a08b4398e5 req-7e5b98c6-1641-4eb7-9b03-21303ff35be1 service nova] Acquiring lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c0d27e5c-a315-48cc-a539-21a08b4398e5 req-7e5b98c6-1641-4eb7-9b03-21303ff35be1 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c0d27e5c-a315-48cc-a539-21a08b4398e5 req-7e5b98c6-1641-4eb7-9b03-21303ff35be1 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.compute.manager [req-c0d27e5c-a315-48cc-a539-21a08b4398e5 req-7e5b98c6-1641-4eb7-9b03-21303ff35be1 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] No waiting events found dispatching network-vif-unplugged-ab41a728-624a-46a0-9fd6-0268c0b35f55 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.compute.manager [req-c0d27e5c-a315-48cc-a539-21a08b4398e5 req-7e5b98c6-1641-4eb7-9b03-21303ff35be1 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-unplugged-ab41a728-624a-46a0-9fd6-0268c0b35f55 for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.compute.manager [req-c0d27e5c-a315-48cc-a539-21a08b4398e5 req-7e5b98c6-1641-4eb7-9b03-21303ff35be1 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-plugged-ab41a728-624a-46a0-9fd6-0268c0b35f55 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c0d27e5c-a315-48cc-a539-21a08b4398e5 req-7e5b98c6-1641-4eb7-9b03-21303ff35be1 service nova] Acquiring lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c0d27e5c-a315-48cc-a539-21a08b4398e5 req-7e5b98c6-1641-4eb7-9b03-21303ff35be1 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c0d27e5c-a315-48cc-a539-21a08b4398e5 req-7e5b98c6-1641-4eb7-9b03-21303ff35be1 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.compute.manager [req-c0d27e5c-a315-48cc-a539-21a08b4398e5 req-7e5b98c6-1641-4eb7-9b03-21303ff35be1 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] No waiting events found dispatching network-vif-plugged-ab41a728-624a-46a0-9fd6-0268c0b35f55 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:47:33 user nova-compute[74850]: WARNING nova.compute.manager [req-c0d27e5c-a315-48cc-a539-21a08b4398e5 req-7e5b98c6-1641-4eb7-9b03-21303ff35be1 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received unexpected event network-vif-plugged-ab41a728-624a-46a0-9fd6-0268c0b35f55 for instance with vm_state active and task_state deleting.
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.compute.manager [req-c0d27e5c-a315-48cc-a539-21a08b4398e5 req-7e5b98c6-1641-4eb7-9b03-21303ff35be1 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-unplugged-5fdd3936-9253-49a5-9f2d-6c2fdce456ea {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c0d27e5c-a315-48cc-a539-21a08b4398e5 req-7e5b98c6-1641-4eb7-9b03-21303ff35be1 service nova] Acquiring lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c0d27e5c-a315-48cc-a539-21a08b4398e5 req-7e5b98c6-1641-4eb7-9b03-21303ff35be1 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c0d27e5c-a315-48cc-a539-21a08b4398e5 req-7e5b98c6-1641-4eb7-9b03-21303ff35be1 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.compute.manager [req-c0d27e5c-a315-48cc-a539-21a08b4398e5 req-7e5b98c6-1641-4eb7-9b03-21303ff35be1 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] No waiting events found dispatching network-vif-unplugged-5fdd3936-9253-49a5-9f2d-6c2fdce456ea {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.compute.manager [req-c0d27e5c-a315-48cc-a539-21a08b4398e5 req-7e5b98c6-1641-4eb7-9b03-21303ff35be1 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-unplugged-5fdd3936-9253-49a5-9f2d-6c2fdce456ea for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.compute.manager [req-c0d27e5c-a315-48cc-a539-21a08b4398e5 req-7e5b98c6-1641-4eb7-9b03-21303ff35be1 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-plugged-5fdd3936-9253-49a5-9f2d-6c2fdce456ea {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c0d27e5c-a315-48cc-a539-21a08b4398e5 req-7e5b98c6-1641-4eb7-9b03-21303ff35be1 service nova] Acquiring lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c0d27e5c-a315-48cc-a539-21a08b4398e5 req-7e5b98c6-1641-4eb7-9b03-21303ff35be1 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c0d27e5c-a315-48cc-a539-21a08b4398e5 req-7e5b98c6-1641-4eb7-9b03-21303ff35be1 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.compute.manager [req-c0d27e5c-a315-48cc-a539-21a08b4398e5 req-7e5b98c6-1641-4eb7-9b03-21303ff35be1 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] No waiting events found dispatching network-vif-plugged-5fdd3936-9253-49a5-9f2d-6c2fdce456ea {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:47:33 user nova-compute[74850]: WARNING nova.compute.manager [req-c0d27e5c-a315-48cc-a539-21a08b4398e5 req-7e5b98c6-1641-4eb7-9b03-21303ff35be1 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received unexpected event network-vif-plugged-5fdd3936-9253-49a5-9f2d-6c2fdce456ea for instance with vm_state active and task_state deleting.
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.compute.manager [req-10776527-a44f-4e6c-9f2f-a832624a8de9 req-c9bc520c-aed9-4ae9-813e-945f1d451d20 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-plugged-78e098ef-09f4-4007-9e14-ebff143a4ba1 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-10776527-a44f-4e6c-9f2f-a832624a8de9 req-c9bc520c-aed9-4ae9-813e-945f1d451d20 service nova] Acquiring lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-10776527-a44f-4e6c-9f2f-a832624a8de9 req-c9bc520c-aed9-4ae9-813e-945f1d451d20 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-10776527-a44f-4e6c-9f2f-a832624a8de9 req-c9bc520c-aed9-4ae9-813e-945f1d451d20 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.compute.manager [req-10776527-a44f-4e6c-9f2f-a832624a8de9 req-c9bc520c-aed9-4ae9-813e-945f1d451d20 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] No waiting events found dispatching network-vif-plugged-78e098ef-09f4-4007-9e14-ebff143a4ba1 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:47:33 user nova-compute[74850]: WARNING nova.compute.manager [req-10776527-a44f-4e6c-9f2f-a832624a8de9 req-c9bc520c-aed9-4ae9-813e-945f1d451d20 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received unexpected event network-vif-plugged-78e098ef-09f4-4007-9e14-ebff143a4ba1 for instance with vm_state active and task_state deleting.
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.compute.manager [req-10776527-a44f-4e6c-9f2f-a832624a8de9 req-c9bc520c-aed9-4ae9-813e-945f1d451d20 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-unplugged-091cb215-5fc9-4eb5-9aca-0751d5e41ea4 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-10776527-a44f-4e6c-9f2f-a832624a8de9 req-c9bc520c-aed9-4ae9-813e-945f1d451d20 service nova] Acquiring lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-10776527-a44f-4e6c-9f2f-a832624a8de9 req-c9bc520c-aed9-4ae9-813e-945f1d451d20 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-10776527-a44f-4e6c-9f2f-a832624a8de9 req-c9bc520c-aed9-4ae9-813e-945f1d451d20 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.compute.manager [req-10776527-a44f-4e6c-9f2f-a832624a8de9 req-c9bc520c-aed9-4ae9-813e-945f1d451d20 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] No waiting events found dispatching network-vif-unplugged-091cb215-5fc9-4eb5-9aca-0751d5e41ea4 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.compute.manager [req-10776527-a44f-4e6c-9f2f-a832624a8de9 req-c9bc520c-aed9-4ae9-813e-945f1d451d20 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-unplugged-091cb215-5fc9-4eb5-9aca-0751d5e41ea4 for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.compute.manager [req-10776527-a44f-4e6c-9f2f-a832624a8de9 req-c9bc520c-aed9-4ae9-813e-945f1d451d20 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-plugged-091cb215-5fc9-4eb5-9aca-0751d5e41ea4 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-10776527-a44f-4e6c-9f2f-a832624a8de9 req-c9bc520c-aed9-4ae9-813e-945f1d451d20 service nova] Acquiring lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-10776527-a44f-4e6c-9f2f-a832624a8de9 req-c9bc520c-aed9-4ae9-813e-945f1d451d20 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-10776527-a44f-4e6c-9f2f-a832624a8de9 req-c9bc520c-aed9-4ae9-813e-945f1d451d20 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.compute.manager [req-10776527-a44f-4e6c-9f2f-a832624a8de9 req-c9bc520c-aed9-4ae9-813e-945f1d451d20 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] No waiting events found dispatching network-vif-plugged-091cb215-5fc9-4eb5-9aca-0751d5e41ea4 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:47:33 user nova-compute[74850]: WARNING nova.compute.manager [req-10776527-a44f-4e6c-9f2f-a832624a8de9 req-c9bc520c-aed9-4ae9-813e-945f1d451d20 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received unexpected event network-vif-plugged-091cb215-5fc9-4eb5-9aca-0751d5e41ea4 for instance with vm_state active and task_state deleting.
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.compute.manager [req-10776527-a44f-4e6c-9f2f-a832624a8de9 req-c9bc520c-aed9-4ae9-813e-945f1d451d20 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-unplugged-dff8eb7c-ea5d-459e-a836-440097829dfd {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-10776527-a44f-4e6c-9f2f-a832624a8de9 req-c9bc520c-aed9-4ae9-813e-945f1d451d20 service nova] Acquiring lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-10776527-a44f-4e6c-9f2f-a832624a8de9 req-c9bc520c-aed9-4ae9-813e-945f1d451d20 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-10776527-a44f-4e6c-9f2f-a832624a8de9 req-c9bc520c-aed9-4ae9-813e-945f1d451d20 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.compute.manager [req-10776527-a44f-4e6c-9f2f-a832624a8de9 req-c9bc520c-aed9-4ae9-813e-945f1d451d20 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] No waiting events found dispatching network-vif-unplugged-dff8eb7c-ea5d-459e-a836-440097829dfd {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.compute.manager [req-10776527-a44f-4e6c-9f2f-a832624a8de9 req-c9bc520c-aed9-4ae9-813e-945f1d451d20 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-unplugged-dff8eb7c-ea5d-459e-a836-440097829dfd for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.compute.manager [req-10776527-a44f-4e6c-9f2f-a832624a8de9 req-c9bc520c-aed9-4ae9-813e-945f1d451d20 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-changed-9a03ed99-51c7-49e9-abbb-dc338dd795ff {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.compute.manager [req-10776527-a44f-4e6c-9f2f-a832624a8de9 req-c9bc520c-aed9-4ae9-813e-945f1d451d20 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Refreshing instance network info cache due to event network-changed-9a03ed99-51c7-49e9-abbb-dc338dd795ff. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-10776527-a44f-4e6c-9f2f-a832624a8de9 req-c9bc520c-aed9-4ae9-813e-945f1d451d20 service nova] Acquiring lock "refresh_cache-cc072036-25dc-48a8-b430-5a2655fb473a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-10776527-a44f-4e6c-9f2f-a832624a8de9 req-c9bc520c-aed9-4ae9-813e-945f1d451d20 service nova] Acquired lock "refresh_cache-cc072036-25dc-48a8-b430-5a2655fb473a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.network.neutron [req-10776527-a44f-4e6c-9f2f-a832624a8de9 req-c9bc520c-aed9-4ae9-813e-945f1d451d20 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Refreshing network info cache for port 9a03ed99-51c7-49e9-abbb-dc338dd795ff {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.compute.manager [req-edc27fc4-5b67-4c79-8a8f-b1edca489a3d req-296a9f41-cd87-4855-b025-efc33f62f2da service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-plugged-0bbb73c1-6eda-416d-a9c8-6592c2abbea4 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-edc27fc4-5b67-4c79-8a8f-b1edca489a3d req-296a9f41-cd87-4855-b025-efc33f62f2da service nova] Acquiring lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-edc27fc4-5b67-4c79-8a8f-b1edca489a3d req-296a9f41-cd87-4855-b025-efc33f62f2da service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-edc27fc4-5b67-4c79-8a8f-b1edca489a3d req-296a9f41-cd87-4855-b025-efc33f62f2da service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.compute.manager [req-edc27fc4-5b67-4c79-8a8f-b1edca489a3d req-296a9f41-cd87-4855-b025-efc33f62f2da service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] No waiting events found dispatching network-vif-plugged-0bbb73c1-6eda-416d-a9c8-6592c2abbea4 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:47:33 user nova-compute[74850]: WARNING nova.compute.manager [req-edc27fc4-5b67-4c79-8a8f-b1edca489a3d req-296a9f41-cd87-4855-b025-efc33f62f2da service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received unexpected event network-vif-plugged-0bbb73c1-6eda-416d-a9c8-6592c2abbea4 for instance with vm_state active and task_state deleting.
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.compute.manager [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] [instance: 937d7470-ec86-4972-b975-257d626329dd] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EAeKbcZw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '937d7470-ec86-4972-b975-257d626329dd', 'attached_at': '', 'detached_at': '', 'volume_id': '2daa0a31-2ec1-4ea6-81b7-4756aa1defdd', 'serial': '2daa0a31-2ec1-4ea6-81b7-4756aa1defdd'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UrfPgXNy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl', 'volume_id': '2f63338a-4acf-4574-b01e-b1785897d706'}, 'status': 'reserved', 'instance': '937d7470-ec86-4972-b975-257d626329dd', 'attached_at': '', 'detached_at': '', 'volume_id': '2f63338a-4acf-4574-b01e-b1785897d706', 'serial'} {{(pid=74850) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] [instance: 937d7470-ec86-4972-b975-257d626329dd] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 00:47:33 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EAeKbcZw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:47:33 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:47:33 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e2b5ff22-ec54-4242-ab59-93cf2ff1ec01 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Acquiring lock "4a2881e6-ee6e-4165-a6d9-35fda79c142d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e2b5ff22-ec54-4242-ab59-93cf2ff1ec01 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Lock "4a2881e6-ee6e-4165-a6d9-35fda79c142d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e2b5ff22-ec54-4242-ab59-93cf2ff1ec01 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Acquiring lock "4a2881e6-ee6e-4165-a6d9-35fda79c142d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e2b5ff22-ec54-4242-ab59-93cf2ff1ec01 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Lock "4a2881e6-ee6e-4165-a6d9-35fda79c142d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e2b5ff22-ec54-4242-ab59-93cf2ff1ec01 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Lock "4a2881e6-ee6e-4165-a6d9-35fda79c142d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:34 user nova-compute[74850]: INFO nova.compute.manager [None req-e2b5ff22-ec54-4242-ab59-93cf2ff1ec01 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Terminating instance
Nov 14 00:47:34 user nova-compute[74850]: DEBUG nova.compute.manager [None req-e2b5ff22-ec54-4242-ab59-93cf2ff1ec01 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG nova.network.neutron [req-10776527-a44f-4e6c-9f2f-a832624a8de9 req-c9bc520c-aed9-4ae9-813e-945f1d451d20 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Updated VIF entry in instance network info cache for port 9a03ed99-51c7-49e9-abbb-dc338dd795ff. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG nova.network.neutron [req-10776527-a44f-4e6c-9f2f-a832624a8de9 req-c9bc520c-aed9-4ae9-813e-945f1d451d20 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Updating instance_info_cache with network_info: [{"id": "9a03ed99-51c7-49e9-abbb-dc338dd795ff", "address": "fa:16:3e:3b:53:d5", "network": {"id": "9ebba924-fce1-4de9-9859-4be03c6c5bd6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-873499233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a03ed99-51", "ovs_interfaceid": "9a03ed99-51c7-49e9-abbb-dc338dd795ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3b861886-0054-400a-b163-35945d498927", "address": "fa:16:3e:19:40:aa", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b861886-00", "ovs_interfaceid": "3b861886-0054-400a-b163-35945d498927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "381f68d0-96e0-404e-93e6-d166732e2df8", "address": "fa:16:3e:41:e5:08", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap381f68d0-96", "ovs_interfaceid": "381f68d0-96e0-404e-93e6-d166732e2df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "447494fb-fc40-41f9-94d9-d1c39434a22d", "address": "fa:16:3e:87:3d:45", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap447494fb-fc", "ovs_interfaceid": "447494fb-fc40-41f9-94d9-d1c39434a22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "70f458ad-d5db-47a5-9ab1-b776a8fdbb98", "address": "fa:16:3e:96:01:0a", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f458ad-d5", "ovs_interfaceid": "70f458ad-d5db-47a5-9ab1-b776a8fdbb98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "457e3066-b6bf-4d67-9c40-d1437ef901a3", "address": "fa:16:3e:dd:36:d4", "network": {"id": "b5892a30-40d5-4832-bb6b-b8a7f20106b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-725774050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457e3066-b6", "ovs_interfaceid": "457e3066-b6bf-4d67-9c40-d1437ef901a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14239fc2-af2c-4d50-9f58-9758fe0f1221", "address": "fa:16:3e:66:d7:47", "network": {"id": "b5892a30-40d5-4832-bb6b-b8a7f20106b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-725774050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14239fc2-af", "ovs_interfaceid": "14239fc2-af2c-4d50-9f58-9758fe0f1221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-10776527-a44f-4e6c-9f2f-a832624a8de9 req-c9bc520c-aed9-4ae9-813e-945f1d451d20 service nova] Releasing lock "refresh_cache-cc072036-25dc-48a8-b430-5a2655fb473a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG nova.compute.manager [req-10776527-a44f-4e6c-9f2f-a832624a8de9 req-c9bc520c-aed9-4ae9-813e-945f1d451d20 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-plugged-dff8eb7c-ea5d-459e-a836-440097829dfd {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-10776527-a44f-4e6c-9f2f-a832624a8de9 req-c9bc520c-aed9-4ae9-813e-945f1d451d20 service nova] Acquiring lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-10776527-a44f-4e6c-9f2f-a832624a8de9 req-c9bc520c-aed9-4ae9-813e-945f1d451d20 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-10776527-a44f-4e6c-9f2f-a832624a8de9 req-c9bc520c-aed9-4ae9-813e-945f1d451d20 service nova] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG nova.compute.manager [req-10776527-a44f-4e6c-9f2f-a832624a8de9 req-c9bc520c-aed9-4ae9-813e-945f1d451d20 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] No waiting events found dispatching network-vif-plugged-dff8eb7c-ea5d-459e-a836-440097829dfd {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:47:34 user nova-compute[74850]: WARNING nova.compute.manager [req-10776527-a44f-4e6c-9f2f-a832624a8de9 req-c9bc520c-aed9-4ae9-813e-945f1d451d20 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received unexpected event network-vif-plugged-dff8eb7c-ea5d-459e-a836-440097829dfd for instance with vm_state active and task_state deleting.
Nov 14 00:47:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] <== connect_volume: return (1422ms) {'type': 'block', 'scsi_wwn': '23835333832383165', 'path': '/dev/sdb'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835333832383165', 'path': '/dev/sdb'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.938s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b82868-1c16-4847-a9c0-94ce03589eb2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 00:47:34 user nova-compute[74850]: No targets found.
Nov 14 00:47:34 user nova-compute[74850]: iSNS:
Nov 14 00:47:34 user nova-compute[74850]: No targets found.
Nov 14 00:47:34 user nova-compute[74850]: STATIC:
Nov 14 00:47:34 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606
Nov 14 00:47:34 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:34 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:34 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83
Nov 14 00:47:34 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:34 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:34 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8
Nov 14 00:47:34 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:34 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:34 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706
Nov 14 00:47:34 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:34 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:34 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec
Nov 14 00:47:34 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:34 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:34 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab
Nov 14 00:47:34 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:34 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:34 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2
Nov 14 00:47:34 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:34 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:34 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c
Nov 14 00:47:34 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:34 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:34 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732
Nov 14 00:47:34 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:34 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:34 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a
Nov 14 00:47:34 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:34 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:34 user nova-compute[74850]: FIRMWARE:
Nov 14 00:47:34 user nova-compute[74850]: No targets found.
Nov 14 00:47:34 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 00:47:34 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 00:47:34 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T00:45:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1046338121',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1407646081',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6k6B6AwbocNisCO4Eq2JgavF/MwPMPgsSfJ4CZC+5MU8+G1Higk1jdnJvqwYlgQxsBYLb1AOlev2ixcNIA7eSaJMrT6i+cl48pJKEqDssTEhOLedhY/A00Q2wZRBoCKw==',key_name='tempest-keypair-1347631522',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:45:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9c05ffa95fcf49d6a87d6dad2b3f0983',ramdisk_id='',reservation_id='r-3ge02sav',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-676489401',owner_user_name='tempest-ServerActionsV293TestJSON-676489401-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:47:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a609a827db1a4e2ca232e7bc8880ed0b',uuid=b54b37bc-8c90-4c48-a943-e489e830b93b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5db497e0-e507-4a13-b0ff-fb4f7608f94d", "address": "fa:16:3e:75:22:ea", "network": {"id": "35cab925-9113-4bab-8203-a81035513ed6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036882895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c05ffa95fcf49d6a87d6dad2b3f0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db497e0-e5", "ovs_interfaceid": "5db497e0-e507-4a13-b0ff-fb4f7608f94d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Converting VIF {"id": "5db497e0-e507-4a13-b0ff-fb4f7608f94d", "address": "fa:16:3e:75:22:ea", "network": {"id": "35cab925-9113-4bab-8203-a81035513ed6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036882895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c05ffa95fcf49d6a87d6dad2b3f0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db497e0-e5", "ovs_interfaceid": "5db497e0-e507-4a13-b0ff-fb4f7608f94d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:22:ea,bridge_name='br-int',has_traffic_filtering=True,id=5db497e0-e507-4a13-b0ff-fb4f7608f94d,network=Network(35cab925-9113-4bab-8203-a81035513ed6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db497e0-e5') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:47:34 user nova-compute[74850]:   <uuid>b54b37bc-8c90-4c48-a943-e489e830b93b</uuid>
Nov 14 00:47:34 user nova-compute[74850]:   <name>instance-00000008</name>
Nov 14 00:47:34 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:47:34 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:47:34 user nova-compute[74850]:   <metadata>
Nov 14 00:47:34 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:47:34 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:47:34 user nova-compute[74850]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1046338121</nova:name>
Nov 14 00:47:34 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:47:32</nova:creationTime>
Nov 14 00:47:34 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:47:34 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:47:34 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:47:34 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:47:34 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:47:34 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:47:34 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:47:34 user nova-compute[74850]:       <nova:owner>
Nov 14 00:47:34 user nova-compute[74850]:         <nova:user uuid="a609a827db1a4e2ca232e7bc8880ed0b">tempest-ServerActionsV293TestJSON-676489401-project-member</nova:user>
Nov 14 00:47:34 user nova-compute[74850]:         <nova:project uuid="9c05ffa95fcf49d6a87d6dad2b3f0983">tempest-ServerActionsV293TestJSON-676489401</nova:project>
Nov 14 00:47:34 user nova-compute[74850]:       </nova:owner>
Nov 14 00:47:34 user nova-compute[74850]:       <nova:ports>
Nov 14 00:47:34 user nova-compute[74850]:         <nova:port uuid="5db497e0-e507-4a13-b0ff-fb4f7608f94d">
Nov 14 00:47:34 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 00:47:34 user nova-compute[74850]:         </nova:port>
Nov 14 00:47:34 user nova-compute[74850]:       </nova:ports>
Nov 14 00:47:34 user nova-compute[74850]:     </nova:instance>
Nov 14 00:47:34 user nova-compute[74850]:   </metadata>
Nov 14 00:47:34 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:47:34 user nova-compute[74850]:     <system>
Nov 14 00:47:34 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:47:34 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:47:34 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:47:34 user nova-compute[74850]:       <entry name="serial">b54b37bc-8c90-4c48-a943-e489e830b93b</entry>
Nov 14 00:47:34 user nova-compute[74850]:       <entry name="uuid">b54b37bc-8c90-4c48-a943-e489e830b93b</entry>
Nov 14 00:47:34 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:47:34 user nova-compute[74850]:     </system>
Nov 14 00:47:34 user nova-compute[74850]:   </sysinfo>
Nov 14 00:47:34 user nova-compute[74850]:   <os>
Nov 14 00:47:34 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:47:34 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 00:47:34 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:47:34 user nova-compute[74850]:   </os>
Nov 14 00:47:34 user nova-compute[74850]:   <features>
Nov 14 00:47:34 user nova-compute[74850]:     <acpi/>
Nov 14 00:47:34 user nova-compute[74850]:     <apic/>
Nov 14 00:47:34 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:47:34 user nova-compute[74850]:   </features>
Nov 14 00:47:34 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:47:34 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:47:34 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:47:34 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:47:34 user nova-compute[74850]:   </clock>
Nov 14 00:47:34 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:47:34 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:47:34 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:47:34 user nova-compute[74850]:   </cpu>
Nov 14 00:47:34 user nova-compute[74850]:   <devices>
Nov 14 00:47:34 user nova-compute[74850]:     <disk type="block" device="disk">
Nov 14 00:47:34 user nova-compute[74850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:47:34 user nova-compute[74850]:       <source dev="/dev/sdb"/>
Nov 14 00:47:34 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:47:34 user nova-compute[74850]:       <serial>ef003978-0c16-4a36-b762-c86ac032e85a</serial>
Nov 14 00:47:34 user nova-compute[74850]:     </disk>
Nov 14 00:47:34 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:47:34 user nova-compute[74850]:       <mac address="fa:16:3e:75:22:ea"/>
Nov 14 00:47:34 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:47:34 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:47:34 user nova-compute[74850]:       <target dev="tap5db497e0-e5"/>
Nov 14 00:47:34 user nova-compute[74850]:     </interface>
Nov 14 00:47:34 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:47:34 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/b54b37bc-8c90-4c48-a943-e489e830b93b/console.log" append="off"/>
Nov 14 00:47:34 user nova-compute[74850]:     </serial>
Nov 14 00:47:34 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:47:34 user nova-compute[74850]:     <video>
Nov 14 00:47:34 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:47:34 user nova-compute[74850]:     </video>
Nov 14 00:47:34 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:47:34 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:47:34 user nova-compute[74850]:     </rng>
Nov 14 00:47:34 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:47:34 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:47:34 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:47:34 user nova-compute[74850]:     </memballoon>
Nov 14 00:47:34 user nova-compute[74850]:   </devices>
Nov 14 00:47:34 user nova-compute[74850]: </domain>
Nov 14 00:47:34 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T00:45:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1046338121',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1407646081',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6k6B6AwbocNisCO4Eq2JgavF/MwPMPgsSfJ4CZC+5MU8+G1Higk1jdnJvqwYlgQxsBYLb1AOlev2ixcNIA7eSaJMrT6i+cl48pJKEqDssTEhOLedhY/A00Q2wZRBoCKw==',key_name='tempest-keypair-1347631522',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:45:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9c05ffa95fcf49d6a87d6dad2b3f0983',ramdisk_id='',reservation_id='r-3ge02sav',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-676489401',owner_user_name='tempest-ServerActionsV293TestJSON-676489401-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:47:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a609a827db1a4e2ca232e7bc8880ed0b',uuid=b54b37bc-8c90-4c48-a943-e489e830b93b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5db497e0-e507-4a13-b0ff-fb4f7608f94d", "address": "fa:16:3e:75:22:ea", "network": {"id": "35cab925-9113-4bab-8203-a81035513ed6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036882895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c05ffa95fcf49d6a87d6dad2b3f0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db497e0-e5", "ovs_interfaceid": "5db497e0-e507-4a13-b0ff-fb4f7608f94d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Converting VIF {"id": "5db497e0-e507-4a13-b0ff-fb4f7608f94d", "address": "fa:16:3e:75:22:ea", "network": {"id": "35cab925-9113-4bab-8203-a81035513ed6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036882895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c05ffa95fcf49d6a87d6dad2b3f0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db497e0-e5", "ovs_interfaceid": "5db497e0-e507-4a13-b0ff-fb4f7608f94d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:22:ea,bridge_name='br-int',has_traffic_filtering=True,id=5db497e0-e507-4a13-b0ff-fb4f7608f94d,network=Network(35cab925-9113-4bab-8203-a81035513ed6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db497e0-e5') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG os_vif [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:22:ea,bridge_name='br-int',has_traffic_filtering=True,id=5db497e0-e507-4a13-b0ff-fb4f7608f94d,network=Network(35cab925-9113-4bab-8203-a81035513ed6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db497e0-e5') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0a2bfc15-156d-5da6-b83a-c3ac64097f02', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88e9279-4808-4160-815c-8291c837da06]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5db497e0-e5, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5db497e0-e5, col_values=(('qos', UUID('c8daf114-16fc-4226-97bb-71bc59c750e7')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5db497e0-e5, col_values=(('external_ids', {'iface-id': '5db497e0-e507-4a13-b0ff-fb4f7608f94d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:22:ea', 'vm-uuid': 'b54b37bc-8c90-4c48-a943-e489e830b93b'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:34 user nova-compute[74850]: INFO os_vif [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:22:ea,bridge_name='br-int',has_traffic_filtering=True,id=5db497e0-e507-4a13-b0ff-fb4f7608f94d,network=Network(35cab925-9113-4bab-8203-a81035513ed6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db497e0-e5')
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c843473-20cb-49e2-b2c4-51af6184375a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)
Nov 14 00:47:34 user nova-compute[74850]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)
Nov 14 00:47:34 user nova-compute[74850]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)
Nov 14 00:47:34 user nova-compute[74850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:34 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:34 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:47:34 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:34 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:34 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:34 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:34 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)
Nov 14 00:47:34 user nova-compute[74850]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)
Nov 14 00:47:34 user nova-compute[74850]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)
Nov 14 00:47:34 user nova-compute[74850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:34 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:34 user nova-compute[74850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 (non-flash)
Nov 14 00:47:34 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:34 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:34 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:34 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:34 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a5c25dbd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606'): ({'sdd'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Removing single pathed devices sdd {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[431f76eb-8d47-4032-b595-c29a28ff5ff9]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] No VIF found with MAC fa:16:3e:75:22:ea, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[00bbc0ca-e73d-4c6a-83b3-79bb05f35511]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Flushing IO for device /dev/sdd {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf62043-c95f-4c85-834f-843fc0f0d764]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[88024071-2944-44e9-90e8-a6ae69092bbc]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] SCSI volumes sdd have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b39fa2-167c-41a9-9ec6-5f496a180a7a]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[354c9571-5dfb-47c9-8841-4c083daea1d4]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606, portal: 172.16.0.220,3260]
Nov 14 00:47:34 user nova-compute[74850]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606, portal: 172.16.0.220,3260] successful.
Nov 14 00:47:34 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:866aee5f-8ea9-4a58-a6ee-1a4aee92f606 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2dc614-60d1-4353-9fd7-89a063d17558]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] <== disconnect_volume: return (1320ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.787s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:47:34 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:47:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:47:34 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yFQngRwq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:47:34 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:47:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f121a6-008b-4629-9e42-f933537be1ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 00:47:34 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0378e3-04fc-4759-9239-7c16a3501f82]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd] added
Nov 14 00:47:34 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[158b3a67-16fd-4363-8b49-b184c26aab4c]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f8176a-db5c-42c9-bdf1-6d0cbf2e72eb]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EAeKbcZw {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EAeKbcZw" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4b37a6-4891-47aa-97ca-be297785c805]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EAeKbcZw'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6615a78-45e8-4f39-9e71-4a7f973e7bc7]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[88cfe5d0-2e41-42ae-bf90-bb335e33eb29]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)
Nov 14 00:47:34 user nova-compute[74850]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)
Nov 14 00:47:34 user nova-compute[74850]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)
Nov 14 00:47:34 user nova-compute[74850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:34 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:34 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:34 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:34 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:34 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:34 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)
Nov 14 00:47:34 user nova-compute[74850]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)
Nov 14 00:47:34 user nova-compute[74850]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)
Nov 14 00:47:34 user nova-compute[74850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:34 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:34 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:34 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:34 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:34 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:34 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d6025e-2f64-49b3-8720-b97af7b1f592]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd, portal: 172.16.0.220,3260]
Nov 14 00:47:34 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd, portal: 172.16.0.220,3260] successful.
Nov 14 00:47:34 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[258630bc-36bc-4f3e-955d-aa581c5b9b6a]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[088babba-74d7-44cc-882d-dcbd391e17d9]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)
Nov 14 00:47:35 user nova-compute[74850]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)
Nov 14 00:47:35 user nova-compute[74850]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)
Nov 14 00:47:35 user nova-compute[74850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:35 user nova-compute[74850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)
Nov 14 00:47:35 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:35 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:35 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:35 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:35 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:35 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)
Nov 14 00:47:35 user nova-compute[74850]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)
Nov 14 00:47:35 user nova-compute[74850]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)
Nov 14 00:47:35 user nova-compute[74850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:35 user nova-compute[74850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)
Nov 14 00:47:35 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:35 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:35 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:35 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:35 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:35 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4856a5b-784b-4a97-8642-6ccecfb58e6b]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: None {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:47:35 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Instance destroyed successfully.
Nov 14 00:47:35 user nova-compute[74850]: DEBUG nova.objects.instance [None req-e2b5ff22-ec54-4242-ab59-93cf2ff1ec01 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Lazy-loading 'resources' on Instance uuid 4a2881e6-ee6e-4165-a6d9-35fda79c142d {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-e2b5ff22-ec54-4242-ab59-93cf2ff1ec01 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1167620568',display_name='tempest-AttachSCSIVolumeTestJSON-server-1167620568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1167620568',id=5,image_ref='ed4d3d48-93f7-4f21-b25a-975b83645c87',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJpJE//2+b9Lwr20uwQ6rghkZwQW/qTLXJVAtl2f1x2vw82BauGLHnV3rYuZw6wqfvi6QHg6rZLvZHGkGbWHtekLKHLMnT/xSi54YLZMks8pJJrQFj0fAMduEVPanSf5YA==',key_name='tempest-keypair-1892965077',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:45:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0dd0e10c315346cabe45d8cb1596b3dd',ramdisk_id='',reservation_id='r-5vved0vh',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ed4d3d48-93f7-4f21-b25a-975b83645c87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1513679227',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1513679227-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:45:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8611932bd704d8ea467ee48ba50ce8b',uuid=4a2881e6-ee6e-4165-a6d9-35fda79c142d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8d36bc2-b85b-4eaf-8c22-e58c9dae360d", "address": "fa:16:3e:65:0b:b4", "network": {"id": "db670808-a8f8-441f-aa30-b55187e39c46", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-972081880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dd0e10c315346cabe45d8cb1596b3dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d36bc2-b8", "ovs_interfaceid": "f8d36bc2-b85b-4eaf-8c22-e58c9dae360d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-e2b5ff22-ec54-4242-ab59-93cf2ff1ec01 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Converting VIF {"id": "f8d36bc2-b85b-4eaf-8c22-e58c9dae360d", "address": "fa:16:3e:65:0b:b4", "network": {"id": "db670808-a8f8-441f-aa30-b55187e39c46", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-972081880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dd0e10c315346cabe45d8cb1596b3dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d36bc2-b8", "ovs_interfaceid": "f8d36bc2-b85b-4eaf-8c22-e58c9dae360d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-e2b5ff22-ec54-4242-ab59-93cf2ff1ec01 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:0b:b4,bridge_name='br-int',has_traffic_filtering=True,id=f8d36bc2-b85b-4eaf-8c22-e58c9dae360d,network=Network(db670808-a8f8-441f-aa30-b55187e39c46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8d36bc2-b8') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG os_vif [None req-e2b5ff22-ec54-4242-ab59-93cf2ff1ec01 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:0b:b4,bridge_name='br-int',has_traffic_filtering=True,id=f8d36bc2-b85b-4eaf-8c22-e58c9dae360d,network=Network(db670808-a8f8-441f-aa30-b55187e39c46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8d36bc2-b8') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8d36bc2-b8, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f0b9ff75-ede3-4085-8e04-d5120d543820) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:35 user nova-compute[74850]: INFO os_vif [None req-e2b5ff22-ec54-4242-ab59-93cf2ff1ec01 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:0b:b4,bridge_name='br-int',has_traffic_filtering=True,id=f8d36bc2-b85b-4eaf-8c22-e58c9dae360d,network=Network(db670808-a8f8-441f-aa30-b55187e39c46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8d36bc2-b8')
Nov 14 00:47:35 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-e2b5ff22-ec54-4242-ab59-93cf2ff1ec01 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Deleting instance files /opt/stack/data/nova/instances/4a2881e6-ee6e-4165-a6d9-35fda79c142d_del
Nov 14 00:47:35 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-e2b5ff22-ec54-4242-ab59-93cf2ff1ec01 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Deletion of /opt/stack/data/nova/instances/4a2881e6-ee6e-4165-a6d9-35fda79c142d_del complete
Nov 14 00:47:35 user nova-compute[74850]: INFO nova.compute.manager [None req-e2b5ff22-ec54-4242-ab59-93cf2ff1ec01 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Took 1.44 seconds to destroy the instance on the hypervisor.
Nov 14 00:47:35 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-e2b5ff22-ec54-4242-ab59-93cf2ff1ec01 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Acquiring lock "cc072036-25dc-48a8-b430-5a2655fb473a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Lock "cc072036-25dc-48a8-b430-5a2655fb473a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Acquiring lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:35 user nova-compute[74850]: INFO nova.compute.manager [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Terminating instance
Nov 14 00:47:35 user nova-compute[74850]: DEBUG nova.compute.manager [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG nova.compute.manager [req-f368cd21-fb8e-45a3-abaf-ee50e777df43 req-9ceeb039-df1b-4815-a74e-00ecd7630263 service nova] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Received event network-vif-unplugged-f8d36bc2-b85b-4eaf-8c22-e58c9dae360d {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f368cd21-fb8e-45a3-abaf-ee50e777df43 req-9ceeb039-df1b-4815-a74e-00ecd7630263 service nova] Acquiring lock "4a2881e6-ee6e-4165-a6d9-35fda79c142d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f368cd21-fb8e-45a3-abaf-ee50e777df43 req-9ceeb039-df1b-4815-a74e-00ecd7630263 service nova] Lock "4a2881e6-ee6e-4165-a6d9-35fda79c142d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f368cd21-fb8e-45a3-abaf-ee50e777df43 req-9ceeb039-df1b-4815-a74e-00ecd7630263 service nova] Lock "4a2881e6-ee6e-4165-a6d9-35fda79c142d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG nova.compute.manager [req-f368cd21-fb8e-45a3-abaf-ee50e777df43 req-9ceeb039-df1b-4815-a74e-00ecd7630263 service nova] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] No waiting events found dispatching network-vif-unplugged-f8d36bc2-b85b-4eaf-8c22-e58c9dae360d {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG nova.compute.manager [req-f368cd21-fb8e-45a3-abaf-ee50e777df43 req-9ceeb039-df1b-4815-a74e-00ecd7630263 service nova] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Received event network-vif-unplugged-f8d36bc2-b85b-4eaf-8c22-e58c9dae360d for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG nova.compute.manager [req-f368cd21-fb8e-45a3-abaf-ee50e777df43 req-9ceeb039-df1b-4815-a74e-00ecd7630263 service nova] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Received event network-vif-plugged-f8d36bc2-b85b-4eaf-8c22-e58c9dae360d {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f368cd21-fb8e-45a3-abaf-ee50e777df43 req-9ceeb039-df1b-4815-a74e-00ecd7630263 service nova] Acquiring lock "4a2881e6-ee6e-4165-a6d9-35fda79c142d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f368cd21-fb8e-45a3-abaf-ee50e777df43 req-9ceeb039-df1b-4815-a74e-00ecd7630263 service nova] Lock "4a2881e6-ee6e-4165-a6d9-35fda79c142d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f368cd21-fb8e-45a3-abaf-ee50e777df43 req-9ceeb039-df1b-4815-a74e-00ecd7630263 service nova] Lock "4a2881e6-ee6e-4165-a6d9-35fda79c142d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG nova.compute.manager [req-f368cd21-fb8e-45a3-abaf-ee50e777df43 req-9ceeb039-df1b-4815-a74e-00ecd7630263 service nova] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] No waiting events found dispatching network-vif-plugged-f8d36bc2-b85b-4eaf-8c22-e58c9dae360d {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:47:35 user nova-compute[74850]: WARNING nova.compute.manager [req-f368cd21-fb8e-45a3-abaf-ee50e777df43 req-9ceeb039-df1b-4815-a74e-00ecd7630263 service nova] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Received unexpected event network-vif-plugged-f8d36bc2-b85b-4eaf-8c22-e58c9dae360d for instance with vm_state active and task_state deleting.
Nov 14 00:47:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:36 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-2eae3eca-fa1a-4e97-bf69-88102980a8bc tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 28212eec-99be-4171-97ed-7748bbb75c88 is timed out.
Nov 14 00:47:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:36 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-2eae3eca-fa1a-4e97-bf69-88102980a8bc tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Successfully detached device vdb from instance 28212eec-99be-4171-97ed-7748bbb75c88 from the live domain config.
Nov 14 00:47:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2eae3eca-fa1a-4e97-bf69-88102980a8bc tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eae3eca-fa1a-4e97-bf69-88102980a8bc tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aElnmDud', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:47:36 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-2eae3eca-fa1a-4e97-bf69-88102980a8bc tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:47:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-2eae3eca-fa1a-4e97-bf69-88102980a8bc tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EAeKbcZw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] <== connect_volume: return (2165ms) {'type': 'block', 'scsi_wwn': '23161643134626363', 'path': '/dev/sdd'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] [instance: 937d7470-ec86-4972-b975-257d626329dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161643134626363', 'path': '/dev/sdd'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.373s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG nova.objects.instance [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Lazy-loading 'flavor' on Instance uuid 937d7470-ec86-4972-b975-257d626329dd {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd697855-aa4c-4aef-a83d-8e9ebc1b3453]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 00:47:36 user nova-compute[74850]: No targets found.
Nov 14 00:47:36 user nova-compute[74850]: iSNS:
Nov 14 00:47:36 user nova-compute[74850]: No targets found.
Nov 14 00:47:36 user nova-compute[74850]: STATIC:
Nov 14 00:47:36 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd
Nov 14 00:47:36 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:36 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:36 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83
Nov 14 00:47:36 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:36 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:36 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8
Nov 14 00:47:36 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:36 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:36 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706
Nov 14 00:47:36 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:36 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:36 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec
Nov 14 00:47:36 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:36 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:36 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab
Nov 14 00:47:36 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:36 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:36 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2
Nov 14 00:47:36 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:36 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:36 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c
Nov 14 00:47:36 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:36 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:36 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732
Nov 14 00:47:36 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:36 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:36 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a
Nov 14 00:47:36 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:36 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:36 user nova-compute[74850]: FIRMWARE:
Nov 14 00:47:36 user nova-compute[74850]: No targets found.
Nov 14 00:47:36 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 00:47:36 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 00:47:36 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cad2037-2696-4f33-8c7b-944170f142ec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[788c2453-85ad-4feb-a893-dc9d4f0001a1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)
Nov 14 00:47:36 user nova-compute[74850]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)
Nov 14 00:47:36 user nova-compute[74850]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)
Nov 14 00:47:36 user nova-compute[74850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:36 user nova-compute[74850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)
Nov 14 00:47:36 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:36 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:36 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:36 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:36 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:36 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)
Nov 14 00:47:36 user nova-compute[74850]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)
Nov 14 00:47:36 user nova-compute[74850]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)
Nov 14 00:47:36 user nova-compute[74850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:36 user nova-compute[74850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)
Nov 14 00:47:36 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:36 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:36 user nova-compute[74850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec (non-flash)
Nov 14 00:47:36 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:36 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:36 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a3c381240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec'): ({'sdf'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Removing single pathed devices sdf {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[718932dc-b752-438b-a70a-0b33539a4a02]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[558bff3a-bd68-48d8-b9fc-081f8350ee6e]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Flushing IO for device /dev/sdf {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[83df749f-ed63-479e-b0be-aa7066329508]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG nova.compute.manager [req-6d874f0c-4fb4-4672-9c13-dc9244be08e1 req-268f0f53-1df2-4e2d-bede-18a81d63122c service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-unplugged-3b861886-0054-400a-b163-35945d498927 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6d874f0c-4fb4-4672-9c13-dc9244be08e1 req-268f0f53-1df2-4e2d-bede-18a81d63122c service nova] Acquiring lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6d874f0c-4fb4-4672-9c13-dc9244be08e1 req-268f0f53-1df2-4e2d-bede-18a81d63122c service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6d874f0c-4fb4-4672-9c13-dc9244be08e1 req-268f0f53-1df2-4e2d-bede-18a81d63122c service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG nova.compute.manager [req-6d874f0c-4fb4-4672-9c13-dc9244be08e1 req-268f0f53-1df2-4e2d-bede-18a81d63122c service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] No waiting events found dispatching network-vif-unplugged-3b861886-0054-400a-b163-35945d498927 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG nova.compute.manager [req-6d874f0c-4fb4-4672-9c13-dc9244be08e1 req-268f0f53-1df2-4e2d-bede-18a81d63122c service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-unplugged-3b861886-0054-400a-b163-35945d498927 for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e522e6af-a40f-4f8b-beae-2c049b19b188]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] SCSI volumes sdf have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4218599d-39e7-474c-8d0e-c3b6395f5967]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec -p 172.16.0.220:3260 --logout" returned: 0 in 0.111s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[48612d6b-0bfd-4cd1-8001-ff1d1fda42f5]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec, portal: 172.16.0.220,3260]
Nov 14 00:47:36 user nova-compute[74850]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec, portal: 172.16.0.220,3260] successful.
Nov 14 00:47:36 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9283b1c4-11f9-41e1-986e-7141d0774fec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.055s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f90c55d-78c7-4323-91b1-7e5a9c517977]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.459s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] <== disconnect_volume: return (1831ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-2eae3eca-fa1a-4e97-bf69-88102980a8bc tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.479s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GHgSFWfn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:47:36 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:47:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25d2643-ddd9-4d0a-b8c6-43c62e0c3cc1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eae3eca-fa1a-4e97-bf69-88102980a8bc tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 00:47:36 user nova-compute[74850]: No targets found.
Nov 14 00:47:36 user nova-compute[74850]: iSNS:
Nov 14 00:47:36 user nova-compute[74850]: No targets found.
Nov 14 00:47:36 user nova-compute[74850]: STATIC:
Nov 14 00:47:36 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd
Nov 14 00:47:36 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:36 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:36 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83
Nov 14 00:47:36 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:36 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:36 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8
Nov 14 00:47:36 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:36 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:36 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706
Nov 14 00:47:36 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:36 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:36 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab
Nov 14 00:47:36 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:36 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:36 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2
Nov 14 00:47:36 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:36 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:36 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c
Nov 14 00:47:36 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:36 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:36 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732
Nov 14 00:47:36 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:36 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:36 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a
Nov 14 00:47:36 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:36 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:36 user nova-compute[74850]: FIRMWARE:
Nov 14 00:47:36 user nova-compute[74850]: No targets found.
Nov 14 00:47:36 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eae3eca-fa1a-4e97-bf69-88102980a8bc tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 00:47:36 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 00:47:36 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eae3eca-fa1a-4e97-bf69-88102980a8bc tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 00:47:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0a191c-dbeb-4c7d-981c-7d626d378c48]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fe95a4-df13-47f7-9c8f-3f4630ae287a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eae3eca-fa1a-4e97-bf69-88102980a8bc tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)
Nov 14 00:47:37 user nova-compute[74850]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)
Nov 14 00:47:37 user nova-compute[74850]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)
Nov 14 00:47:37 user nova-compute[74850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:37 user nova-compute[74850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)
Nov 14 00:47:37 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:37 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:37 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:37 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:37 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eae3eca-fa1a-4e97-bf69-88102980a8bc tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab (non-flash)
Nov 14 00:47:37 user nova-compute[74850]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)
Nov 14 00:47:37 user nova-compute[74850]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)
Nov 14 00:47:37 user nova-compute[74850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:37 user nova-compute[74850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)
Nov 14 00:47:37 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:37 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:37 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:37 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:37 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eae3eca-fa1a-4e97-bf69-88102980a8bc tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a3c337c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab'): ({'sdj'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-2eae3eca-fa1a-4e97-bf69-88102980a8bc tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Removing single pathed devices sdj {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b45e31-310b-4296-b42a-fecf6f7f5245]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d958cdd-c949-40c8-925c-98d3e64787ad]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-2eae3eca-fa1a-4e97-bf69-88102980a8bc tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Flushing IO for device /dev/sdj {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.012s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5f0644-30ce-4c01-9c91-6cda9fc25f2f]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-2eae3eca-fa1a-4e97-bf69-88102980a8bc tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.341s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0686a3d-5c7d-420d-8529-3997faf888b5]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-2eae3eca-fa1a-4e97-bf69-88102980a8bc tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-2eae3eca-fa1a-4e97-bf69-88102980a8bc tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] SCSI volumes sdj have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eae3eca-fa1a-4e97-bf69-88102980a8bc tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.078s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f58a95-6e4d-4102-a200-c437f91aa677]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eae3eca-fa1a-4e97-bf69-88102980a8bc tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.118s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccab0bf4-05d1-4f75-909e-94a24f52d55a]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eae3eca-fa1a-4e97-bf69-88102980a8bc tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab, portal: 172.16.0.220,3260]
Nov 14 00:47:37 user nova-compute[74850]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab, portal: 172.16.0.220,3260] successful.
Nov 14 00:47:37 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:37 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Took 1.81 seconds to deallocate network for instance.
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9137509-261e-4222-9682-d560cc1d53ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d491b01-619d-4d45-958f-aeeea30915e3]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eae3eca-fa1a-4e97-bf69-88102980a8bc tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-2eae3eca-fa1a-4e97-bf69-88102980a8bc tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.770s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eae3eca-fa1a-4e97-bf69-88102980a8bc tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] <== disconnect_volume: return (1249ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2eae3eca-fa1a-4e97-bf69-88102980a8bc tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.767s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG nova.compute.manager [req-6812c8bb-59d5-4f76-b756-0f5322b6782d req-ab1b6784-266c-4562-9257-3da4129a388b service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-unplugged-457e3066-b6bf-4d67-9c40-d1437ef901a3 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6812c8bb-59d5-4f76-b756-0f5322b6782d req-ab1b6784-266c-4562-9257-3da4129a388b service nova] Acquiring lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6812c8bb-59d5-4f76-b756-0f5322b6782d req-ab1b6784-266c-4562-9257-3da4129a388b service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6812c8bb-59d5-4f76-b756-0f5322b6782d req-ab1b6784-266c-4562-9257-3da4129a388b service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG nova.compute.manager [req-6812c8bb-59d5-4f76-b756-0f5322b6782d req-ab1b6784-266c-4562-9257-3da4129a388b service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] No waiting events found dispatching network-vif-unplugged-457e3066-b6bf-4d67-9c40-d1437ef901a3 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG nova.compute.manager [req-6812c8bb-59d5-4f76-b756-0f5322b6782d req-ab1b6784-266c-4562-9257-3da4129a388b service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-unplugged-457e3066-b6bf-4d67-9c40-d1437ef901a3 for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.039s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[342d3b5d-5739-4b60-a811-f36cec5add61]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 00:47:37 user nova-compute[74850]: No targets found.
Nov 14 00:47:37 user nova-compute[74850]: iSNS:
Nov 14 00:47:37 user nova-compute[74850]: No targets found.
Nov 14 00:47:37 user nova-compute[74850]: STATIC:
Nov 14 00:47:37 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd
Nov 14 00:47:37 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:37 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:37 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83
Nov 14 00:47:37 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:37 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:37 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8
Nov 14 00:47:37 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:37 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:37 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706
Nov 14 00:47:37 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:37 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:37 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2
Nov 14 00:47:37 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:37 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:37 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c
Nov 14 00:47:37 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:37 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:37 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732
Nov 14 00:47:37 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:37 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:37 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a
Nov 14 00:47:37 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:37 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:37 user nova-compute[74850]: FIRMWARE:
Nov 14 00:47:37 user nova-compute[74850]: No targets found.
Nov 14 00:47:37 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 00:47:37 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 00:47:37 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.036s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[06414c34-427e-4137-aa11-98104862dfa1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e2b5ff22-ec54-4242-ab59-93cf2ff1ec01 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e2b5ff22-ec54-4242-ab59-93cf2ff1ec01 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d1f866-0f17-42e4-8927-686640e69c9a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)
Nov 14 00:47:37 user nova-compute[74850]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)
Nov 14 00:47:37 user nova-compute[74850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:37 user nova-compute[74850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)
Nov 14 00:47:37 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:37 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:37 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:37 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:37 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)
Nov 14 00:47:37 user nova-compute[74850]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)
Nov 14 00:47:37 user nova-compute[74850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:37 user nova-compute[74850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)
Nov 14 00:47:37 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:37 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:37 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:37 user nova-compute[74850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 (non-flash)
Nov 14 00:47:37 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a3c11c8b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83'): ({'sdh'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Removing single pathed devices sdh {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d6ca54-c25d-46c3-86f2-019c799f6177]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.035s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5555947c-a88c-482e-88ae-6bd422b6677a]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Flushing IO for device /dev/sdh {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.029s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9e64fb-a714-41db-b998-9c1b6aa975fb]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] COPY block job progress, current cursor: 113246208 final cursor: 1073741824 {{(pid=74850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG nova.compute.manager [req-414040cb-52d3-4a5c-8876-27188f8159ec req-39d3c92c-4920-41d1-b1b3-3d7e353152a5 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-unplugged-9a03ed99-51c7-49e9-abbb-dc338dd795ff {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-414040cb-52d3-4a5c-8876-27188f8159ec req-39d3c92c-4920-41d1-b1b3-3d7e353152a5 service nova] Acquiring lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-414040cb-52d3-4a5c-8876-27188f8159ec req-39d3c92c-4920-41d1-b1b3-3d7e353152a5 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-414040cb-52d3-4a5c-8876-27188f8159ec req-39d3c92c-4920-41d1-b1b3-3d7e353152a5 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG nova.compute.manager [req-414040cb-52d3-4a5c-8876-27188f8159ec req-39d3c92c-4920-41d1-b1b3-3d7e353152a5 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] No waiting events found dispatching network-vif-unplugged-9a03ed99-51c7-49e9-abbb-dc338dd795ff {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG nova.compute.manager [req-414040cb-52d3-4a5c-8876-27188f8159ec req-39d3c92c-4920-41d1-b1b3-3d7e353152a5 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-unplugged-9a03ed99-51c7-49e9-abbb-dc338dd795ff for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG nova.compute.manager [req-414040cb-52d3-4a5c-8876-27188f8159ec req-39d3c92c-4920-41d1-b1b3-3d7e353152a5 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-plugged-9a03ed99-51c7-49e9-abbb-dc338dd795ff {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-414040cb-52d3-4a5c-8876-27188f8159ec req-39d3c92c-4920-41d1-b1b3-3d7e353152a5 service nova] Acquiring lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-414040cb-52d3-4a5c-8876-27188f8159ec req-39d3c92c-4920-41d1-b1b3-3d7e353152a5 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-414040cb-52d3-4a5c-8876-27188f8159ec req-39d3c92c-4920-41d1-b1b3-3d7e353152a5 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG nova.compute.manager [req-414040cb-52d3-4a5c-8876-27188f8159ec req-39d3c92c-4920-41d1-b1b3-3d7e353152a5 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] No waiting events found dispatching network-vif-plugged-9a03ed99-51c7-49e9-abbb-dc338dd795ff {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:47:37 user nova-compute[74850]: WARNING nova.compute.manager [req-414040cb-52d3-4a5c-8876-27188f8159ec req-39d3c92c-4920-41d1-b1b3-3d7e353152a5 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received unexpected event network-vif-plugged-9a03ed99-51c7-49e9-abbb-dc338dd795ff for instance with vm_state active and task_state deleting.
Nov 14 00:47:37 user nova-compute[74850]: DEBUG nova.compute.manager [req-414040cb-52d3-4a5c-8876-27188f8159ec req-39d3c92c-4920-41d1-b1b3-3d7e353152a5 service nova] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Received event network-vif-plugged-5db497e0-e507-4a13-b0ff-fb4f7608f94d {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-414040cb-52d3-4a5c-8876-27188f8159ec req-39d3c92c-4920-41d1-b1b3-3d7e353152a5 service nova] Acquiring lock "b54b37bc-8c90-4c48-a943-e489e830b93b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-414040cb-52d3-4a5c-8876-27188f8159ec req-39d3c92c-4920-41d1-b1b3-3d7e353152a5 service nova] Lock "b54b37bc-8c90-4c48-a943-e489e830b93b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-414040cb-52d3-4a5c-8876-27188f8159ec req-39d3c92c-4920-41d1-b1b3-3d7e353152a5 service nova] Lock "b54b37bc-8c90-4c48-a943-e489e830b93b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG nova.compute.manager [req-414040cb-52d3-4a5c-8876-27188f8159ec req-39d3c92c-4920-41d1-b1b3-3d7e353152a5 service nova] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] No waiting events found dispatching network-vif-plugged-5db497e0-e507-4a13-b0ff-fb4f7608f94d {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:47:37 user nova-compute[74850]: WARNING nova.compute.manager [req-414040cb-52d3-4a5c-8876-27188f8159ec req-39d3c92c-4920-41d1-b1b3-3d7e353152a5 service nova] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Received unexpected event network-vif-plugged-5db497e0-e507-4a13-b0ff-fb4f7608f94d for instance with vm_state active and task_state rebuild_spawning.
Nov 14 00:47:37 user nova-compute[74850]: DEBUG nova.compute.manager [req-414040cb-52d3-4a5c-8876-27188f8159ec req-39d3c92c-4920-41d1-b1b3-3d7e353152a5 service nova] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Received event network-vif-plugged-5db497e0-e507-4a13-b0ff-fb4f7608f94d {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-414040cb-52d3-4a5c-8876-27188f8159ec req-39d3c92c-4920-41d1-b1b3-3d7e353152a5 service nova] Acquiring lock "b54b37bc-8c90-4c48-a943-e489e830b93b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-414040cb-52d3-4a5c-8876-27188f8159ec req-39d3c92c-4920-41d1-b1b3-3d7e353152a5 service nova] Lock "b54b37bc-8c90-4c48-a943-e489e830b93b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-414040cb-52d3-4a5c-8876-27188f8159ec req-39d3c92c-4920-41d1-b1b3-3d7e353152a5 service nova] Lock "b54b37bc-8c90-4c48-a943-e489e830b93b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG nova.compute.manager [req-414040cb-52d3-4a5c-8876-27188f8159ec req-39d3c92c-4920-41d1-b1b3-3d7e353152a5 service nova] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] No waiting events found dispatching network-vif-plugged-5db497e0-e507-4a13-b0ff-fb4f7608f94d {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:47:37 user nova-compute[74850]: WARNING nova.compute.manager [req-414040cb-52d3-4a5c-8876-27188f8159ec req-39d3c92c-4920-41d1-b1b3-3d7e353152a5 service nova] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Received unexpected event network-vif-plugged-5db497e0-e507-4a13-b0ff-fb4f7608f94d for instance with vm_state active and task_state rebuild_spawning.
Nov 14 00:47:37 user nova-compute[74850]: DEBUG nova.compute.manager [req-414040cb-52d3-4a5c-8876-27188f8159ec req-39d3c92c-4920-41d1-b1b3-3d7e353152a5 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-unplugged-447494fb-fc40-41f9-94d9-d1c39434a22d {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-414040cb-52d3-4a5c-8876-27188f8159ec req-39d3c92c-4920-41d1-b1b3-3d7e353152a5 service nova] Acquiring lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-414040cb-52d3-4a5c-8876-27188f8159ec req-39d3c92c-4920-41d1-b1b3-3d7e353152a5 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-414040cb-52d3-4a5c-8876-27188f8159ec req-39d3c92c-4920-41d1-b1b3-3d7e353152a5 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG nova.compute.manager [req-414040cb-52d3-4a5c-8876-27188f8159ec req-39d3c92c-4920-41d1-b1b3-3d7e353152a5 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] No waiting events found dispatching network-vif-unplugged-447494fb-fc40-41f9-94d9-d1c39434a22d {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG nova.compute.manager [req-414040cb-52d3-4a5c-8876-27188f8159ec req-39d3c92c-4920-41d1-b1b3-3d7e353152a5 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-unplugged-447494fb-fc40-41f9-94d9-d1c39434a22d for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.290s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f0b7d5-49ab-4669-8935-1e6850f7dbf2]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] SCSI volumes sdh have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 00:47:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.061s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c7399e-b6f6-4cc1-8017-5f98a8c60fb8]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-e2b5ff22-ec54-4242-ab59-93cf2ff1ec01 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 -p 172.16.0.220:3260 --logout" returned: 0 in 0.155s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ef7caf-c0bb-48ce-857e-5aa150303886]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83, portal: 172.16.0.220,3260]
Nov 14 00:47:38 user nova-compute[74850]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83, portal: 172.16.0.220,3260] successful.
Nov 14 00:47:38 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12497dec-be59-409e-8653-a094b2ef1c83 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.069s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[18138203-bfd7-4180-89e3-af7ca8db6775]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.919s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] <== disconnect_volume: return (1686ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 00:47:38 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Deleting instance files /opt/stack/data/nova/instances/7b1dc486-c6b5-4518-8da5-6042c97cbe55_del
Nov 14 00:47:38 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Deletion of /opt/stack/data/nova/instances/7b1dc486-c6b5-4518-8da5-6042c97cbe55_del complete
Nov 14 00:47:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] COPY block job progress, current cursor: 217055232 final cursor: 1073741824 {{(pid=74850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-e2b5ff22-ec54-4242-ab59-93cf2ff1ec01 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:38 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Instance destroyed successfully.
Nov 14 00:47:38 user nova-compute[74850]: DEBUG nova.objects.instance [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Lazy-loading 'resources' on Instance uuid cc072036-25dc-48a8-b430-5a2655fb473a {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e2b5ff22-ec54-4242-ab59-93cf2ff1ec01 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.950s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500911426',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500911426',id=12,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvUEeAUQLsXKl6m7NjNtE2ef2Weqmtoygn4z0iXpTrZKHLLVGmVbBND3rGgVzIxdNW/D9ndUeJzkE9PknlgrHFaaNshkRa/weDto/3TT+c3YiufBTSs5ncIjQtIYYNX4w==',key_name='tempest-keypair-637099234',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:46:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c11a9473df4d4f11ac696ce90dfe7dff',ramdisk_id='',reservation_id='r-ci1qk04z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-132442839',owner_user_name='tempest-TaggedBootDevicesTest_v242-132442839-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:46:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c75e4b6218c34ff98d528512b4b2d825',uuid=cc072036-25dc-48a8-b430-5a2655fb473a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a03ed99-51c7-49e9-abbb-dc338dd795ff", "address": "fa:16:3e:3b:53:d5", "network": {"id": "9ebba924-fce1-4de9-9859-4be03c6c5bd6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-873499233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a03ed99-51", "ovs_interfaceid": "9a03ed99-51c7-49e9-abbb-dc338dd795ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converting VIF {"id": "9a03ed99-51c7-49e9-abbb-dc338dd795ff", "address": "fa:16:3e:3b:53:d5", "network": {"id": "9ebba924-fce1-4de9-9859-4be03c6c5bd6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-873499233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a03ed99-51", "ovs_interfaceid": "9a03ed99-51c7-49e9-abbb-dc338dd795ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:53:d5,bridge_name='br-int',has_traffic_filtering=True,id=9a03ed99-51c7-49e9-abbb-dc338dd795ff,network=Network(9ebba924-fce1-4de9-9859-4be03c6c5bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a03ed99-51') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG os_vif [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:53:d5,bridge_name='br-int',has_traffic_filtering=True,id=9a03ed99-51c7-49e9-abbb-dc338dd795ff,network=Network(9ebba924-fce1-4de9-9859-4be03c6c5bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a03ed99-51') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a03ed99-51, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:47:38 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-e2b5ff22-ec54-4242-ab59-93cf2ff1ec01 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Deleted allocations for instance 4a2881e6-ee6e-4165-a6d9-35fda79c142d
Nov 14 00:47:38 user nova-compute[74850]: DEBUG nova.compute.manager [req-d34eb3f9-9350-4453-9acd-9cc880e83f4c req-5e81ded8-6a01-4a6a-b501-7d7cedae1363 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-plugged-3b861886-0054-400a-b163-35945d498927 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d34eb3f9-9350-4453-9acd-9cc880e83f4c req-5e81ded8-6a01-4a6a-b501-7d7cedae1363 service nova] Acquiring lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d34eb3f9-9350-4453-9acd-9cc880e83f4c req-5e81ded8-6a01-4a6a-b501-7d7cedae1363 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d34eb3f9-9350-4453-9acd-9cc880e83f4c req-5e81ded8-6a01-4a6a-b501-7d7cedae1363 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG nova.compute.manager [req-d34eb3f9-9350-4453-9acd-9cc880e83f4c req-5e81ded8-6a01-4a6a-b501-7d7cedae1363 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] No waiting events found dispatching network-vif-plugged-3b861886-0054-400a-b163-35945d498927 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:47:38 user nova-compute[74850]: WARNING nova.compute.manager [req-d34eb3f9-9350-4453-9acd-9cc880e83f4c req-5e81ded8-6a01-4a6a-b501-7d7cedae1363 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received unexpected event network-vif-plugged-3b861886-0054-400a-b163-35945d498927 for instance with vm_state active and task_state deleting.
Nov 14 00:47:38 user nova-compute[74850]: DEBUG nova.compute.manager [req-d34eb3f9-9350-4453-9acd-9cc880e83f4c req-5e81ded8-6a01-4a6a-b501-7d7cedae1363 service nova] [instance: 4a2881e6-ee6e-4165-a6d9-35fda79c142d] Received event network-vif-deleted-f8d36bc2-b85b-4eaf-8c22-e58c9dae360d {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG nova.compute.manager [req-d34eb3f9-9350-4453-9acd-9cc880e83f4c req-5e81ded8-6a01-4a6a-b501-7d7cedae1363 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-unplugged-381f68d0-96e0-404e-93e6-d166732e2df8 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d34eb3f9-9350-4453-9acd-9cc880e83f4c req-5e81ded8-6a01-4a6a-b501-7d7cedae1363 service nova] Acquiring lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d34eb3f9-9350-4453-9acd-9cc880e83f4c req-5e81ded8-6a01-4a6a-b501-7d7cedae1363 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d34eb3f9-9350-4453-9acd-9cc880e83f4c req-5e81ded8-6a01-4a6a-b501-7d7cedae1363 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG nova.compute.manager [req-d34eb3f9-9350-4453-9acd-9cc880e83f4c req-5e81ded8-6a01-4a6a-b501-7d7cedae1363 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] No waiting events found dispatching network-vif-unplugged-381f68d0-96e0-404e-93e6-d166732e2df8 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG nova.compute.manager [req-d34eb3f9-9350-4453-9acd-9cc880e83f4c req-5e81ded8-6a01-4a6a-b501-7d7cedae1363 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-unplugged-381f68d0-96e0-404e-93e6-d166732e2df8 for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG nova.compute.manager [req-d34eb3f9-9350-4453-9acd-9cc880e83f4c req-5e81ded8-6a01-4a6a-b501-7d7cedae1363 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-plugged-381f68d0-96e0-404e-93e6-d166732e2df8 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d34eb3f9-9350-4453-9acd-9cc880e83f4c req-5e81ded8-6a01-4a6a-b501-7d7cedae1363 service nova] Acquiring lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d34eb3f9-9350-4453-9acd-9cc880e83f4c req-5e81ded8-6a01-4a6a-b501-7d7cedae1363 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d34eb3f9-9350-4453-9acd-9cc880e83f4c req-5e81ded8-6a01-4a6a-b501-7d7cedae1363 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG nova.compute.manager [req-d34eb3f9-9350-4453-9acd-9cc880e83f4c req-5e81ded8-6a01-4a6a-b501-7d7cedae1363 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] No waiting events found dispatching network-vif-plugged-381f68d0-96e0-404e-93e6-d166732e2df8 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:47:38 user nova-compute[74850]: WARNING nova.compute.manager [req-d34eb3f9-9350-4453-9acd-9cc880e83f4c req-5e81ded8-6a01-4a6a-b501-7d7cedae1363 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received unexpected event network-vif-plugged-381f68d0-96e0-404e-93e6-d166732e2df8 for instance with vm_state active and task_state deleting.
Nov 14 00:47:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:38 user nova-compute[74850]: INFO nova.compute.manager [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Took 7.50 seconds to destroy the instance on the hypervisor.
Nov 14 00:47:38 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e2b5ff22-ec54-4242-ab59-93cf2ff1ec01 tempest-AttachSCSIVolumeTestJSON-1513679227 tempest-AttachSCSIVolumeTestJSON-1513679227-project-member] Lock "4a2881e6-ee6e-4165-a6d9-35fda79c142d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.582s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f5082c6b-4e5a-4c47-bc47-66731f210a14) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:38 user nova-compute[74850]: INFO os_vif [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:53:d5,bridge_name='br-int',has_traffic_filtering=True,id=9a03ed99-51c7-49e9-abbb-dc338dd795ff,network=Network(9ebba924-fce1-4de9-9859-4be03c6c5bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a03ed99-51')
Nov 14 00:47:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500911426',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500911426',id=12,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvUEeAUQLsXKl6m7NjNtE2ef2Weqmtoygn4z0iXpTrZKHLLVGmVbBND3rGgVzIxdNW/D9ndUeJzkE9PknlgrHFaaNshkRa/weDto/3TT+c3YiufBTSs5ncIjQtIYYNX4w==',key_name='tempest-keypair-637099234',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:46:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c11a9473df4d4f11ac696ce90dfe7dff',ramdisk_id='',reservation_id='r-ci1qk04z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-132442839',owner_user_name='tempest-TaggedBootDevicesTest_v242-132442839-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:46:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c75e4b6218c34ff98d528512b4b2d825',uuid=cc072036-25dc-48a8-b430-5a2655fb473a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b861886-0054-400a-b163-35945d498927", "address": "fa:16:3e:19:40:aa", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b861886-00", "ovs_interfaceid": "3b861886-0054-400a-b163-35945d498927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converting VIF {"id": "3b861886-0054-400a-b163-35945d498927", "address": "fa:16:3e:19:40:aa", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b861886-00", "ovs_interfaceid": "3b861886-0054-400a-b163-35945d498927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:40:aa,bridge_name='br-int',has_traffic_filtering=True,id=3b861886-0054-400a-b163-35945d498927,network=Network(6638fd71-589d-4917-8925-96a0fd255c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3b861886-00') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG os_vif [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:40:aa,bridge_name='br-int',has_traffic_filtering=True,id=3b861886-0054-400a-b163-35945d498927,network=Network(6638fd71-589d-4917-8925-96a0fd255c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3b861886-00') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b861886-00, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG nova.objects.instance [None req-2eae3eca-fa1a-4e97-bf69-88102980a8bc tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lazy-loading 'flavor' on Instance uuid 28212eec-99be-4171-97ed-7748bbb75c88 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] COPY block job progress, current cursor: 337641472 final cursor: 1073741824 {{(pid=74850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b671613d-0cd1-4d9f-8a44-a65d8eee3395) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2eae3eca-fa1a-4e97-bf69-88102980a8bc tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "28212eec-99be-4171-97ed-7748bbb75c88" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.416s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:47:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:39 user nova-compute[74850]: INFO os_vif [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:40:aa,bridge_name='br-int',has_traffic_filtering=True,id=3b861886-0054-400a-b163-35945d498927,network=Network(6638fd71-589d-4917-8925-96a0fd255c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3b861886-00')
Nov 14 00:47:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500911426',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500911426',id=12,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvUEeAUQLsXKl6m7NjNtE2ef2Weqmtoygn4z0iXpTrZKHLLVGmVbBND3rGgVzIxdNW/D9ndUeJzkE9PknlgrHFaaNshkRa/weDto/3TT+c3YiufBTSs5ncIjQtIYYNX4w==',key_name='tempest-keypair-637099234',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:46:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c11a9473df4d4f11ac696ce90dfe7dff',ramdisk_id='',reservation_id='r-ci1qk04z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-132442839',owner_user_name='tempest-TaggedBootDevicesTest_v242-132442839-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:46:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c75e4b6218c34ff98d528512b4b2d825',uuid=cc072036-25dc-48a8-b430-5a2655fb473a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "381f68d0-96e0-404e-93e6-d166732e2df8", "address": "fa:16:3e:41:e5:08", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap381f68d0-96", "ovs_interfaceid": "381f68d0-96e0-404e-93e6-d166732e2df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converting VIF {"id": "381f68d0-96e0-404e-93e6-d166732e2df8", "address": "fa:16:3e:41:e5:08", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap381f68d0-96", "ovs_interfaceid": "381f68d0-96e0-404e-93e6-d166732e2df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:e5:08,bridge_name='br-int',has_traffic_filtering=True,id=381f68d0-96e0-404e-93e6-d166732e2df8,network=Network(6638fd71-589d-4917-8925-96a0fd255c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap381f68d0-96') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG os_vif [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:e5:08,bridge_name='br-int',has_traffic_filtering=True,id=381f68d0-96e0-404e-93e6-d166732e2df8,network=Network(6638fd71-589d-4917-8925-96a0fd255c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap381f68d0-96') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap381f68d0-96, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f0c8cc85-49db-4f9c-a5da-f5ae7de74b7b) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:39 user nova-compute[74850]: INFO os_vif [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:e5:08,bridge_name='br-int',has_traffic_filtering=True,id=381f68d0-96e0-404e-93e6-d166732e2df8,network=Network(6638fd71-589d-4917-8925-96a0fd255c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap381f68d0-96')
Nov 14 00:47:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500911426',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500911426',id=12,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvUEeAUQLsXKl6m7NjNtE2ef2Weqmtoygn4z0iXpTrZKHLLVGmVbBND3rGgVzIxdNW/D9ndUeJzkE9PknlgrHFaaNshkRa/weDto/3TT+c3YiufBTSs5ncIjQtIYYNX4w==',key_name='tempest-keypair-637099234',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:46:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c11a9473df4d4f11ac696ce90dfe7dff',ramdisk_id='',reservation_id='r-ci1qk04z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-132442839',owner_user_name='tempest-TaggedBootDevicesTest_v242-132442839-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:46:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c75e4b6218c34ff98d528512b4b2d825',uuid=cc072036-25dc-48a8-b430-5a2655fb473a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "447494fb-fc40-41f9-94d9-d1c39434a22d", "address": "fa:16:3e:87:3d:45", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap447494fb-fc", "ovs_interfaceid": "447494fb-fc40-41f9-94d9-d1c39434a22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converting VIF {"id": "447494fb-fc40-41f9-94d9-d1c39434a22d", "address": "fa:16:3e:87:3d:45", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap447494fb-fc", "ovs_interfaceid": "447494fb-fc40-41f9-94d9-d1c39434a22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:3d:45,bridge_name='br-int',has_traffic_filtering=True,id=447494fb-fc40-41f9-94d9-d1c39434a22d,network=Network(6638fd71-589d-4917-8925-96a0fd255c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap447494fb-fc') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG os_vif [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:3d:45,bridge_name='br-int',has_traffic_filtering=True,id=447494fb-fc40-41f9-94d9-d1c39434a22d,network=Network(6638fd71-589d-4917-8925-96a0fd255c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap447494fb-fc') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap447494fb-fc, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=677f08ff-05e9-4938-87d4-5746432d996a) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:39 user nova-compute[74850]: INFO os_vif [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:3d:45,bridge_name='br-int',has_traffic_filtering=True,id=447494fb-fc40-41f9-94d9-d1c39434a22d,network=Network(6638fd71-589d-4917-8925-96a0fd255c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap447494fb-fc')
Nov 14 00:47:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500911426',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500911426',id=12,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvUEeAUQLsXKl6m7NjNtE2ef2Weqmtoygn4z0iXpTrZKHLLVGmVbBND3rGgVzIxdNW/D9ndUeJzkE9PknlgrHFaaNshkRa/weDto/3TT+c3YiufBTSs5ncIjQtIYYNX4w==',key_name='tempest-keypair-637099234',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:46:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c11a9473df4d4f11ac696ce90dfe7dff',ramdisk_id='',reservation_id='r-ci1qk04z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-132442839',owner_user_name='tempest-TaggedBootDevicesTest_v242-132442839-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:46:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c75e4b6218c34ff98d528512b4b2d825',uuid=cc072036-25dc-48a8-b430-5a2655fb473a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70f458ad-d5db-47a5-9ab1-b776a8fdbb98", "address": "fa:16:3e:96:01:0a", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f458ad-d5", "ovs_interfaceid": "70f458ad-d5db-47a5-9ab1-b776a8fdbb98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converting VIF {"id": "70f458ad-d5db-47a5-9ab1-b776a8fdbb98", "address": "fa:16:3e:96:01:0a", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f458ad-d5", "ovs_interfaceid": "70f458ad-d5db-47a5-9ab1-b776a8fdbb98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:01:0a,bridge_name='br-int',has_traffic_filtering=True,id=70f458ad-d5db-47a5-9ab1-b776a8fdbb98,network=Network(6638fd71-589d-4917-8925-96a0fd255c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70f458ad-d5') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG os_vif [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:01:0a,bridge_name='br-int',has_traffic_filtering=True,id=70f458ad-d5db-47a5-9ab1-b776a8fdbb98,network=Network(6638fd71-589d-4917-8925-96a0fd255c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70f458ad-d5') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] COPY block job progress, current cursor: 521142272 final cursor: 1073741824 {{(pid=74850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70f458ad-d5, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f0f1c332-0efa-45e9-b2bb-8d0a64d3807b) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:39 user nova-compute[74850]: INFO os_vif [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:01:0a,bridge_name='br-int',has_traffic_filtering=True,id=70f458ad-d5db-47a5-9ab1-b776a8fdbb98,network=Network(6638fd71-589d-4917-8925-96a0fd255c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70f458ad-d5')
Nov 14 00:47:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500911426',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500911426',id=12,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvUEeAUQLsXKl6m7NjNtE2ef2Weqmtoygn4z0iXpTrZKHLLVGmVbBND3rGgVzIxdNW/D9ndUeJzkE9PknlgrHFaaNshkRa/weDto/3TT+c3YiufBTSs5ncIjQtIYYNX4w==',key_name='tempest-keypair-637099234',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:46:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c11a9473df4d4f11ac696ce90dfe7dff',ramdisk_id='',reservation_id='r-ci1qk04z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-132442839',owner_user_name='tempest-TaggedBootDevicesTest_v242-132442839-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:46:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c75e4b6218c34ff98d528512b4b2d825',uuid=cc072036-25dc-48a8-b430-5a2655fb473a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "457e3066-b6bf-4d67-9c40-d1437ef901a3", "address": "fa:16:3e:dd:36:d4", "network": {"id": "b5892a30-40d5-4832-bb6b-b8a7f20106b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-725774050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457e3066-b6", "ovs_interfaceid": "457e3066-b6bf-4d67-9c40-d1437ef901a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converting VIF {"id": "457e3066-b6bf-4d67-9c40-d1437ef901a3", "address": "fa:16:3e:dd:36:d4", "network": {"id": "b5892a30-40d5-4832-bb6b-b8a7f20106b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-725774050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457e3066-b6", "ovs_interfaceid": "457e3066-b6bf-4d67-9c40-d1437ef901a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:36:d4,bridge_name='br-int',has_traffic_filtering=True,id=457e3066-b6bf-4d67-9c40-d1437ef901a3,network=Network(b5892a30-40d5-4832-bb6b-b8a7f20106b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457e3066-b6') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG os_vif [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:36:d4,bridge_name='br-int',has_traffic_filtering=True,id=457e3066-b6bf-4d67-9c40-d1437ef901a3,network=Network(b5892a30-40d5-4832-bb6b-b8a7f20106b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457e3066-b6') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap457e3066-b6, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f8f680ad-ba90-43b9-b894-31ce023eef08) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:39 user nova-compute[74850]: INFO os_vif [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:36:d4,bridge_name='br-int',has_traffic_filtering=True,id=457e3066-b6bf-4d67-9c40-d1437ef901a3,network=Network(b5892a30-40d5-4832-bb6b-b8a7f20106b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457e3066-b6')
Nov 14 00:47:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500911426',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500911426',id=12,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvUEeAUQLsXKl6m7NjNtE2ef2Weqmtoygn4z0iXpTrZKHLLVGmVbBND3rGgVzIxdNW/D9ndUeJzkE9PknlgrHFaaNshkRa/weDto/3TT+c3YiufBTSs5ncIjQtIYYNX4w==',key_name='tempest-keypair-637099234',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:46:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c11a9473df4d4f11ac696ce90dfe7dff',ramdisk_id='',reservation_id='r-ci1qk04z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-132442839',owner_user_name='tempest-TaggedBootDevicesTest_v242-132442839-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:46:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c75e4b6218c34ff98d528512b4b2d825',uuid=cc072036-25dc-48a8-b430-5a2655fb473a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14239fc2-af2c-4d50-9f58-9758fe0f1221", "address": "fa:16:3e:66:d7:47", "network": {"id": "b5892a30-40d5-4832-bb6b-b8a7f20106b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-725774050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14239fc2-af", "ovs_interfaceid": "14239fc2-af2c-4d50-9f58-9758fe0f1221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converting VIF {"id": "14239fc2-af2c-4d50-9f58-9758fe0f1221", "address": "fa:16:3e:66:d7:47", "network": {"id": "b5892a30-40d5-4832-bb6b-b8a7f20106b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-725774050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14239fc2-af", "ovs_interfaceid": "14239fc2-af2c-4d50-9f58-9758fe0f1221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:d7:47,bridge_name='br-int',has_traffic_filtering=True,id=14239fc2-af2c-4d50-9f58-9758fe0f1221,network=Network(b5892a30-40d5-4832-bb6b-b8a7f20106b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14239fc2-af') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG os_vif [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:d7:47,bridge_name='br-int',has_traffic_filtering=True,id=14239fc2-af2c-4d50-9f58-9758fe0f1221,network=Network(b5892a30-40d5-4832-bb6b-b8a7f20106b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14239fc2-af') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap14239fc2-af, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG nova.compute.manager [req-597023a4-fdd5-47f2-a4a7-d9d6f7eea0eb req-e99b345a-01a4-42cd-af3e-32917334b5d6 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-plugged-457e3066-b6bf-4d67-9c40-d1437ef901a3 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-597023a4-fdd5-47f2-a4a7-d9d6f7eea0eb req-e99b345a-01a4-42cd-af3e-32917334b5d6 service nova] Acquiring lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-597023a4-fdd5-47f2-a4a7-d9d6f7eea0eb req-e99b345a-01a4-42cd-af3e-32917334b5d6 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-597023a4-fdd5-47f2-a4a7-d9d6f7eea0eb req-e99b345a-01a4-42cd-af3e-32917334b5d6 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG nova.compute.manager [req-597023a4-fdd5-47f2-a4a7-d9d6f7eea0eb req-e99b345a-01a4-42cd-af3e-32917334b5d6 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] No waiting events found dispatching network-vif-plugged-457e3066-b6bf-4d67-9c40-d1437ef901a3 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:47:39 user nova-compute[74850]: WARNING nova.compute.manager [req-597023a4-fdd5-47f2-a4a7-d9d6f7eea0eb req-e99b345a-01a4-42cd-af3e-32917334b5d6 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received unexpected event network-vif-plugged-457e3066-b6bf-4d67-9c40-d1437ef901a3 for instance with vm_state active and task_state deleting.
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cc52275f-8530-46c2-8b8b-578f66a5587c) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:39 user nova-compute[74850]: INFO os_vif [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:d7:47,bridge_name='br-int',has_traffic_filtering=True,id=14239fc2-af2c-4d50-9f58-9758fe0f1221,network=Network(b5892a30-40d5-4832-bb6b-b8a7f20106b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14239fc2-af')
Nov 14 00:47:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yXAhsIuZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:47:39 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:47:39 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 00:47:39 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Instance spawned successfully.
Nov 14 00:47:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c13781-3cfa-4fb8-aaca-6f37568102a9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 00:47:39 user nova-compute[74850]: No targets found.
Nov 14 00:47:39 user nova-compute[74850]: iSNS:
Nov 14 00:47:39 user nova-compute[74850]: No targets found.
Nov 14 00:47:39 user nova-compute[74850]: STATIC:
Nov 14 00:47:39 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd
Nov 14 00:47:39 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:39 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:39 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8
Nov 14 00:47:39 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:39 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:39 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706
Nov 14 00:47:39 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:39 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:39 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2
Nov 14 00:47:39 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:39 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:39 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c
Nov 14 00:47:39 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:39 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:39 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732
Nov 14 00:47:39 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:39 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:39 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a
Nov 14 00:47:39 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:39 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:39 user nova-compute[74850]: FIRMWARE:
Nov 14 00:47:39 user nova-compute[74850]: No targets found.
Nov 14 00:47:39 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 00:47:39 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 00:47:39 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdc2f4d-1b1c-439e-8d5a-0b78d32c8aeb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab890bc5-1a04-433f-9021-74cdce3bc3df]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)
Nov 14 00:47:39 user nova-compute[74850]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)
Nov 14 00:47:39 user nova-compute[74850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:39 user nova-compute[74850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)
Nov 14 00:47:39 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:39 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:39 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:39 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)
Nov 14 00:47:39 user nova-compute[74850]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)
Nov 14 00:47:39 user nova-compute[74850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:39 user nova-compute[74850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)
Nov 14 00:47:39 user nova-compute[74850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c (non-flash)
Nov 14 00:47:39 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:39 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:39 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a5c253130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c'): ({'sdc'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Removing single pathed devices sdc {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6026822a-85ac-4d2e-b491-1666a027fa05]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41e1bc3-062a-425b-a271-4f8fc4f256a7]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Flushing IO for device /dev/sdc {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c3698a-bff6-47e3-a653-e2b2d6c5b34c]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b097eb6-d010-46aa-aedf-fc57b059be1d]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] SCSI volumes sdc have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG nova.objects.instance [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74850) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf95cb5-527a-4546-a4fa-e524f3d92901]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] COPY block job progress, current cursor: 658505728 final cursor: 1073741824 {{(pid=74850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b674f40-7055-4d8b-aafc-3138d5392ec0]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c, portal: 172.16.0.220,3260]
Nov 14 00:47:39 user nova-compute[74850]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c, portal: 172.16.0.220,3260] successful.
Nov 14 00:47:39 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6b3dee9f-438e-479e-a5e0-5a2b05bfbe87 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.154s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG nova.compute.manager [req-303425dd-0565-423e-9858-c54bc7991c17 req-eaee806e-bd92-43ab-8cba-a0e8907647be service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-plugged-447494fb-fc40-41f9-94d9-d1c39434a22d {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-303425dd-0565-423e-9858-c54bc7991c17 req-eaee806e-bd92-43ab-8cba-a0e8907647be service nova] Acquiring lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-303425dd-0565-423e-9858-c54bc7991c17 req-eaee806e-bd92-43ab-8cba-a0e8907647be service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-303425dd-0565-423e-9858-c54bc7991c17 req-eaee806e-bd92-43ab-8cba-a0e8907647be service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG nova.compute.manager [req-303425dd-0565-423e-9858-c54bc7991c17 req-eaee806e-bd92-43ab-8cba-a0e8907647be service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] No waiting events found dispatching network-vif-plugged-447494fb-fc40-41f9-94d9-d1c39434a22d {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:47:39 user nova-compute[74850]: WARNING nova.compute.manager [req-303425dd-0565-423e-9858-c54bc7991c17 req-eaee806e-bd92-43ab-8cba-a0e8907647be service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received unexpected event network-vif-plugged-447494fb-fc40-41f9-94d9-d1c39434a22d for instance with vm_state active and task_state deleting.
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0445ff3f-e6a1-42c9-8615-6a1dedd73f9c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[691507cb-7513-459d-afda-735c540f2d53]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.465s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] <== disconnect_volume: return (467ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lIdOTxVJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:47:39 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:47:39 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:47:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f03f971-7159-4ae0-a2a5-e5e04e25b07b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 00:47:40 user nova-compute[74850]: No targets found.
Nov 14 00:47:40 user nova-compute[74850]: iSNS:
Nov 14 00:47:40 user nova-compute[74850]: No targets found.
Nov 14 00:47:40 user nova-compute[74850]: STATIC:
Nov 14 00:47:40 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd
Nov 14 00:47:40 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:40 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:40 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8
Nov 14 00:47:40 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:40 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:40 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706
Nov 14 00:47:40 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:40 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:40 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2
Nov 14 00:47:40 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:40 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:40 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732
Nov 14 00:47:40 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:40 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:40 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a
Nov 14 00:47:40 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:40 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:40 user nova-compute[74850]: FIRMWARE:
Nov 14 00:47:40 user nova-compute[74850]: No targets found.
Nov 14 00:47:40 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 00:47:40 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 00:47:40 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.037s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8fac02-6441-48c7-a35f-2e97fb795cda]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.064s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e78b93-d7e4-4a85-ac86-a92486b353c0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)
Nov 14 00:47:40 user nova-compute[74850]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)
Nov 14 00:47:40 user nova-compute[74850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:40 user nova-compute[74850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)
Nov 14 00:47:40 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:40 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:40 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)
Nov 14 00:47:40 user nova-compute[74850]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)
Nov 14 00:47:40 user nova-compute[74850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:40 user nova-compute[74850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)
Nov 14 00:47:40 user nova-compute[74850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 (non-flash)
Nov 14 00:47:40 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:40 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a3c2eea70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8'): ({'sde'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Removing single pathed devices sde {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9148225d-5428-464d-97d8-c4ad573c86b0]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef366b8e-f0e5-4242-a430-70c43b7c49c9]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Flushing IO for device /dev/sde {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10628cb-7efa-4d78-bae7-15bcfdb70475]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[647c0139-6654-45af-8ab4-0f63d4cf4af6]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] SCSI volumes sde have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.045s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4130a4af-ff8e-4256-a6d5-06206f8db50a]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] COPY block job progress, current cursor: 778043392 final cursor: 1073741824 {{(pid=74850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2f3e38-8f9d-46e9-bc97-642ece28883e]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8, portal: 172.16.0.220,3260]
Nov 14 00:47:40 user nova-compute[74850]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8, portal: 172.16.0.220,3260] successful.
Nov 14 00:47:40 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97af5108-d8a8-4d51-9924-995dc5855ef8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.047s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ca02f3-7733-42b0-bcca-3d5e94b76461]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.530s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] <== disconnect_volume: return (532ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPwzaCbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:47:40 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:47:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[758b6261-3f15-4cf1-a4f2-45473e60f9ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 00:47:40 user nova-compute[74850]: No targets found.
Nov 14 00:47:40 user nova-compute[74850]: iSNS:
Nov 14 00:47:40 user nova-compute[74850]: No targets found.
Nov 14 00:47:40 user nova-compute[74850]: STATIC:
Nov 14 00:47:40 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd
Nov 14 00:47:40 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:40 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:40 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706
Nov 14 00:47:40 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:40 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:40 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2
Nov 14 00:47:40 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:40 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:40 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732
Nov 14 00:47:40 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:40 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:40 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a
Nov 14 00:47:40 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:40 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:40 user nova-compute[74850]: FIRMWARE:
Nov 14 00:47:40 user nova-compute[74850]: No targets found.
Nov 14 00:47:40 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 00:47:40 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 00:47:40 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcb2606-d163-4a02-9e30-739fc72644b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG nova.compute.manager [req-f624258d-a96f-4fae-8393-ee1f62595be1 req-3afb3740-8e02-4b57-bcd2-cd928da3f6a4 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-unplugged-70f458ad-d5db-47a5-9ab1-b776a8fdbb98 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f624258d-a96f-4fae-8393-ee1f62595be1 req-3afb3740-8e02-4b57-bcd2-cd928da3f6a4 service nova] Acquiring lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f624258d-a96f-4fae-8393-ee1f62595be1 req-3afb3740-8e02-4b57-bcd2-cd928da3f6a4 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f624258d-a96f-4fae-8393-ee1f62595be1 req-3afb3740-8e02-4b57-bcd2-cd928da3f6a4 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG nova.compute.manager [req-f624258d-a96f-4fae-8393-ee1f62595be1 req-3afb3740-8e02-4b57-bcd2-cd928da3f6a4 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] No waiting events found dispatching network-vif-unplugged-70f458ad-d5db-47a5-9ab1-b776a8fdbb98 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG nova.compute.manager [req-f624258d-a96f-4fae-8393-ee1f62595be1 req-3afb3740-8e02-4b57-bcd2-cd928da3f6a4 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-unplugged-70f458ad-d5db-47a5-9ab1-b776a8fdbb98 for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG nova.compute.manager [req-f624258d-a96f-4fae-8393-ee1f62595be1 req-3afb3740-8e02-4b57-bcd2-cd928da3f6a4 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-plugged-70f458ad-d5db-47a5-9ab1-b776a8fdbb98 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f624258d-a96f-4fae-8393-ee1f62595be1 req-3afb3740-8e02-4b57-bcd2-cd928da3f6a4 service nova] Acquiring lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f624258d-a96f-4fae-8393-ee1f62595be1 req-3afb3740-8e02-4b57-bcd2-cd928da3f6a4 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f624258d-a96f-4fae-8393-ee1f62595be1 req-3afb3740-8e02-4b57-bcd2-cd928da3f6a4 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG nova.compute.manager [req-f624258d-a96f-4fae-8393-ee1f62595be1 req-3afb3740-8e02-4b57-bcd2-cd928da3f6a4 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] No waiting events found dispatching network-vif-plugged-70f458ad-d5db-47a5-9ab1-b776a8fdbb98 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:47:40 user nova-compute[74850]: WARNING nova.compute.manager [req-f624258d-a96f-4fae-8393-ee1f62595be1 req-3afb3740-8e02-4b57-bcd2-cd928da3f6a4 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received unexpected event network-vif-plugged-70f458ad-d5db-47a5-9ab1-b776a8fdbb98 for instance with vm_state active and task_state deleting.
Nov 14 00:47:40 user nova-compute[74850]: DEBUG nova.compute.manager [req-f624258d-a96f-4fae-8393-ee1f62595be1 req-3afb3740-8e02-4b57-bcd2-cd928da3f6a4 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-unplugged-14239fc2-af2c-4d50-9f58-9758fe0f1221 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f624258d-a96f-4fae-8393-ee1f62595be1 req-3afb3740-8e02-4b57-bcd2-cd928da3f6a4 service nova] Acquiring lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f624258d-a96f-4fae-8393-ee1f62595be1 req-3afb3740-8e02-4b57-bcd2-cd928da3f6a4 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f624258d-a96f-4fae-8393-ee1f62595be1 req-3afb3740-8e02-4b57-bcd2-cd928da3f6a4 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG nova.compute.manager [req-f624258d-a96f-4fae-8393-ee1f62595be1 req-3afb3740-8e02-4b57-bcd2-cd928da3f6a4 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] No waiting events found dispatching network-vif-unplugged-14239fc2-af2c-4d50-9f58-9758fe0f1221 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG nova.compute.manager [req-f624258d-a96f-4fae-8393-ee1f62595be1 req-3afb3740-8e02-4b57-bcd2-cd928da3f6a4 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-unplugged-14239fc2-af2c-4d50-9f58-9758fe0f1221 for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG nova.compute.manager [req-f624258d-a96f-4fae-8393-ee1f62595be1 req-3afb3740-8e02-4b57-bcd2-cd928da3f6a4 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-plugged-14239fc2-af2c-4d50-9f58-9758fe0f1221 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f624258d-a96f-4fae-8393-ee1f62595be1 req-3afb3740-8e02-4b57-bcd2-cd928da3f6a4 service nova] Acquiring lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f624258d-a96f-4fae-8393-ee1f62595be1 req-3afb3740-8e02-4b57-bcd2-cd928da3f6a4 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f624258d-a96f-4fae-8393-ee1f62595be1 req-3afb3740-8e02-4b57-bcd2-cd928da3f6a4 service nova] Lock "cc072036-25dc-48a8-b430-5a2655fb473a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG nova.compute.manager [req-f624258d-a96f-4fae-8393-ee1f62595be1 req-3afb3740-8e02-4b57-bcd2-cd928da3f6a4 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] No waiting events found dispatching network-vif-plugged-14239fc2-af2c-4d50-9f58-9758fe0f1221 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:47:40 user nova-compute[74850]: WARNING nova.compute.manager [req-f624258d-a96f-4fae-8393-ee1f62595be1 req-3afb3740-8e02-4b57-bcd2-cd928da3f6a4 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received unexpected event network-vif-plugged-14239fc2-af2c-4d50-9f58-9758fe0f1221 for instance with vm_state active and task_state deleting.
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.057s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[05af6b18-47e6-402c-b028-15480a191145]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)
Nov 14 00:47:40 user nova-compute[74850]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)
Nov 14 00:47:40 user nova-compute[74850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:40 user nova-compute[74850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)
Nov 14 00:47:40 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:40 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)
Nov 14 00:47:40 user nova-compute[74850]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)
Nov 14 00:47:40 user nova-compute[74850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:40 user nova-compute[74850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)
Nov 14 00:47:40 user nova-compute[74850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 (non-flash)
Nov 14 00:47:40 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a3c734f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732'): ({'sdg'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Removing single pathed devices sdg {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d101ba-51ce-4a69-8e0d-4e3192b24bf0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.029s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca184bf-42c7-43f5-a15c-86df4adc0ee7]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Flushing IO for device /dev/sdg {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada389f4-1a3f-4161-b5d6-b48928c0797d]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.085s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bdd69a-1216-4941-9abe-652b600d8016]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] SCSI volumes sdg have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] COPY block job progress, current cursor: 953155584 final cursor: 1073741824 {{(pid=74850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b94a43-c883-45bd-98be-ab7295b16037]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df0abd3-0e6e-48f0-ad8f-6ed1727cb967]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732, portal: 172.16.0.220,3260]
Nov 14 00:47:41 user nova-compute[74850]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732, portal: 172.16.0.220,3260] successful.
Nov 14 00:47:41 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e372017c-0803-4c15-98aa-3a64b9277732 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[436bc4bb-b8e9-4cb1-8240-75199050366a]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.525s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] <== disconnect_volume: return (528ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 00:47:41 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Deleting instance files /opt/stack/data/nova/instances/cc072036-25dc-48a8-b430-5a2655fb473a_del
Nov 14 00:47:41 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Deletion of /opt/stack/data/nova/instances/cc072036-25dc-48a8-b430-5a2655fb473a_del complete
Nov 14 00:47:41 user nova-compute[74850]: INFO nova.compute.manager [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Took 5.59 seconds to destroy the instance on the hypervisor.
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] [instance: 937d7470-ec86-4972-b975-257d626329dd] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UrfPgXNy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl', 'volume_id': '2f63338a-4acf-4574-b01e-b1785897d706'}, None), 'kwargs': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:47:41 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:47:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5e8ecd-e1b7-498a-ba7a-c90e8d59763c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 00:47:41 user nova-compute[74850]: No targets found.
Nov 14 00:47:41 user nova-compute[74850]: iSNS:
Nov 14 00:47:41 user nova-compute[74850]: No targets found.
Nov 14 00:47:41 user nova-compute[74850]: STATIC:
Nov 14 00:47:41 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd
Nov 14 00:47:41 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:41 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:41 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706
Nov 14 00:47:41 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:41 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:41 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2
Nov 14 00:47:41 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:41 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:41 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a
Nov 14 00:47:41 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:41 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:41 user nova-compute[74850]: FIRMWARE:
Nov 14 00:47:41 user nova-compute[74850]: No targets found.
Nov 14 00:47:41 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 00:47:41 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 00:47:41 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f0bb78-879b-4b4c-9b4a-bb17cbee7ea0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2402700-551f-44eb-9424-e256450c9e98]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)
Nov 14 00:47:41 user nova-compute[74850]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)
Nov 14 00:47:41 user nova-compute[74850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:41 user nova-compute[74850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)
Nov 14 00:47:41 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 (non-flash)
Nov 14 00:47:41 user nova-compute[74850]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)
Nov 14 00:47:41 user nova-compute[74850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:41 user nova-compute[74850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)
Nov 14 00:47:41 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a5c251a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706'): ({'sdl'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Removing single pathed devices sdl {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fba7c7-7dc9-40d1-9c39-b318b55d1336]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[42109150-9fed-43d1-b45c-49447b603d20]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Flushing IO for device /dev/sdl {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a651c6-a62b-4c8d-9ac8-c4afe17c50d4]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.046s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c4a8ba-99e2-48d3-8149-18829728c241]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Checking to see if SCSI volumes sdl have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] SCSI volumes sdl have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f851d9-5b0e-4164-9448-cc7cc2230432]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29d47f3-39a4-4267-96a1-62b4a95df6df]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706, portal: 172.16.0.220,3260]
Nov 14 00:47:41 user nova-compute[74850]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706, portal: 172.16.0.220,3260] successful.
Nov 14 00:47:41 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f63338a-4acf-4574-b01e-b1785897d706 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[380a1aec-c138-4cc9-a0a9-72fd93c84d31]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] <== disconnect_volume: return (351ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] [instance: 937d7470-ec86-4972-b975-257d626329dd] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG nova.compute.manager [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EAeKbcZw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '937d7470-ec86-4972-b975-257d626329dd', 'attached_at': '', 'detached_at': '', 'volume_id': '2daa0a31-2ec1-4ea6-81b7-4756aa1defdd', 'serial'} {{(pid=74850) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 14 00:47:41 user nova-compute[74850]: DEBUG nova.compute.manager [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] [instance: 937d7470-ec86-4972-b975-257d626329dd] swap_volume: removing Cinder connection for volume 2f63338a-4acf-4574-b01e-b1785897d706 {{(pid=74850) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 14 00:47:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937d7470-ec86-4972-b975-257d626329dd/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937d7470-ec86-4972-b975-257d626329dd/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937d7470-ec86-4972-b975-257d626329dd/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937d7470-ec86-4972-b975-257d626329dd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:42 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:47:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28212eec-99be-4171-97ed-7748bbb75c88/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28212eec-99be-4171-97ed-7748bbb75c88/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28212eec-99be-4171-97ed-7748bbb75c88/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:42 user nova-compute[74850]: DEBUG nova.compute.manager [req-c5eaa9da-7f51-4fb5-9854-79b3d4599047 req-354f2443-981e-45ad-84a8-fa6ff7d4c5cb service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-deleted-091cb215-5fc9-4eb5-9aca-0751d5e41ea4 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:42 user nova-compute[74850]: INFO nova.compute.manager [req-c5eaa9da-7f51-4fb5-9854-79b3d4599047 req-354f2443-981e-45ad-84a8-fa6ff7d4c5cb service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Neutron deleted interface 091cb215-5fc9-4eb5-9aca-0751d5e41ea4; detaching it from the instance and deleting it from the info cache
Nov 14 00:47:42 user nova-compute[74850]: DEBUG nova.network.neutron [req-c5eaa9da-7f51-4fb5-9854-79b3d4599047 req-354f2443-981e-45ad-84a8-fa6ff7d4c5cb service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Updating instance_info_cache with network_info: [{"id": "04f4b3e3-634c-4285-b389-785cff1205ea", "address": "fa:16:3e:c0:42:3b", "network": {"id": "7b7555f1-01f5-4ec4-a537-8dba31d7bcc0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1180089476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f4b3e3-63", "ovs_interfaceid": "04f4b3e3-634c-4285-b389-785cff1205ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78e098ef-09f4-4007-9e14-ebff143a4ba1", "address": "fa:16:3e:92:05:67", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78e098ef-09", "ovs_interfaceid": "78e098ef-09f4-4007-9e14-ebff143a4ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0bbb73c1-6eda-416d-a9c8-6592c2abbea4", "address": "fa:16:3e:e8:f0:5f", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbb73c1-6e", "ovs_interfaceid": "0bbb73c1-6eda-416d-a9c8-6592c2abbea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ab41a728-624a-46a0-9fd6-0268c0b35f55", "address": "fa:16:3e:f1:76:22", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab41a728-62", "ovs_interfaceid": "ab41a728-624a-46a0-9fd6-0268c0b35f55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5fdd3936-9253-49a5-9f2d-6c2fdce456ea", "address": "fa:16:3e:e3:e9:a7", "network": {"id": "947450c5-5cd3-4c59-89ef-c5ac64194c29", "bridge": "br-int", "label": "tempest-device-tagging-net2-516735970", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdd3936-92", "ovs_interfaceid": "5fdd3936-9253-49a5-9f2d-6c2fdce456ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dff8eb7c-ea5d-459e-a836-440097829dfd", "address": "fa:16:3e:61:a0:19", "network": {"id": "947450c5-5cd3-4c59-89ef-c5ac64194c29", "bridge": "br-int", "label": "tempest-device-tagging-net2-516735970", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff8eb7c-ea", "ovs_interfaceid": "dff8eb7c-ea5d-459e-a836-440097829dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:47:42 user nova-compute[74850]: DEBUG nova.compute.manager [req-c5eaa9da-7f51-4fb5-9854-79b3d4599047 req-354f2443-981e-45ad-84a8-fa6ff7d4c5cb service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Detach interface failed, port_id=091cb215-5fc9-4eb5-9aca-0751d5e41ea4, reason: Instance 7b1dc486-c6b5-4518-8da5-6042c97cbe55 could not be found. {{(pid=74850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 00:47:42 user nova-compute[74850]: DEBUG nova.compute.manager [req-c5eaa9da-7f51-4fb5-9854-79b3d4599047 req-354f2443-981e-45ad-84a8-fa6ff7d4c5cb service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-deleted-dff8eb7c-ea5d-459e-a836-440097829dfd {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:42 user nova-compute[74850]: INFO nova.compute.manager [req-c5eaa9da-7f51-4fb5-9854-79b3d4599047 req-354f2443-981e-45ad-84a8-fa6ff7d4c5cb service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Neutron deleted interface dff8eb7c-ea5d-459e-a836-440097829dfd; detaching it from the instance and deleting it from the info cache
Nov 14 00:47:42 user nova-compute[74850]: DEBUG nova.network.neutron [req-c5eaa9da-7f51-4fb5-9854-79b3d4599047 req-354f2443-981e-45ad-84a8-fa6ff7d4c5cb service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Updating instance_info_cache with network_info: [{"id": "04f4b3e3-634c-4285-b389-785cff1205ea", "address": "fa:16:3e:c0:42:3b", "network": {"id": "7b7555f1-01f5-4ec4-a537-8dba31d7bcc0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1180089476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f4b3e3-63", "ovs_interfaceid": "04f4b3e3-634c-4285-b389-785cff1205ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78e098ef-09f4-4007-9e14-ebff143a4ba1", "address": "fa:16:3e:92:05:67", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78e098ef-09", "ovs_interfaceid": "78e098ef-09f4-4007-9e14-ebff143a4ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0bbb73c1-6eda-416d-a9c8-6592c2abbea4", "address": "fa:16:3e:e8:f0:5f", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbb73c1-6e", "ovs_interfaceid": "0bbb73c1-6eda-416d-a9c8-6592c2abbea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ab41a728-624a-46a0-9fd6-0268c0b35f55", "address": "fa:16:3e:f1:76:22", "network": {"id": "2ab0eed7-4ccb-4e11-9cd5-b43b636bafe6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1172560428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab41a728-62", "ovs_interfaceid": "ab41a728-624a-46a0-9fd6-0268c0b35f55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5fdd3936-9253-49a5-9f2d-6c2fdce456ea", "address": "fa:16:3e:e3:e9:a7", "network": {"id": "947450c5-5cd3-4c59-89ef-c5ac64194c29", "bridge": "br-int", "label": "tempest-device-tagging-net2-516735970", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2f380efb37074b3399411fafb1deaa00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdd3936-92", "ovs_interfaceid": "5fdd3936-9253-49a5-9f2d-6c2fdce456ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:47:43 user nova-compute[74850]: DEBUG nova.compute.manager [req-c5eaa9da-7f51-4fb5-9854-79b3d4599047 req-354f2443-981e-45ad-84a8-fa6ff7d4c5cb service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Detach interface failed, port_id=dff8eb7c-ea5d-459e-a836-440097829dfd, reason: Instance 7b1dc486-c6b5-4518-8da5-6042c97cbe55 could not be found. {{(pid=74850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 00:47:43 user nova-compute[74850]: DEBUG nova.compute.manager [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] [instance: 937d7470-ec86-4972-b975-257d626329dd] swap_volume: Updating volume 2f63338a-4acf-4574-b01e-b1785897d706 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "EAeKbcZw", "auth_password": "culaO7CAMZh4Rm", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdd", "volume_id": "2daa0a31-2ec1-4ea6-81b7-4756aa1defdd"}, "status": "reserved", "instance": "937d7470-ec86-4972-b975-257d626329dd", "attached_at": "", "detached_at": "", "volume_id": "2daa0a31-2ec1-4ea6-81b7-4756aa1defdd", "serial": "2daa0a31-2ec1-4ea6-81b7-4756aa1defdd"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '2daa0a31-2ec1-4ea6-81b7-4756aa1defdd', 'no_device': None, 'attachment_id': 'b015eea7-62a7-4512-8368-cec6e7fbf68f'} {{(pid=74850) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 14 00:47:43 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-23d26c38-4e6d-42be-a56a-6164fe0bab99 tempest-TestVolumeSwap-1413293253 tempest-TestVolumeSwap-1413293253-project-admin] Lock "937d7470-ec86-4972-b975-257d626329dd" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 14.387s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28212eec-99be-4171-97ed-7748bbb75c88/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:43 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:47:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:43 user nova-compute[74850]: DEBUG nova.compute.manager [req-f46ef892-049b-4060-b779-084a2c6ca113 req-840a06aa-cd8d-4742-86bf-6eb98decd099 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-deleted-9a03ed99-51c7-49e9-abbb-dc338dd795ff {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:43 user nova-compute[74850]: INFO nova.compute.manager [req-f46ef892-049b-4060-b779-084a2c6ca113 req-840a06aa-cd8d-4742-86bf-6eb98decd099 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Neutron deleted interface 9a03ed99-51c7-49e9-abbb-dc338dd795ff; detaching it from the instance and deleting it from the info cache
Nov 14 00:47:43 user nova-compute[74850]: DEBUG nova.network.neutron [req-f46ef892-049b-4060-b779-084a2c6ca113 req-840a06aa-cd8d-4742-86bf-6eb98decd099 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Updating instance_info_cache with network_info: [{"id": "3b861886-0054-400a-b163-35945d498927", "address": "fa:16:3e:19:40:aa", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b861886-00", "ovs_interfaceid": "3b861886-0054-400a-b163-35945d498927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "381f68d0-96e0-404e-93e6-d166732e2df8", "address": "fa:16:3e:41:e5:08", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap381f68d0-96", "ovs_interfaceid": "381f68d0-96e0-404e-93e6-d166732e2df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "447494fb-fc40-41f9-94d9-d1c39434a22d", "address": "fa:16:3e:87:3d:45", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap447494fb-fc", "ovs_interfaceid": "447494fb-fc40-41f9-94d9-d1c39434a22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "70f458ad-d5db-47a5-9ab1-b776a8fdbb98", "address": "fa:16:3e:96:01:0a", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f458ad-d5", "ovs_interfaceid": "70f458ad-d5db-47a5-9ab1-b776a8fdbb98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "457e3066-b6bf-4d67-9c40-d1437ef901a3", "address": "fa:16:3e:dd:36:d4", "network": {"id": "b5892a30-40d5-4832-bb6b-b8a7f20106b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-725774050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457e3066-b6", "ovs_interfaceid": "457e3066-b6bf-4d67-9c40-d1437ef901a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14239fc2-af2c-4d50-9f58-9758fe0f1221", "address": "fa:16:3e:66:d7:47", "network": {"id": "b5892a30-40d5-4832-bb6b-b8a7f20106b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-725774050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14239fc2-af", "ovs_interfaceid": "14239fc2-af2c-4d50-9f58-9758fe0f1221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:47:43 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:47:43 user nova-compute[74850]: DEBUG nova.compute.manager [req-f46ef892-049b-4060-b779-084a2c6ca113 req-840a06aa-cd8d-4742-86bf-6eb98decd099 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Detach interface failed, port_id=9a03ed99-51c7-49e9-abbb-dc338dd795ff, reason: Instance cc072036-25dc-48a8-b430-5a2655fb473a could not be found. {{(pid=74850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 00:47:43 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Took 5.36 seconds to deallocate network for instance.
Nov 14 00:47:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faeb3377-d199-472b-9ee2-f504d5ac9ac4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faeb3377-d199-472b-9ee2-f504d5ac9ac4/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faeb3377-d199-472b-9ee2-f504d5ac9ac4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faeb3377-d199-472b-9ee2-f504d5ac9ac4/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-43b33599-0302-407a-8a33-3e4d9f80d3e3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Acquiring lock "937d7470-ec86-4972-b975-257d626329dd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-43b33599-0302-407a-8a33-3e4d9f80d3e3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Lock "937d7470-ec86-4972-b975-257d626329dd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:44 user nova-compute[74850]: INFO nova.compute.manager [None req-43b33599-0302-407a-8a33-3e4d9f80d3e3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Detaching volume 2daa0a31-2ec1-4ea6-81b7-4756aa1defdd
Nov 14 00:47:44 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-864ddbd4-f526-40e3-97d9-cc13cc148563 tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance faeb3377-d199-472b-9ee2-f504d5ac9ac4 is timed out.
Nov 14 00:47:44 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-864ddbd4-f526-40e3-97d9-cc13cc148563 tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Successfully detached device vdb from instance faeb3377-d199-472b-9ee2-f504d5ac9ac4 from the live domain config.
Nov 14 00:47:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-864ddbd4-f526-40e3-97d9-cc13cc148563 tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 00:47:44 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-864ddbd4-f526-40e3-97d9-cc13cc148563 tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mfruNOxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdm'}, None), 'kwargs': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:47:44 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-864ddbd4-f526-40e3-97d9-cc13cc148563 tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:47:44 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-864ddbd4-f526-40e3-97d9-cc13cc148563 tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:47:44 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-864ddbd4-f526-40e3-97d9-cc13cc148563 tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:47:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:44 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df7abdf-9f31-4ff5-a03d-6a9acc56a109]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:44 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-864ddbd4-f526-40e3-97d9-cc13cc148563 tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 00:47:44 user nova-compute[74850]: No targets found.
Nov 14 00:47:44 user nova-compute[74850]: iSNS:
Nov 14 00:47:44 user nova-compute[74850]: No targets found.
Nov 14 00:47:44 user nova-compute[74850]: STATIC:
Nov 14 00:47:44 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd
Nov 14 00:47:44 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:44 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:44 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2
Nov 14 00:47:44 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:44 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:44 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a
Nov 14 00:47:44 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:47:44 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:47:44 user nova-compute[74850]: FIRMWARE:
Nov 14 00:47:44 user nova-compute[74850]: No targets found.
Nov 14 00:47:44 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:44 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-864ddbd4-f526-40e3-97d9-cc13cc148563 tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 00:47:44 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 00:47:44 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 00:47:44 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-864ddbd4-f526-40e3-97d9-cc13cc148563 tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 00:47:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:44 user nova-compute[74850]: INFO nova.virt.block_device [None req-43b33599-0302-407a-8a33-3e4d9f80d3e3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Attempting to driver detach volume 2daa0a31-2ec1-4ea6-81b7-4756aa1defdd from mountpoint /dev/vdb
Nov 14 00:47:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:44 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9610f911-40be-46fa-970b-35b3a94a4a1f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a145c7e-9a5f-4bfb-8151-6ff8a43341f7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-864ddbd4-f526-40e3-97d9-cc13cc148563 tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)
Nov 14 00:47:45 user nova-compute[74850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:45 user nova-compute[74850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)
Nov 14 00:47:45 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-864ddbd4-f526-40e3-97d9-cc13cc148563 tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 (non-flash)
Nov 14 00:47:45 user nova-compute[74850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:47:45 user nova-compute[74850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)
Nov 14 00:47:45 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-864ddbd4-f526-40e3-97d9-cc13cc148563 tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a3c735d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2'): ({'sdm'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-864ddbd4-f526-40e3-97d9-cc13cc148563 tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Removing single pathed devices sdm {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG nova.compute.manager [req-9f752fea-7858-4f55-8a50-ba6b05612c90 req-63a9d803-a4ac-4b83-8684-36748947dd54 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-deleted-04f4b3e3-634c-4285-b389-785cff1205ea {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG nova.compute.manager [req-9f752fea-7858-4f55-8a50-ba6b05612c90 req-63a9d803-a4ac-4b83-8684-36748947dd54 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-deleted-5fdd3936-9253-49a5-9f2d-6c2fdce456ea {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG nova.compute.manager [req-9f752fea-7858-4f55-8a50-ba6b05612c90 req-63a9d803-a4ac-4b83-8684-36748947dd54 service nova] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Received event network-vif-deleted-ab41a728-624a-46a0-9fd6-0268c0b35f55 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-43b33599-0302-407a-8a33-3e4d9f80d3e3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Attempting to detach device vdb from instance 937d7470-ec86-4972-b975-257d626329dd from the persistent domain config. {{(pid=74850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-43b33599-0302-407a-8a33-3e4d9f80d3e3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 00:47:45 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:47:45 user nova-compute[74850]:   <source dev="/dev/sdd"/>
Nov 14 00:47:45 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:47:45 user nova-compute[74850]:   <serial>2daa0a31-2ec1-4ea6-81b7-4756aa1defdd</serial>
Nov 14 00:47:45 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 00:47:45 user nova-compute[74850]: </disk>
Nov 14 00:47:45 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:45 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-43b33599-0302-407a-8a33-3e4d9f80d3e3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Successfully detached device vdb from instance 937d7470-ec86-4972-b975-257d626329dd from the persistent domain config.
Nov 14 00:47:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-43b33599-0302-407a-8a33-3e4d9f80d3e3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 937d7470-ec86-4972-b975-257d626329dd from the live domain config. {{(pid=74850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-43b33599-0302-407a-8a33-3e4d9f80d3e3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 00:47:45 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:47:45 user nova-compute[74850]:   <source dev="/dev/sdd"/>
Nov 14 00:47:45 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:47:45 user nova-compute[74850]:   <serial>2daa0a31-2ec1-4ea6-81b7-4756aa1defdd</serial>
Nov 14 00:47:45 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 00:47:45 user nova-compute[74850]: </disk>
Nov 14 00:47:45 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 00:47:45 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:47:45 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:47:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=8027MB free_disk=25.52515411376953GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f132171-fd68-429a-b825-60f898eda6c0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdm {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdm" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[562921ec-398e-4d66-a1b7-ce559a5f2602]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-864ddbd4-f526-40e3-97d9-cc13cc148563 tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Flushing IO for device /dev/sdm {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdm {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdm" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7a91b9-ebbd-4720-b7e9-8dcbc61c0f32]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-864ddbd4-f526-40e3-97d9-cc13cc148563 tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdm/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdm/device/delete" returned: 0 in 0.050s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a2dea8-34c0-4d0d-bed1-7d6158443b4d]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-864ddbd4-f526-40e3-97d9-cc13cc148563 tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Checking to see if SCSI volumes sdm have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-864ddbd4-f526-40e3-97d9-cc13cc148563 tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] SCSI volumes sdm have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-864ddbd4-f526-40e3-97d9-cc13cc148563 tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance a70d0196-f90e-47c4-be67-bf7ef4c3d8c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 1879be4c-9226-4c8c-a56c-f8e37398851b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 28212eec-99be-4171-97ed-7748bbb75c88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 937d7470-ec86-4972-b975-257d626329dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance b54b37bc-8c90-4c48-a943-e489e830b93b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance faeb3377-d199-472b-9ee2-f504d5ac9ac4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 7b1dc486-c6b5-4518-8da5-6042c97cbe55 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance cc072036-25dc-48a8-b430-5a2655fb473a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[db238b12-a771-4980-ba85-41aa9875a35b]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-864ddbd4-f526-40e3-97d9-cc13cc148563 tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b2d0a1-9a59-43a8-bbc4-feb578750c98]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-864ddbd4-f526-40e3-97d9-cc13cc148563 tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2, portal: 172.16.0.220,3260]
Nov 14 00:47:45 user nova-compute[74850]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2, portal: 172.16.0.220,3260] successful.
Nov 14 00:47:45 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b3c8867-75a4-4117-8b2f-9e9491d4bfa2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f623226e-0896-42c1-8517-32c0394b9ce2]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-864ddbd4-f526-40e3-97d9-cc13cc148563 tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-864ddbd4-f526-40e3-97d9-cc13cc148563 tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.896s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-864ddbd4-f526-40e3-97d9-cc13cc148563 tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] <== disconnect_volume: return (899ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-864ddbd4-f526-40e3-97d9-cc13cc148563 tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-43b33599-0302-407a-8a33-3e4d9f80d3e3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 937d7470-ec86-4972-b975-257d626329dd {{(pid=74850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG nova.compute.manager [req-b3b6bfa1-397b-4760-a926-9b18ceb0b944 req-2f32a2ef-3955-4d2d-942b-1ed4eed535e9 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-deleted-70f458ad-d5db-47a5-9ab1-b776a8fdbb98 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:45 user nova-compute[74850]: INFO nova.compute.manager [req-b3b6bfa1-397b-4760-a926-9b18ceb0b944 req-2f32a2ef-3955-4d2d-942b-1ed4eed535e9 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Neutron deleted interface 70f458ad-d5db-47a5-9ab1-b776a8fdbb98; detaching it from the instance and deleting it from the info cache
Nov 14 00:47:45 user nova-compute[74850]: DEBUG nova.network.neutron [req-b3b6bfa1-397b-4760-a926-9b18ceb0b944 req-2f32a2ef-3955-4d2d-942b-1ed4eed535e9 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Updating instance_info_cache with network_info: [{"id": "3b861886-0054-400a-b163-35945d498927", "address": "fa:16:3e:19:40:aa", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b861886-00", "ovs_interfaceid": "3b861886-0054-400a-b163-35945d498927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "381f68d0-96e0-404e-93e6-d166732e2df8", "address": "fa:16:3e:41:e5:08", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap381f68d0-96", "ovs_interfaceid": "381f68d0-96e0-404e-93e6-d166732e2df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "447494fb-fc40-41f9-94d9-d1c39434a22d", "address": "fa:16:3e:87:3d:45", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap447494fb-fc", "ovs_interfaceid": "447494fb-fc40-41f9-94d9-d1c39434a22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "457e3066-b6bf-4d67-9c40-d1437ef901a3", "address": "fa:16:3e:dd:36:d4", "network": {"id": "b5892a30-40d5-4832-bb6b-b8a7f20106b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-725774050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457e3066-b6", "ovs_interfaceid": "457e3066-b6bf-4d67-9c40-d1437ef901a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14239fc2-af2c-4d50-9f58-9758fe0f1221", "address": "fa:16:3e:66:d7:47", "network": {"id": "b5892a30-40d5-4832-bb6b-b8a7f20106b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-725774050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14239fc2-af", "ovs_interfaceid": "14239fc2-af2c-4d50-9f58-9758fe0f1221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG nova.compute.manager [req-b3b6bfa1-397b-4760-a926-9b18ceb0b944 req-2f32a2ef-3955-4d2d-942b-1ed4eed535e9 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Detach interface failed, port_id=70f458ad-d5db-47a5-9ab1-b776a8fdbb98, reason: Instance cc072036-25dc-48a8-b430-5a2655fb473a could not be found. {{(pid=74850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 00:47:45 user nova-compute[74850]: DEBUG nova.compute.manager [req-b3b6bfa1-397b-4760-a926-9b18ceb0b944 req-2f32a2ef-3955-4d2d-942b-1ed4eed535e9 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-deleted-14239fc2-af2c-4d50-9f58-9758fe0f1221 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:45 user nova-compute[74850]: INFO nova.compute.manager [req-b3b6bfa1-397b-4760-a926-9b18ceb0b944 req-2f32a2ef-3955-4d2d-942b-1ed4eed535e9 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Neutron deleted interface 14239fc2-af2c-4d50-9f58-9758fe0f1221; detaching it from the instance and deleting it from the info cache
Nov 14 00:47:45 user nova-compute[74850]: DEBUG nova.network.neutron [req-b3b6bfa1-397b-4760-a926-9b18ceb0b944 req-2f32a2ef-3955-4d2d-942b-1ed4eed535e9 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Updating instance_info_cache with network_info: [{"id": "3b861886-0054-400a-b163-35945d498927", "address": "fa:16:3e:19:40:aa", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b861886-00", "ovs_interfaceid": "3b861886-0054-400a-b163-35945d498927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "381f68d0-96e0-404e-93e6-d166732e2df8", "address": "fa:16:3e:41:e5:08", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap381f68d0-96", "ovs_interfaceid": "381f68d0-96e0-404e-93e6-d166732e2df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "447494fb-fc40-41f9-94d9-d1c39434a22d", "address": "fa:16:3e:87:3d:45", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap447494fb-fc", "ovs_interfaceid": "447494fb-fc40-41f9-94d9-d1c39434a22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "457e3066-b6bf-4d67-9c40-d1437ef901a3", "address": "fa:16:3e:dd:36:d4", "network": {"id": "b5892a30-40d5-4832-bb6b-b8a7f20106b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-725774050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457e3066-b6", "ovs_interfaceid": "457e3066-b6bf-4d67-9c40-d1437ef901a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:47:46 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:47:46 user nova-compute[74850]: DEBUG nova.compute.manager [req-b3b6bfa1-397b-4760-a926-9b18ceb0b944 req-2f32a2ef-3955-4d2d-942b-1ed4eed535e9 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Detach interface failed, port_id=14239fc2-af2c-4d50-9f58-9758fe0f1221, reason: Instance cc072036-25dc-48a8-b430-5a2655fb473a could not be found. {{(pid=74850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 00:47:46 user nova-compute[74850]: DEBUG nova.compute.manager [req-b3b6bfa1-397b-4760-a926-9b18ceb0b944 req-2f32a2ef-3955-4d2d-942b-1ed4eed535e9 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-deleted-457e3066-b6bf-4d67-9c40-d1437ef901a3 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:46 user nova-compute[74850]: INFO nova.compute.manager [req-b3b6bfa1-397b-4760-a926-9b18ceb0b944 req-2f32a2ef-3955-4d2d-942b-1ed4eed535e9 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Neutron deleted interface 457e3066-b6bf-4d67-9c40-d1437ef901a3; detaching it from the instance and deleting it from the info cache
Nov 14 00:47:46 user nova-compute[74850]: DEBUG nova.network.neutron [req-b3b6bfa1-397b-4760-a926-9b18ceb0b944 req-2f32a2ef-3955-4d2d-942b-1ed4eed535e9 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Updating instance_info_cache with network_info: [{"id": "3b861886-0054-400a-b163-35945d498927", "address": "fa:16:3e:19:40:aa", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b861886-00", "ovs_interfaceid": "3b861886-0054-400a-b163-35945d498927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "381f68d0-96e0-404e-93e6-d166732e2df8", "address": "fa:16:3e:41:e5:08", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap381f68d0-96", "ovs_interfaceid": "381f68d0-96e0-404e-93e6-d166732e2df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "447494fb-fc40-41f9-94d9-d1c39434a22d", "address": "fa:16:3e:87:3d:45", "network": {"id": "6638fd71-589d-4917-8925-96a0fd255c36", "bridge": "br-int", "label": "tempest-device-tagging-net1-613047487", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c11a9473df4d4f11ac696ce90dfe7dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap447494fb-fc", "ovs_interfaceid": "447494fb-fc40-41f9-94d9-d1c39434a22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:47:46 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:47:46 user nova-compute[74850]: DEBUG nova.compute.manager [req-b3b6bfa1-397b-4760-a926-9b18ceb0b944 req-2f32a2ef-3955-4d2d-942b-1ed4eed535e9 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Detach interface failed, port_id=457e3066-b6bf-4d67-9c40-d1437ef901a3, reason: Instance cc072036-25dc-48a8-b430-5a2655fb473a could not be found. {{(pid=74850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 00:47:46 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 00:47:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.642s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:46 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:47:46 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Took 4.98 seconds to deallocate network for instance.
Nov 14 00:47:46 user nova-compute[74850]: INFO nova.compute.manager [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] [instance: 7b1dc486-c6b5-4518-8da5-6042c97cbe55] Took 2.66 seconds to detach 3 volumes for instance.
Nov 14 00:47:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:46 user nova-compute[74850]: DEBUG nova.objects.instance [None req-864ddbd4-f526-40e3-97d9-cc13cc148563 tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Lazy-loading 'flavor' on Instance uuid faeb3377-d199-472b-9ee2-f504d5ac9ac4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:47:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-864ddbd4-f526-40e3-97d9-cc13cc148563 tempest-VolumesAssistedSnapshotsTest-2083588322 tempest-VolumesAssistedSnapshotsTest-2083588322-project-admin] Lock "faeb3377-d199-472b-9ee2-f504d5ac9ac4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.553s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:46 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:47:46 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:47:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:46 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Deleted allocations for instance 7b1dc486-c6b5-4518-8da5-6042c97cbe55
Nov 14 00:47:47 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:47:47 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:47:47 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 00:47:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-0d01d56c-8725-498e-8099-b0b9be1bce10 tempest-TaggedBootDevicesTest-1105688157 tempest-TaggedBootDevicesTest-1105688157-project-member] Lock "7b1dc486-c6b5-4518-8da5-6042c97cbe55" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 16.048s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "refresh_cache-28212eec-99be-4171-97ed-7748bbb75c88" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:47:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquired lock "refresh_cache-28212eec-99be-4171-97ed-7748bbb75c88" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:47:47 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Forcefully refreshing network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 00:47:47 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Updating instance_info_cache with network_info: [{"id": "9df19d5e-989a-48d6-97ce-03b6a897a611", "address": "fa:16:3e:0f:98:91", "network": {"id": "25547f45-3d27-4a3f-b2d2-6f0a0b4ae730", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-464974831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51c848440ceb46dabf1eb8cca6533f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df19d5e-98", "ovs_interfaceid": "9df19d5e-989a-48d6-97ce-03b6a897a611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:47:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Releasing lock "refresh_cache-28212eec-99be-4171-97ed-7748bbb75c88" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:47:47 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Updated the network info_cache for instance {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 00:47:47 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:47:47 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:47:47 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:47:47 user nova-compute[74850]: DEBUG nova.compute.manager [req-4abe4975-db65-43ea-93d5-e895873b6be8 req-8cc28a43-6bd8-4719-b04a-4d3799873798 service nova] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Received event network-vif-deleted-447494fb-fc40-41f9-94d9-d1c39434a22d {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:48 user nova-compute[74850]: INFO nova.compute.manager [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] [instance: cc072036-25dc-48a8-b430-5a2655fb473a] Took 2.74 seconds to detach 3 volumes for instance.
Nov 14 00:47:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:49 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:47:49 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:47:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.274s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:49 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Deleted allocations for instance cc072036-25dc-48a8-b430-5a2655fb473a
Nov 14 00:47:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bf591ddf-cdc3-4f9f-82ca-add561fb69b6 tempest-TaggedBootDevicesTest_v242-132442839 tempest-TaggedBootDevicesTest_v242-132442839-project-member] Lock "cc072036-25dc-48a8-b430-5a2655fb473a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.774s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Acquiring lock "71af2810-c388-44ad-8bbe-a3052d381e95" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Lock "71af2810-c388-44ad-8bbe-a3052d381e95" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:50 user nova-compute[74850]: DEBUG nova.compute.manager [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 00:47:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:50 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 00:47:50 user nova-compute[74850]: INFO nova.compute.claims [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Claim successful on node user
Nov 14 00:47:51 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:47:51 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:47:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.414s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:51 user nova-compute[74850]: DEBUG nova.compute.manager [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 00:47:51 user nova-compute[74850]: DEBUG nova.compute.manager [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 00:47:51 user nova-compute[74850]: DEBUG nova.network.neutron [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 00:47:51 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 00:47:51 user nova-compute[74850]: DEBUG nova.compute.manager [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 00:47:51 user nova-compute[74850]: DEBUG nova.policy [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '895d12a3660d43ffbdbc8cd4d5e1b989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cae3e5d11c40f0b499837464422c86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 00:47:51 user nova-compute[74850]: DEBUG nova.compute.manager [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 00:47:51 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 00:47:51 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Creating image(s)
Nov 14 00:47:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Acquiring lock "/opt/stack/data/nova/instances/71af2810-c388-44ad-8bbe-a3052d381e95/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Lock "/opt/stack/data/nova/instances/71af2810-c388-44ad-8bbe-a3052d381e95/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Lock "/opt/stack/data/nova/instances/71af2810-c388-44ad-8bbe-a3052d381e95/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.184s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.184s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/71af2810-c388-44ad-8bbe-a3052d381e95/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/71af2810-c388-44ad-8bbe-a3052d381e95/disk 1073741824" returned: 0 in 0.054s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.178s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:51 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Checking if we can resize image /opt/stack/data/nova/instances/71af2810-c388-44ad-8bbe-a3052d381e95/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 00:47:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71af2810-c388-44ad-8bbe-a3052d381e95/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:47:52 user nova-compute[74850]: DEBUG nova.network.neutron [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Successfully created port: 81e07ee5-cd42-468b-b815-d7a1ce8dcfb9 {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:47:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71af2810-c388-44ad-8bbe-a3052d381e95/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:47:52 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Cannot resize image /opt/stack/data/nova/instances/71af2810-c388-44ad-8bbe-a3052d381e95/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 00:47:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 00:47:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Ensure instance console log exists: /opt/stack/data/nova/instances/71af2810-c388-44ad-8bbe-a3052d381e95/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 00:47:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:52 user nova-compute[74850]: DEBUG nova.network.neutron [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Successfully updated port: 81e07ee5-cd42-468b-b815-d7a1ce8dcfb9 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:47:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Acquiring lock "refresh_cache-71af2810-c388-44ad-8bbe-a3052d381e95" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:47:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Acquired lock "refresh_cache-71af2810-c388-44ad-8bbe-a3052d381e95" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:47:52 user nova-compute[74850]: DEBUG nova.network.neutron [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:47:52 user nova-compute[74850]: DEBUG nova.compute.manager [req-a1587d8f-98c4-44cc-bdbd-105568d65811 req-a2d32660-ea03-4e2f-b3f4-bce97665b34c service nova] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Received event network-changed-81e07ee5-cd42-468b-b815-d7a1ce8dcfb9 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:52 user nova-compute[74850]: DEBUG nova.compute.manager [req-a1587d8f-98c4-44cc-bdbd-105568d65811 req-a2d32660-ea03-4e2f-b3f4-bce97665b34c service nova] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Refreshing instance network info cache due to event network-changed-81e07ee5-cd42-468b-b815-d7a1ce8dcfb9. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:47:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a1587d8f-98c4-44cc-bdbd-105568d65811 req-a2d32660-ea03-4e2f-b3f4-bce97665b34c service nova] Acquiring lock "refresh_cache-71af2810-c388-44ad-8bbe-a3052d381e95" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:47:52 user nova-compute[74850]: DEBUG nova.network.neutron [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG nova.network.neutron [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Updating instance_info_cache with network_info: [{"id": "81e07ee5-cd42-468b-b815-d7a1ce8dcfb9", "address": "fa:16:3e:63:70:44", "network": {"id": "a510ed73-2a44-4945-9e3c-685351d93486", "bridge": "br-int", "label": "tempest-VolumesActionsTest-957592581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8cae3e5d11c40f0b499837464422c86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e07ee5-cd", "ovs_interfaceid": "81e07ee5-cd42-468b-b815-d7a1ce8dcfb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Releasing lock "refresh_cache-71af2810-c388-44ad-8bbe-a3052d381e95" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG nova.compute.manager [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Instance network_info: |[{"id": "81e07ee5-cd42-468b-b815-d7a1ce8dcfb9", "address": "fa:16:3e:63:70:44", "network": {"id": "a510ed73-2a44-4945-9e3c-685351d93486", "bridge": "br-int", "label": "tempest-VolumesActionsTest-957592581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8cae3e5d11c40f0b499837464422c86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e07ee5-cd", "ovs_interfaceid": "81e07ee5-cd42-468b-b815-d7a1ce8dcfb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a1587d8f-98c4-44cc-bdbd-105568d65811 req-a2d32660-ea03-4e2f-b3f4-bce97665b34c service nova] Acquired lock "refresh_cache-71af2810-c388-44ad-8bbe-a3052d381e95" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG nova.network.neutron [req-a1587d8f-98c4-44cc-bdbd-105568d65811 req-a2d32660-ea03-4e2f-b3f4-bce97665b34c service nova] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Refreshing network info cache for port 81e07ee5-cd42-468b-b815-d7a1ce8dcfb9 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Start _get_guest_xml network_info=[{"id": "81e07ee5-cd42-468b-b815-d7a1ce8dcfb9", "address": "fa:16:3e:63:70:44", "network": {"id": "a510ed73-2a44-4945-9e3c-685351d93486", "bridge": "br-int", "label": "tempest-VolumesActionsTest-957592581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8cae3e5d11c40f0b499837464422c86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e07ee5-cd", "ovs_interfaceid": "81e07ee5-cd42-468b-b815-d7a1ce8dcfb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:47:53 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:47:53 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:47:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:47:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-348664367',display_name='tempest-VolumesActionsTest-instance-348664367',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-348664367',id=13,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8cae3e5d11c40f0b499837464422c86',ramdisk_id='',reservation_id='r-7m40q6ru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-810325091',owner_user_name='tempest-VolumesActionsTest-810325091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:47:51Z,user_data=None,user_id='895d12a3660d43ffbdbc8cd4d5e1b989',uuid=71af2810-c388-44ad-8bbe-a3052d381e95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81e07ee5-cd42-468b-b815-d7a1ce8dcfb9", "address": "fa:16:3e:63:70:44", "network": {"id": "a510ed73-2a44-4945-9e3c-685351d93486", "bridge": "br-int", "label": "tempest-VolumesActionsTest-957592581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8cae3e5d11c40f0b499837464422c86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e07ee5-cd", "ovs_interfaceid": "81e07ee5-cd42-468b-b815-d7a1ce8dcfb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Converting VIF {"id": "81e07ee5-cd42-468b-b815-d7a1ce8dcfb9", "address": "fa:16:3e:63:70:44", "network": {"id": "a510ed73-2a44-4945-9e3c-685351d93486", "bridge": "br-int", "label": "tempest-VolumesActionsTest-957592581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8cae3e5d11c40f0b499837464422c86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e07ee5-cd", "ovs_interfaceid": "81e07ee5-cd42-468b-b815-d7a1ce8dcfb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:70:44,bridge_name='br-int',has_traffic_filtering=True,id=81e07ee5-cd42-468b-b815-d7a1ce8dcfb9,network=Network(a510ed73-2a44-4945-9e3c-685351d93486),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81e07ee5-cd') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG nova.objects.instance [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Lazy-loading 'pci_devices' on Instance uuid 71af2810-c388-44ad-8bbe-a3052d381e95 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:47:53 user nova-compute[74850]:   <uuid>71af2810-c388-44ad-8bbe-a3052d381e95</uuid>
Nov 14 00:47:53 user nova-compute[74850]:   <name>instance-0000000d</name>
Nov 14 00:47:53 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:47:53 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:47:53 user nova-compute[74850]:   <metadata>
Nov 14 00:47:53 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:47:53 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:47:53 user nova-compute[74850]:       <nova:name>tempest-VolumesActionsTest-instance-348664367</nova:name>
Nov 14 00:47:53 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:47:53</nova:creationTime>
Nov 14 00:47:53 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:47:53 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:47:53 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:47:53 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:47:53 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:47:53 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:47:53 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:47:53 user nova-compute[74850]:       <nova:owner>
Nov 14 00:47:53 user nova-compute[74850]:         <nova:user uuid="895d12a3660d43ffbdbc8cd4d5e1b989">tempest-VolumesActionsTest-810325091-project-member</nova:user>
Nov 14 00:47:53 user nova-compute[74850]:         <nova:project uuid="d8cae3e5d11c40f0b499837464422c86">tempest-VolumesActionsTest-810325091</nova:project>
Nov 14 00:47:53 user nova-compute[74850]:       </nova:owner>
Nov 14 00:47:53 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:47:53 user nova-compute[74850]:       <nova:ports>
Nov 14 00:47:53 user nova-compute[74850]:         <nova:port uuid="81e07ee5-cd42-468b-b815-d7a1ce8dcfb9">
Nov 14 00:47:53 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 00:47:53 user nova-compute[74850]:         </nova:port>
Nov 14 00:47:53 user nova-compute[74850]:       </nova:ports>
Nov 14 00:47:53 user nova-compute[74850]:     </nova:instance>
Nov 14 00:47:53 user nova-compute[74850]:   </metadata>
Nov 14 00:47:53 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:47:53 user nova-compute[74850]:     <system>
Nov 14 00:47:53 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:47:53 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:47:53 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:47:53 user nova-compute[74850]:       <entry name="serial">71af2810-c388-44ad-8bbe-a3052d381e95</entry>
Nov 14 00:47:53 user nova-compute[74850]:       <entry name="uuid">71af2810-c388-44ad-8bbe-a3052d381e95</entry>
Nov 14 00:47:53 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:47:53 user nova-compute[74850]:     </system>
Nov 14 00:47:53 user nova-compute[74850]:   </sysinfo>
Nov 14 00:47:53 user nova-compute[74850]:   <os>
Nov 14 00:47:53 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:47:53 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 00:47:53 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:47:53 user nova-compute[74850]:   </os>
Nov 14 00:47:53 user nova-compute[74850]:   <features>
Nov 14 00:47:53 user nova-compute[74850]:     <acpi/>
Nov 14 00:47:53 user nova-compute[74850]:     <apic/>
Nov 14 00:47:53 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:47:53 user nova-compute[74850]:   </features>
Nov 14 00:47:53 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:47:53 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:47:53 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:47:53 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:47:53 user nova-compute[74850]:   </clock>
Nov 14 00:47:53 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:47:53 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:47:53 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:47:53 user nova-compute[74850]:   </cpu>
Nov 14 00:47:53 user nova-compute[74850]:   <devices>
Nov 14 00:47:53 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 00:47:53 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:47:53 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/71af2810-c388-44ad-8bbe-a3052d381e95/disk"/>
Nov 14 00:47:53 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:47:53 user nova-compute[74850]:     </disk>
Nov 14 00:47:53 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:47:53 user nova-compute[74850]:       <mac address="fa:16:3e:63:70:44"/>
Nov 14 00:47:53 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:47:53 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:47:53 user nova-compute[74850]:       <target dev="tap81e07ee5-cd"/>
Nov 14 00:47:53 user nova-compute[74850]:     </interface>
Nov 14 00:47:53 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:47:53 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/71af2810-c388-44ad-8bbe-a3052d381e95/console.log" append="off"/>
Nov 14 00:47:53 user nova-compute[74850]:     </serial>
Nov 14 00:47:53 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:47:53 user nova-compute[74850]:     <video>
Nov 14 00:47:53 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:47:53 user nova-compute[74850]:     </video>
Nov 14 00:47:53 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:47:53 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:47:53 user nova-compute[74850]:     </rng>
Nov 14 00:47:53 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:47:53 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:47:53 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:47:53 user nova-compute[74850]:     </memballoon>
Nov 14 00:47:53 user nova-compute[74850]:   </devices>
Nov 14 00:47:53 user nova-compute[74850]: </domain>
Nov 14 00:47:53 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:47:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-348664367',display_name='tempest-VolumesActionsTest-instance-348664367',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-348664367',id=13,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8cae3e5d11c40f0b499837464422c86',ramdisk_id='',reservation_id='r-7m40q6ru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-810325091',owner_user_name='tempest-VolumesActionsTest-810325091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:47:51Z,user_data=None,user_id='895d12a3660d43ffbdbc8cd4d5e1b989',uuid=71af2810-c388-44ad-8bbe-a3052d381e95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81e07ee5-cd42-468b-b815-d7a1ce8dcfb9", "address": "fa:16:3e:63:70:44", "network": {"id": "a510ed73-2a44-4945-9e3c-685351d93486", "bridge": "br-int", "label": "tempest-VolumesActionsTest-957592581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8cae3e5d11c40f0b499837464422c86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e07ee5-cd", "ovs_interfaceid": "81e07ee5-cd42-468b-b815-d7a1ce8dcfb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Converting VIF {"id": "81e07ee5-cd42-468b-b815-d7a1ce8dcfb9", "address": "fa:16:3e:63:70:44", "network": {"id": "a510ed73-2a44-4945-9e3c-685351d93486", "bridge": "br-int", "label": "tempest-VolumesActionsTest-957592581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8cae3e5d11c40f0b499837464422c86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e07ee5-cd", "ovs_interfaceid": "81e07ee5-cd42-468b-b815-d7a1ce8dcfb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:70:44,bridge_name='br-int',has_traffic_filtering=True,id=81e07ee5-cd42-468b-b815-d7a1ce8dcfb9,network=Network(a510ed73-2a44-4945-9e3c-685351d93486),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81e07ee5-cd') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG os_vif [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:70:44,bridge_name='br-int',has_traffic_filtering=True,id=81e07ee5-cd42-468b-b815-d7a1ce8dcfb9,network=Network(a510ed73-2a44-4945-9e3c-685351d93486),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81e07ee5-cd') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '73318807-94af-5998-96f9-ce5ff3ea4da1', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81e07ee5-cd, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap81e07ee5-cd, col_values=(('qos', UUID('4da768d1-5d53-48c2-aa28-5af489c1a92d')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap81e07ee5-cd, col_values=(('external_ids', {'iface-id': '81e07ee5-cd42-468b-b815-d7a1ce8dcfb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:70:44', 'vm-uuid': '71af2810-c388-44ad-8bbe-a3052d381e95'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:53 user nova-compute[74850]: INFO os_vif [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:70:44,bridge_name='br-int',has_traffic_filtering=True,id=81e07ee5-cd42-468b-b815-d7a1ce8dcfb9,network=Network(a510ed73-2a44-4945-9e3c-685351d93486),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81e07ee5-cd')
Nov 14 00:47:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] No VIF found with MAC fa:16:3e:63:70:44, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG nova.network.neutron [req-a1587d8f-98c4-44cc-bdbd-105568d65811 req-a2d32660-ea03-4e2f-b3f4-bce97665b34c service nova] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Updated VIF entry in instance network info cache for port 81e07ee5-cd42-468b-b815-d7a1ce8dcfb9. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG nova.network.neutron [req-a1587d8f-98c4-44cc-bdbd-105568d65811 req-a2d32660-ea03-4e2f-b3f4-bce97665b34c service nova] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Updating instance_info_cache with network_info: [{"id": "81e07ee5-cd42-468b-b815-d7a1ce8dcfb9", "address": "fa:16:3e:63:70:44", "network": {"id": "a510ed73-2a44-4945-9e3c-685351d93486", "bridge": "br-int", "label": "tempest-VolumesActionsTest-957592581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8cae3e5d11c40f0b499837464422c86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e07ee5-cd", "ovs_interfaceid": "81e07ee5-cd42-468b-b815-d7a1ce8dcfb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:47:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a1587d8f-98c4-44cc-bdbd-105568d65811 req-a2d32660-ea03-4e2f-b3f4-bce97665b34c service nova] Releasing lock "refresh_cache-71af2810-c388-44ad-8bbe-a3052d381e95" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:47:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:55 user nova-compute[74850]: DEBUG nova.compute.manager [req-02ac44ed-927e-4c3a-9892-4c3ba1f99ee5 req-ce4c1f74-c18b-4c6f-ac95-9ce9a7788dce service nova] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Received event network-vif-plugged-81e07ee5-cd42-468b-b815-d7a1ce8dcfb9 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-02ac44ed-927e-4c3a-9892-4c3ba1f99ee5 req-ce4c1f74-c18b-4c6f-ac95-9ce9a7788dce service nova] Acquiring lock "71af2810-c388-44ad-8bbe-a3052d381e95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-02ac44ed-927e-4c3a-9892-4c3ba1f99ee5 req-ce4c1f74-c18b-4c6f-ac95-9ce9a7788dce service nova] Lock "71af2810-c388-44ad-8bbe-a3052d381e95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-02ac44ed-927e-4c3a-9892-4c3ba1f99ee5 req-ce4c1f74-c18b-4c6f-ac95-9ce9a7788dce service nova] Lock "71af2810-c388-44ad-8bbe-a3052d381e95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:55 user nova-compute[74850]: DEBUG nova.compute.manager [req-02ac44ed-927e-4c3a-9892-4c3ba1f99ee5 req-ce4c1f74-c18b-4c6f-ac95-9ce9a7788dce service nova] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] No waiting events found dispatching network-vif-plugged-81e07ee5-cd42-468b-b815-d7a1ce8dcfb9 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:47:55 user nova-compute[74850]: WARNING nova.compute.manager [req-02ac44ed-927e-4c3a-9892-4c3ba1f99ee5 req-ce4c1f74-c18b-4c6f-ac95-9ce9a7788dce service nova] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Received unexpected event network-vif-plugged-81e07ee5-cd42-468b-b815-d7a1ce8dcfb9 for instance with vm_state building and task_state spawning.
Nov 14 00:47:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:57 user nova-compute[74850]: DEBUG nova.compute.manager [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:47:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 00:47:57 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Instance spawned successfully.
Nov 14 00:47:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 00:47:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:47:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:47:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:47:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:47:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:47:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:47:57 user nova-compute[74850]: INFO nova.compute.manager [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Took 6.25 seconds to spawn the instance on the hypervisor.
Nov 14 00:47:57 user nova-compute[74850]: DEBUG nova.compute.manager [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:47:57 user nova-compute[74850]: DEBUG nova.compute.manager [req-b20abaed-1518-409e-9f61-1b5a724ccadd req-409eafd1-7aca-4931-b6d9-0a5750ad7eb9 service nova] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Received event network-vif-plugged-81e07ee5-cd42-468b-b815-d7a1ce8dcfb9 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:47:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b20abaed-1518-409e-9f61-1b5a724ccadd req-409eafd1-7aca-4931-b6d9-0a5750ad7eb9 service nova] Acquiring lock "71af2810-c388-44ad-8bbe-a3052d381e95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:47:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b20abaed-1518-409e-9f61-1b5a724ccadd req-409eafd1-7aca-4931-b6d9-0a5750ad7eb9 service nova] Lock "71af2810-c388-44ad-8bbe-a3052d381e95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:47:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b20abaed-1518-409e-9f61-1b5a724ccadd req-409eafd1-7aca-4931-b6d9-0a5750ad7eb9 service nova] Lock "71af2810-c388-44ad-8bbe-a3052d381e95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:57 user nova-compute[74850]: DEBUG nova.compute.manager [req-b20abaed-1518-409e-9f61-1b5a724ccadd req-409eafd1-7aca-4931-b6d9-0a5750ad7eb9 service nova] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] No waiting events found dispatching network-vif-plugged-81e07ee5-cd42-468b-b815-d7a1ce8dcfb9 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:47:57 user nova-compute[74850]: WARNING nova.compute.manager [req-b20abaed-1518-409e-9f61-1b5a724ccadd req-409eafd1-7aca-4931-b6d9-0a5750ad7eb9 service nova] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Received unexpected event network-vif-plugged-81e07ee5-cd42-468b-b815-d7a1ce8dcfb9 for instance with vm_state building and task_state spawning.
Nov 14 00:47:57 user nova-compute[74850]: INFO nova.compute.manager [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Took 7.00 seconds to build instance.
Nov 14 00:47:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-089e990e-73af-45eb-a3f8-c692d257673d tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Lock "71af2810-c388-44ad-8bbe-a3052d381e95" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.110s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:47:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:47:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:05 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-43b33599-0302-407a-8a33-3e4d9f80d3e3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 937d7470-ec86-4972-b975-257d626329dd is timed out.
Nov 14 00:48:05 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-43b33599-0302-407a-8a33-3e4d9f80d3e3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Successfully detached device vdb from instance 937d7470-ec86-4972-b975-257d626329dd from the live domain config.
Nov 14 00:48:05 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43b33599-0302-407a-8a33-3e4d9f80d3e3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 00:48:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b33599-0302-407a-8a33-3e4d9f80d3e3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EAeKbcZw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': '2daa0a31-2ec1-4ea6-81b7-4756aa1defdd'}, None), 'kwargs': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:48:05 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-43b33599-0302-407a-8a33-3e4d9f80d3e3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:48:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-43b33599-0302-407a-8a33-3e4d9f80d3e3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:48:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-43b33599-0302-407a-8a33-3e4d9f80d3e3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:48:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:05 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[85cf997e-8291-4c11-86f4-f1237fbc1c74]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:48:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b33599-0302-407a-8a33-3e4d9f80d3e3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 00:48:05 user nova-compute[74850]: No targets found.
Nov 14 00:48:05 user nova-compute[74850]: iSNS:
Nov 14 00:48:05 user nova-compute[74850]: No targets found.
Nov 14 00:48:05 user nova-compute[74850]: STATIC:
Nov 14 00:48:05 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd
Nov 14 00:48:05 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:48:05 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:48:05 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a
Nov 14 00:48:05 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:48:05 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:48:05 user nova-compute[74850]: FIRMWARE:
Nov 14 00:48:05 user nova-compute[74850]: No targets found.
Nov 14 00:48:05 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:48:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b33599-0302-407a-8a33-3e4d9f80d3e3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 00:48:05 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 00:48:05 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 00:48:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b33599-0302-407a-8a33-3e4d9f80d3e3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 00:48:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:05 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4743fde-6497-4460-b49e-cb7c4b6ddb1a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:48:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:05 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc2ad7c-f621-40de-8131-e26a88bf4b8c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:48:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b33599-0302-407a-8a33-3e4d9f80d3e3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:48:05 user nova-compute[74850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)
Nov 14 00:48:05 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:48:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b33599-0302-407a-8a33-3e4d9f80d3e3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:48:05 user nova-compute[74850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd (non-flash)
Nov 14 00:48:05 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:48:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b33599-0302-407a-8a33-3e4d9f80d3e3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a5c2508b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd'): ({'sdd'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 00:48:05 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-43b33599-0302-407a-8a33-3e4d9f80d3e3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Removing single pathed devices sdd {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 00:48:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a8e17c-dc38-4fef-aa3a-49a6a6bdb593]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:48:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e814b9b-c93f-4637-8e84-9c7e018db323]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:48:06 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-43b33599-0302-407a-8a33-3e4d9f80d3e3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Flushing IO for device /dev/sdd {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 00:48:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6203c1-427b-4900-b619-7fcaa2d35b47]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:48:06 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-43b33599-0302-407a-8a33-3e4d9f80d3e3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 00:48:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[91bba7d9-9c78-44ab-a5c7-c37148d6fa5c]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:48:06 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-43b33599-0302-407a-8a33-3e4d9f80d3e3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 00:48:06 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-43b33599-0302-407a-8a33-3e4d9f80d3e3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] SCSI volumes sdd have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 00:48:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b33599-0302-407a-8a33-3e4d9f80d3e3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 00:48:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77d691d-86e5-43eb-8ee9-d757d8241ebc]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:48:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b33599-0302-407a-8a33-3e4d9f80d3e3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:48:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8256fb0b-2311-4915-807e-088fab9da406]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:48:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b33599-0302-407a-8a33-3e4d9f80d3e3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd, portal: 172.16.0.220,3260]
Nov 14 00:48:06 user nova-compute[74850]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd, portal: 172.16.0.220,3260] successful.
Nov 14 00:48:06 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:48:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2daa0a31-2ec1-4ea6-81b7-4756aa1defdd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8eee769-601e-46f2-9185-3a464cf42628]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:48:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b33599-0302-407a-8a33-3e4d9f80d3e3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:48:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-43b33599-0302-407a-8a33-3e4d9f80d3e3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:48:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b33599-0302-407a-8a33-3e4d9f80d3e3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] <== disconnect_volume: return (297ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:48:06 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43b33599-0302-407a-8a33-3e4d9f80d3e3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 00:48:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Acquiring lock "3241c4d1-0454-4604-ade4-c38ae72fd64c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:48:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "3241c4d1-0454-4604-ade4-c38ae72fd64c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:48:06 user nova-compute[74850]: DEBUG nova.compute.manager [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 00:48:06 user nova-compute[74850]: DEBUG nova.objects.instance [None req-43b33599-0302-407a-8a33-3e4d9f80d3e3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Lazy-loading 'flavor' on Instance uuid 937d7470-ec86-4972-b975-257d626329dd {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:48:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:48:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:48:06 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 00:48:06 user nova-compute[74850]: INFO nova.compute.claims [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Claim successful on node user
Nov 14 00:48:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-43b33599-0302-407a-8a33-3e4d9f80d3e3 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Lock "937d7470-ec86-4972-b975-257d626329dd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.232s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:48:07 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:48:07 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:48:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:48:07 user nova-compute[74850]: DEBUG nova.compute.manager [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 00:48:07 user nova-compute[74850]: DEBUG nova.compute.manager [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 00:48:07 user nova-compute[74850]: DEBUG nova.network.neutron [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 00:48:07 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 00:48:07 user nova-compute[74850]: DEBUG nova.compute.manager [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 00:48:07 user nova-compute[74850]: DEBUG nova.policy [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7cb1b3c8b5c24f399c674f9dde90aadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c848440ceb46dabf1eb8cca6533f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 00:48:07 user nova-compute[74850]: DEBUG nova.compute.manager [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 00:48:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 00:48:07 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Creating image(s)
Nov 14 00:48:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Acquiring lock "/opt/stack/data/nova/instances/3241c4d1-0454-4604-ade4-c38ae72fd64c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:48:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "/opt/stack/data/nova/instances/3241c4d1-0454-4604-ade4-c38ae72fd64c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:48:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "/opt/stack/data/nova/instances/3241c4d1-0454-4604-ade4-c38ae72fd64c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:48:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.192s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:48:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:48:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.184s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/3241c4d1-0454-4604-ade4-c38ae72fd64c/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/3241c4d1-0454-4604-ade4-c38ae72fd64c/disk 1073741824" returned: 0 in 0.077s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:48:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:08 user nova-compute[74850]: DEBUG nova.network.neutron [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Successfully created port: 2df34162-ff76-4cd8-a7b8-26517bcfdb8d {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:48:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.179s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:08 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3241c4d1-0454-4604-ade4-c38ae72fd64c/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 00:48:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3241c4d1-0454-4604-ade4-c38ae72fd64c/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3241c4d1-0454-4604-ade4-c38ae72fd64c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:08 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Cannot resize image /opt/stack/data/nova/instances/3241c4d1-0454-4604-ade4-c38ae72fd64c/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 00:48:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 00:48:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Ensure instance console log exists: /opt/stack/data/nova/instances/3241c4d1-0454-4604-ade4-c38ae72fd64c/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 00:48:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:48:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:48:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:48:08 user nova-compute[74850]: DEBUG nova.network.neutron [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Successfully updated port: 2df34162-ff76-4cd8-a7b8-26517bcfdb8d {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:48:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Acquiring lock "refresh_cache-3241c4d1-0454-4604-ade4-c38ae72fd64c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:48:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Acquired lock "refresh_cache-3241c4d1-0454-4604-ade4-c38ae72fd64c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:48:08 user nova-compute[74850]: DEBUG nova.network.neutron [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:48:08 user nova-compute[74850]: DEBUG nova.compute.manager [req-ef801c02-8239-4eb5-9991-cac8fa629e9f req-68c899e1-0b85-4541-9ba8-33e57095fd3c service nova] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Received event network-changed-2df34162-ff76-4cd8-a7b8-26517bcfdb8d {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:48:08 user nova-compute[74850]: DEBUG nova.compute.manager [req-ef801c02-8239-4eb5-9991-cac8fa629e9f req-68c899e1-0b85-4541-9ba8-33e57095fd3c service nova] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Refreshing instance network info cache due to event network-changed-2df34162-ff76-4cd8-a7b8-26517bcfdb8d. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:48:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ef801c02-8239-4eb5-9991-cac8fa629e9f req-68c899e1-0b85-4541-9ba8-33e57095fd3c service nova] Acquiring lock "refresh_cache-3241c4d1-0454-4604-ade4-c38ae72fd64c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:48:08 user nova-compute[74850]: DEBUG nova.network.neutron [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG nova.network.neutron [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Updating instance_info_cache with network_info: [{"id": "2df34162-ff76-4cd8-a7b8-26517bcfdb8d", "address": "fa:16:3e:26:84:1a", "network": {"id": "25547f45-3d27-4a3f-b2d2-6f0a0b4ae730", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-464974831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51c848440ceb46dabf1eb8cca6533f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df34162-ff", "ovs_interfaceid": "2df34162-ff76-4cd8-a7b8-26517bcfdb8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Releasing lock "refresh_cache-3241c4d1-0454-4604-ade4-c38ae72fd64c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG nova.compute.manager [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Instance network_info: |[{"id": "2df34162-ff76-4cd8-a7b8-26517bcfdb8d", "address": "fa:16:3e:26:84:1a", "network": {"id": "25547f45-3d27-4a3f-b2d2-6f0a0b4ae730", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-464974831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51c848440ceb46dabf1eb8cca6533f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df34162-ff", "ovs_interfaceid": "2df34162-ff76-4cd8-a7b8-26517bcfdb8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ef801c02-8239-4eb5-9991-cac8fa629e9f req-68c899e1-0b85-4541-9ba8-33e57095fd3c service nova] Acquired lock "refresh_cache-3241c4d1-0454-4604-ade4-c38ae72fd64c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG nova.network.neutron [req-ef801c02-8239-4eb5-9991-cac8fa629e9f req-68c899e1-0b85-4541-9ba8-33e57095fd3c service nova] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Refreshing network info cache for port 2df34162-ff76-4cd8-a7b8-26517bcfdb8d {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Start _get_guest_xml network_info=[{"id": "2df34162-ff76-4cd8-a7b8-26517bcfdb8d", "address": "fa:16:3e:26:84:1a", "network": {"id": "25547f45-3d27-4a3f-b2d2-6f0a0b4ae730", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-464974831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51c848440ceb46dabf1eb8cca6533f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df34162-ff", "ovs_interfaceid": "2df34162-ff76-4cd8-a7b8-26517bcfdb8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:48:09 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:48:09 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:48:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:48:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2050352988',display_name='tempest-VolumesAdminNegativeTest-server-2050352988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2050352988',id=14,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51c848440ceb46dabf1eb8cca6533f09',ramdisk_id='',reservation_id='r-6sksu2gr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-43619810',owner_user_name='tempest-VolumesAdminNegativeTest-43619810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:48:08Z,user_data=None,user_id='7cb1b3c8b5c24f399c674f9dde90aadc',uuid=3241c4d1-0454-4604-ade4-c38ae72fd64c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2df34162-ff76-4cd8-a7b8-26517bcfdb8d", "address": "fa:16:3e:26:84:1a", "network": {"id": "25547f45-3d27-4a3f-b2d2-6f0a0b4ae730", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-464974831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51c848440ceb46dabf1eb8cca6533f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df34162-ff", "ovs_interfaceid": "2df34162-ff76-4cd8-a7b8-26517bcfdb8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Converting VIF {"id": "2df34162-ff76-4cd8-a7b8-26517bcfdb8d", "address": "fa:16:3e:26:84:1a", "network": {"id": "25547f45-3d27-4a3f-b2d2-6f0a0b4ae730", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-464974831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51c848440ceb46dabf1eb8cca6533f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df34162-ff", "ovs_interfaceid": "2df34162-ff76-4cd8-a7b8-26517bcfdb8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:84:1a,bridge_name='br-int',has_traffic_filtering=True,id=2df34162-ff76-4cd8-a7b8-26517bcfdb8d,network=Network(25547f45-3d27-4a3f-b2d2-6f0a0b4ae730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df34162-ff') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG nova.objects.instance [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lazy-loading 'pci_devices' on Instance uuid 3241c4d1-0454-4604-ade4-c38ae72fd64c {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:48:09 user nova-compute[74850]:   <uuid>3241c4d1-0454-4604-ade4-c38ae72fd64c</uuid>
Nov 14 00:48:09 user nova-compute[74850]:   <name>instance-0000000e</name>
Nov 14 00:48:09 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:48:09 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:48:09 user nova-compute[74850]:   <metadata>
Nov 14 00:48:09 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:48:09 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:48:09 user nova-compute[74850]:       <nova:name>tempest-VolumesAdminNegativeTest-server-2050352988</nova:name>
Nov 14 00:48:09 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:48:09</nova:creationTime>
Nov 14 00:48:09 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:48:09 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:48:09 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:48:09 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:48:09 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:48:09 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:48:09 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:48:09 user nova-compute[74850]:       <nova:owner>
Nov 14 00:48:09 user nova-compute[74850]:         <nova:user uuid="7cb1b3c8b5c24f399c674f9dde90aadc">tempest-VolumesAdminNegativeTest-43619810-project-member</nova:user>
Nov 14 00:48:09 user nova-compute[74850]:         <nova:project uuid="51c848440ceb46dabf1eb8cca6533f09">tempest-VolumesAdminNegativeTest-43619810</nova:project>
Nov 14 00:48:09 user nova-compute[74850]:       </nova:owner>
Nov 14 00:48:09 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:48:09 user nova-compute[74850]:       <nova:ports>
Nov 14 00:48:09 user nova-compute[74850]:         <nova:port uuid="2df34162-ff76-4cd8-a7b8-26517bcfdb8d">
Nov 14 00:48:09 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 00:48:09 user nova-compute[74850]:         </nova:port>
Nov 14 00:48:09 user nova-compute[74850]:       </nova:ports>
Nov 14 00:48:09 user nova-compute[74850]:     </nova:instance>
Nov 14 00:48:09 user nova-compute[74850]:   </metadata>
Nov 14 00:48:09 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:48:09 user nova-compute[74850]:     <system>
Nov 14 00:48:09 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:48:09 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:48:09 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:48:09 user nova-compute[74850]:       <entry name="serial">3241c4d1-0454-4604-ade4-c38ae72fd64c</entry>
Nov 14 00:48:09 user nova-compute[74850]:       <entry name="uuid">3241c4d1-0454-4604-ade4-c38ae72fd64c</entry>
Nov 14 00:48:09 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:48:09 user nova-compute[74850]:     </system>
Nov 14 00:48:09 user nova-compute[74850]:   </sysinfo>
Nov 14 00:48:09 user nova-compute[74850]:   <os>
Nov 14 00:48:09 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:48:09 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 00:48:09 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:48:09 user nova-compute[74850]:   </os>
Nov 14 00:48:09 user nova-compute[74850]:   <features>
Nov 14 00:48:09 user nova-compute[74850]:     <acpi/>
Nov 14 00:48:09 user nova-compute[74850]:     <apic/>
Nov 14 00:48:09 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:48:09 user nova-compute[74850]:   </features>
Nov 14 00:48:09 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:48:09 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:48:09 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:48:09 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:48:09 user nova-compute[74850]:   </clock>
Nov 14 00:48:09 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:48:09 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:48:09 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:48:09 user nova-compute[74850]:   </cpu>
Nov 14 00:48:09 user nova-compute[74850]:   <devices>
Nov 14 00:48:09 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 00:48:09 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:48:09 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/3241c4d1-0454-4604-ade4-c38ae72fd64c/disk"/>
Nov 14 00:48:09 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:48:09 user nova-compute[74850]:     </disk>
Nov 14 00:48:09 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:48:09 user nova-compute[74850]:       <mac address="fa:16:3e:26:84:1a"/>
Nov 14 00:48:09 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:48:09 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:48:09 user nova-compute[74850]:       <target dev="tap2df34162-ff"/>
Nov 14 00:48:09 user nova-compute[74850]:     </interface>
Nov 14 00:48:09 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:48:09 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/3241c4d1-0454-4604-ade4-c38ae72fd64c/console.log" append="off"/>
Nov 14 00:48:09 user nova-compute[74850]:     </serial>
Nov 14 00:48:09 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:48:09 user nova-compute[74850]:     <video>
Nov 14 00:48:09 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:48:09 user nova-compute[74850]:     </video>
Nov 14 00:48:09 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:48:09 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:48:09 user nova-compute[74850]:     </rng>
Nov 14 00:48:09 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:48:09 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:48:09 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:48:09 user nova-compute[74850]:     </memballoon>
Nov 14 00:48:09 user nova-compute[74850]:   </devices>
Nov 14 00:48:09 user nova-compute[74850]: </domain>
Nov 14 00:48:09 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:48:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2050352988',display_name='tempest-VolumesAdminNegativeTest-server-2050352988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2050352988',id=14,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51c848440ceb46dabf1eb8cca6533f09',ramdisk_id='',reservation_id='r-6sksu2gr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-43619810',owner_user_name='tempest-VolumesAdminNegativeTest-43619810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:48:08Z,user_data=None,user_id='7cb1b3c8b5c24f399c674f9dde90aadc',uuid=3241c4d1-0454-4604-ade4-c38ae72fd64c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2df34162-ff76-4cd8-a7b8-26517bcfdb8d", "address": "fa:16:3e:26:84:1a", "network": {"id": "25547f45-3d27-4a3f-b2d2-6f0a0b4ae730", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-464974831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51c848440ceb46dabf1eb8cca6533f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df34162-ff", "ovs_interfaceid": "2df34162-ff76-4cd8-a7b8-26517bcfdb8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Converting VIF {"id": "2df34162-ff76-4cd8-a7b8-26517bcfdb8d", "address": "fa:16:3e:26:84:1a", "network": {"id": "25547f45-3d27-4a3f-b2d2-6f0a0b4ae730", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-464974831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51c848440ceb46dabf1eb8cca6533f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df34162-ff", "ovs_interfaceid": "2df34162-ff76-4cd8-a7b8-26517bcfdb8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:84:1a,bridge_name='br-int',has_traffic_filtering=True,id=2df34162-ff76-4cd8-a7b8-26517bcfdb8d,network=Network(25547f45-3d27-4a3f-b2d2-6f0a0b4ae730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df34162-ff') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG os_vif [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:84:1a,bridge_name='br-int',has_traffic_filtering=True,id=2df34162-ff76-4cd8-a7b8-26517bcfdb8d,network=Network(25547f45-3d27-4a3f-b2d2-6f0a0b4ae730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df34162-ff') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a80c27df-fb0c-50b0-adb5-3d1d081a5587', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2df34162-ff, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2df34162-ff, col_values=(('qos', UUID('9b4b3641-4853-4ea5-8953-08907d56c83f')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2df34162-ff, col_values=(('external_ids', {'iface-id': '2df34162-ff76-4cd8-a7b8-26517bcfdb8d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:84:1a', 'vm-uuid': '3241c4d1-0454-4604-ade4-c38ae72fd64c'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:09 user nova-compute[74850]: INFO os_vif [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:84:1a,bridge_name='br-int',has_traffic_filtering=True,id=2df34162-ff76-4cd8-a7b8-26517bcfdb8d,network=Network(25547f45-3d27-4a3f-b2d2-6f0a0b4ae730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df34162-ff')
Nov 14 00:48:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] No VIF found with MAC fa:16:3e:26:84:1a, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG nova.network.neutron [req-ef801c02-8239-4eb5-9991-cac8fa629e9f req-68c899e1-0b85-4541-9ba8-33e57095fd3c service nova] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Updated VIF entry in instance network info cache for port 2df34162-ff76-4cd8-a7b8-26517bcfdb8d. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG nova.network.neutron [req-ef801c02-8239-4eb5-9991-cac8fa629e9f req-68c899e1-0b85-4541-9ba8-33e57095fd3c service nova] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Updating instance_info_cache with network_info: [{"id": "2df34162-ff76-4cd8-a7b8-26517bcfdb8d", "address": "fa:16:3e:26:84:1a", "network": {"id": "25547f45-3d27-4a3f-b2d2-6f0a0b4ae730", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-464974831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51c848440ceb46dabf1eb8cca6533f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df34162-ff", "ovs_interfaceid": "2df34162-ff76-4cd8-a7b8-26517bcfdb8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:48:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ef801c02-8239-4eb5-9991-cac8fa629e9f req-68c899e1-0b85-4541-9ba8-33e57095fd3c service nova] Releasing lock "refresh_cache-3241c4d1-0454-4604-ade4-c38ae72fd64c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:48:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:11 user nova-compute[74850]: DEBUG nova.compute.manager [req-b0e706ac-b4da-4ecd-92e8-6e9e94387193 req-7d21fc15-5489-4a53-b3e6-a8577fd58a0d service nova] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Received event network-vif-plugged-2df34162-ff76-4cd8-a7b8-26517bcfdb8d {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:48:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b0e706ac-b4da-4ecd-92e8-6e9e94387193 req-7d21fc15-5489-4a53-b3e6-a8577fd58a0d service nova] Acquiring lock "3241c4d1-0454-4604-ade4-c38ae72fd64c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:48:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b0e706ac-b4da-4ecd-92e8-6e9e94387193 req-7d21fc15-5489-4a53-b3e6-a8577fd58a0d service nova] Lock "3241c4d1-0454-4604-ade4-c38ae72fd64c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:48:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b0e706ac-b4da-4ecd-92e8-6e9e94387193 req-7d21fc15-5489-4a53-b3e6-a8577fd58a0d service nova] Lock "3241c4d1-0454-4604-ade4-c38ae72fd64c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:48:11 user nova-compute[74850]: DEBUG nova.compute.manager [req-b0e706ac-b4da-4ecd-92e8-6e9e94387193 req-7d21fc15-5489-4a53-b3e6-a8577fd58a0d service nova] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] No waiting events found dispatching network-vif-plugged-2df34162-ff76-4cd8-a7b8-26517bcfdb8d {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:48:11 user nova-compute[74850]: WARNING nova.compute.manager [req-b0e706ac-b4da-4ecd-92e8-6e9e94387193 req-7d21fc15-5489-4a53-b3e6-a8577fd58a0d service nova] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Received unexpected event network-vif-plugged-2df34162-ff76-4cd8-a7b8-26517bcfdb8d for instance with vm_state building and task_state spawning.
Nov 14 00:48:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:13 user nova-compute[74850]: DEBUG nova.compute.manager [req-c9a67e4d-2882-4848-9bd1-fb5711081403 req-0b13f464-48f6-434d-9580-5c31251b3926 service nova] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Received event network-vif-plugged-2df34162-ff76-4cd8-a7b8-26517bcfdb8d {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:48:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c9a67e4d-2882-4848-9bd1-fb5711081403 req-0b13f464-48f6-434d-9580-5c31251b3926 service nova] Acquiring lock "3241c4d1-0454-4604-ade4-c38ae72fd64c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:48:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c9a67e4d-2882-4848-9bd1-fb5711081403 req-0b13f464-48f6-434d-9580-5c31251b3926 service nova] Lock "3241c4d1-0454-4604-ade4-c38ae72fd64c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:48:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c9a67e4d-2882-4848-9bd1-fb5711081403 req-0b13f464-48f6-434d-9580-5c31251b3926 service nova] Lock "3241c4d1-0454-4604-ade4-c38ae72fd64c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:48:13 user nova-compute[74850]: DEBUG nova.compute.manager [req-c9a67e4d-2882-4848-9bd1-fb5711081403 req-0b13f464-48f6-434d-9580-5c31251b3926 service nova] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] No waiting events found dispatching network-vif-plugged-2df34162-ff76-4cd8-a7b8-26517bcfdb8d {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:48:13 user nova-compute[74850]: WARNING nova.compute.manager [req-c9a67e4d-2882-4848-9bd1-fb5711081403 req-0b13f464-48f6-434d-9580-5c31251b3926 service nova] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Received unexpected event network-vif-plugged-2df34162-ff76-4cd8-a7b8-26517bcfdb8d for instance with vm_state building and task_state spawning.
Nov 14 00:48:13 user nova-compute[74850]: DEBUG nova.compute.manager [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:48:13 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 00:48:13 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Instance spawned successfully.
Nov 14 00:48:13 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 00:48:13 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:48:13 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:48:13 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:48:13 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:48:13 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:48:13 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:48:13 user nova-compute[74850]: INFO nova.compute.manager [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Took 5.70 seconds to spawn the instance on the hypervisor.
Nov 14 00:48:13 user nova-compute[74850]: DEBUG nova.compute.manager [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:48:13 user nova-compute[74850]: INFO nova.compute.manager [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Took 6.48 seconds to build instance.
Nov 14 00:48:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ac3ff61f-7442-407c-be2a-aab6f43f3c03 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "3241c4d1-0454-4604-ade4-c38ae72fd64c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.584s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:48:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-82e1e0bc-4aee-4c0a-af2c-89bebb088afd tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Acquiring lock "faeb3377-d199-472b-9ee2-f504d5ac9ac4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:48:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-82e1e0bc-4aee-4c0a-af2c-89bebb088afd tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Lock "faeb3377-d199-472b-9ee2-f504d5ac9ac4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:48:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-82e1e0bc-4aee-4c0a-af2c-89bebb088afd tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Acquiring lock "faeb3377-d199-472b-9ee2-f504d5ac9ac4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:48:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-82e1e0bc-4aee-4c0a-af2c-89bebb088afd tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Lock "faeb3377-d199-472b-9ee2-f504d5ac9ac4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:48:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-82e1e0bc-4aee-4c0a-af2c-89bebb088afd tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Lock "faeb3377-d199-472b-9ee2-f504d5ac9ac4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:48:16 user nova-compute[74850]: INFO nova.compute.manager [None req-82e1e0bc-4aee-4c0a-af2c-89bebb088afd tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Terminating instance
Nov 14 00:48:16 user nova-compute[74850]: DEBUG nova.compute.manager [None req-82e1e0bc-4aee-4c0a-af2c-89bebb088afd tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 00:48:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:17 user nova-compute[74850]: DEBUG nova.compute.manager [req-b670ef86-dd60-4259-ba6b-bf1cca9d969c req-0baa8ad0-0f74-49e2-9961-39cf81b07618 service nova] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Received event network-vif-unplugged-e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:48:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b670ef86-dd60-4259-ba6b-bf1cca9d969c req-0baa8ad0-0f74-49e2-9961-39cf81b07618 service nova] Acquiring lock "faeb3377-d199-472b-9ee2-f504d5ac9ac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:48:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b670ef86-dd60-4259-ba6b-bf1cca9d969c req-0baa8ad0-0f74-49e2-9961-39cf81b07618 service nova] Lock "faeb3377-d199-472b-9ee2-f504d5ac9ac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:48:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b670ef86-dd60-4259-ba6b-bf1cca9d969c req-0baa8ad0-0f74-49e2-9961-39cf81b07618 service nova] Lock "faeb3377-d199-472b-9ee2-f504d5ac9ac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:48:17 user nova-compute[74850]: DEBUG nova.compute.manager [req-b670ef86-dd60-4259-ba6b-bf1cca9d969c req-0baa8ad0-0f74-49e2-9961-39cf81b07618 service nova] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] No waiting events found dispatching network-vif-unplugged-e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:48:17 user nova-compute[74850]: DEBUG nova.compute.manager [req-b670ef86-dd60-4259-ba6b-bf1cca9d969c req-0baa8ad0-0f74-49e2-9961-39cf81b07618 service nova] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Received event network-vif-unplugged-e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 00:48:17 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Instance destroyed successfully.
Nov 14 00:48:17 user nova-compute[74850]: DEBUG nova.objects.instance [None req-82e1e0bc-4aee-4c0a-af2c-89bebb088afd tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Lazy-loading 'resources' on Instance uuid faeb3377-d199-472b-9ee2-f504d5ac9ac4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:48:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-82e1e0bc-4aee-4c0a-af2c-89bebb088afd tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:45:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1939508979',display_name='tempest-VolumesAssistedSnapshotsTest-server-1939508979',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1939508979',id=9,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJfdZqKAE0r0CKH6VGJq2O3BVuRwT7eBQDZQRr4fW2r2oECzghrOS0rMgeQqupLkejkXJbaQ4kamX/1GzsToSACvGpO0QTqrvPPLFtnZ8wuCEEo1wJZ+ov4oDtPOBWilzQ==',key_name='tempest-keypair-87582777',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:45:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8aa47b07cec543abbcfe0c27cb06e591',ramdisk_id='',reservation_id='r-xt3d1zsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1054739683',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1054739683-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:45:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2cd9f911e27e4ad398043e232d750aa9',uuid=faeb3377-d199-472b-9ee2-f504d5ac9ac4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa", "address": "fa:16:3e:f4:17:52", "network": {"id": "1e997e66-8753-4b3a-a6c9-26ba2a6152fa", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1625339302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa47b07cec543abbcfe0c27cb06e591", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5356eac-6f", "ovs_interfaceid": "e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:48:17 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-82e1e0bc-4aee-4c0a-af2c-89bebb088afd tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Converting VIF {"id": "e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa", "address": "fa:16:3e:f4:17:52", "network": {"id": "1e997e66-8753-4b3a-a6c9-26ba2a6152fa", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1625339302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa47b07cec543abbcfe0c27cb06e591", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5356eac-6f", "ovs_interfaceid": "e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:48:17 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-82e1e0bc-4aee-4c0a-af2c-89bebb088afd tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:17:52,bridge_name='br-int',has_traffic_filtering=True,id=e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa,network=Network(1e997e66-8753-4b3a-a6c9-26ba2a6152fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5356eac-6f') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:48:17 user nova-compute[74850]: DEBUG os_vif [None req-82e1e0bc-4aee-4c0a-af2c-89bebb088afd tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:17:52,bridge_name='br-int',has_traffic_filtering=True,id=e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa,network=Network(1e997e66-8753-4b3a-a6c9-26ba2a6152fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5356eac-6f') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:48:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5356eac-6f, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:48:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:48:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9545d1bc-76b6-44f6-bf17-669101cb1ef7) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:48:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:48:17 user nova-compute[74850]: INFO os_vif [None req-82e1e0bc-4aee-4c0a-af2c-89bebb088afd tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:17:52,bridge_name='br-int',has_traffic_filtering=True,id=e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa,network=Network(1e997e66-8753-4b3a-a6c9-26ba2a6152fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5356eac-6f')
Nov 14 00:48:17 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-82e1e0bc-4aee-4c0a-af2c-89bebb088afd tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Deleting instance files /opt/stack/data/nova/instances/faeb3377-d199-472b-9ee2-f504d5ac9ac4_del
Nov 14 00:48:17 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-82e1e0bc-4aee-4c0a-af2c-89bebb088afd tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Deletion of /opt/stack/data/nova/instances/faeb3377-d199-472b-9ee2-f504d5ac9ac4_del complete
Nov 14 00:48:17 user nova-compute[74850]: INFO nova.compute.manager [None req-82e1e0bc-4aee-4c0a-af2c-89bebb088afd tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 14 00:48:17 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-82e1e0bc-4aee-4c0a-af2c-89bebb088afd tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 00:48:17 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 00:48:17 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 00:48:18 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:48:18 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Took 0.96 seconds to deallocate network for instance.
Nov 14 00:48:18 user nova-compute[74850]: DEBUG nova.compute.manager [req-3ca696f5-f762-4ff3-b02f-9e4d3816fdc6 req-6ef65b50-9356-4f34-ad3d-66afd07e3547 service nova] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Received event network-vif-deleted-e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:48:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-82e1e0bc-4aee-4c0a-af2c-89bebb088afd tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:48:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-82e1e0bc-4aee-4c0a-af2c-89bebb088afd tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:48:18 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-82e1e0bc-4aee-4c0a-af2c-89bebb088afd tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:48:18 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-82e1e0bc-4aee-4c0a-af2c-89bebb088afd tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:48:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-82e1e0bc-4aee-4c0a-af2c-89bebb088afd tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.253s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:48:18 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-82e1e0bc-4aee-4c0a-af2c-89bebb088afd tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Deleted allocations for instance faeb3377-d199-472b-9ee2-f504d5ac9ac4
Nov 14 00:48:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-82e1e0bc-4aee-4c0a-af2c-89bebb088afd tempest-VolumesAssistedSnapshotsTest-1054739683 tempest-VolumesAssistedSnapshotsTest-1054739683-project-member] Lock "faeb3377-d199-472b-9ee2-f504d5ac9ac4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.324s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:48:19 user nova-compute[74850]: DEBUG nova.compute.manager [req-6029c71d-91cc-4048-932f-e39e96a80972 req-fd4c0363-594c-45bb-a15e-c274b6e5e58e service nova] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Received event network-vif-plugged-e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:48:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6029c71d-91cc-4048-932f-e39e96a80972 req-fd4c0363-594c-45bb-a15e-c274b6e5e58e service nova] Acquiring lock "faeb3377-d199-472b-9ee2-f504d5ac9ac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:48:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6029c71d-91cc-4048-932f-e39e96a80972 req-fd4c0363-594c-45bb-a15e-c274b6e5e58e service nova] Lock "faeb3377-d199-472b-9ee2-f504d5ac9ac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:48:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6029c71d-91cc-4048-932f-e39e96a80972 req-fd4c0363-594c-45bb-a15e-c274b6e5e58e service nova] Lock "faeb3377-d199-472b-9ee2-f504d5ac9ac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:48:19 user nova-compute[74850]: DEBUG nova.compute.manager [req-6029c71d-91cc-4048-932f-e39e96a80972 req-fd4c0363-594c-45bb-a15e-c274b6e5e58e service nova] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] No waiting events found dispatching network-vif-plugged-e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:48:19 user nova-compute[74850]: WARNING nova.compute.manager [req-6029c71d-91cc-4048-932f-e39e96a80972 req-fd4c0363-594c-45bb-a15e-c274b6e5e58e service nova] [instance: faeb3377-d199-472b-9ee2-f504d5ac9ac4] Received unexpected event network-vif-plugged-e5356eac-6ff1-4aa5-b2bd-9305a54e7bfa for instance with vm_state deleted and task_state None.
Nov 14 00:48:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:30 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e0a5538a-4af7-4ce7-8b23-9bd9bcfc77a4 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Acquiring lock "937d7470-ec86-4972-b975-257d626329dd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:48:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e0a5538a-4af7-4ce7-8b23-9bd9bcfc77a4 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Lock "937d7470-ec86-4972-b975-257d626329dd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:48:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e0a5538a-4af7-4ce7-8b23-9bd9bcfc77a4 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Acquiring lock "937d7470-ec86-4972-b975-257d626329dd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:48:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e0a5538a-4af7-4ce7-8b23-9bd9bcfc77a4 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Lock "937d7470-ec86-4972-b975-257d626329dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:48:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e0a5538a-4af7-4ce7-8b23-9bd9bcfc77a4 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Lock "937d7470-ec86-4972-b975-257d626329dd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:48:35 user nova-compute[74850]: INFO nova.compute.manager [None req-e0a5538a-4af7-4ce7-8b23-9bd9bcfc77a4 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Terminating instance
Nov 14 00:48:35 user nova-compute[74850]: DEBUG nova.compute.manager [None req-e0a5538a-4af7-4ce7-8b23-9bd9bcfc77a4 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 00:48:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:35 user nova-compute[74850]: DEBUG nova.compute.manager [req-9e690e27-e9dd-43b0-9dfa-2835e44b02ef req-d37f10fe-a052-4764-83db-8697ef1bb3db service nova] [instance: 937d7470-ec86-4972-b975-257d626329dd] Received event network-vif-unplugged-2df12354-6de2-49fd-812e-1354c7c87039 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:48:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9e690e27-e9dd-43b0-9dfa-2835e44b02ef req-d37f10fe-a052-4764-83db-8697ef1bb3db service nova] Acquiring lock "937d7470-ec86-4972-b975-257d626329dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:48:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9e690e27-e9dd-43b0-9dfa-2835e44b02ef req-d37f10fe-a052-4764-83db-8697ef1bb3db service nova] Lock "937d7470-ec86-4972-b975-257d626329dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:48:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9e690e27-e9dd-43b0-9dfa-2835e44b02ef req-d37f10fe-a052-4764-83db-8697ef1bb3db service nova] Lock "937d7470-ec86-4972-b975-257d626329dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:48:35 user nova-compute[74850]: DEBUG nova.compute.manager [req-9e690e27-e9dd-43b0-9dfa-2835e44b02ef req-d37f10fe-a052-4764-83db-8697ef1bb3db service nova] [instance: 937d7470-ec86-4972-b975-257d626329dd] No waiting events found dispatching network-vif-unplugged-2df12354-6de2-49fd-812e-1354c7c87039 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:48:35 user nova-compute[74850]: DEBUG nova.compute.manager [req-9e690e27-e9dd-43b0-9dfa-2835e44b02ef req-d37f10fe-a052-4764-83db-8697ef1bb3db service nova] [instance: 937d7470-ec86-4972-b975-257d626329dd] Received event network-vif-unplugged-2df12354-6de2-49fd-812e-1354c7c87039 for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 00:48:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:35 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 937d7470-ec86-4972-b975-257d626329dd] Instance destroyed successfully.
Nov 14 00:48:35 user nova-compute[74850]: DEBUG nova.objects.instance [None req-e0a5538a-4af7-4ce7-8b23-9bd9bcfc77a4 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Lazy-loading 'resources' on Instance uuid 937d7470-ec86-4972-b975-257d626329dd {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:48:35 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-e0a5538a-4af7-4ce7-8b23-9bd9bcfc77a4 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:45:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-752047898',display_name='tempest-TestVolumeSwap-server-752047898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-752047898',id=7,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOoVNvkutJjwmkF9XeKrykcSE5UbP6yiCQ+agx7TDKNjdR1haAqEF0ZS1csyFhoXXvvItY/3Pp3GZEdxrmUjvmyQS9xL6wDMxPNdNfbQ9oXKzoDgh9fMXaR5qjh+qzJqQ==',key_name='tempest-keypair-635174324',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:45:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7ee2171e47543fa818dc601abc63ea0',ramdisk_id='',reservation_id='r-05xdstn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1639962610',owner_user_name='tempest-TestVolumeSwap-1639962610-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:45:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd597d37ed9b48a1bfaa3da62b286ca7',uuid=937d7470-ec86-4972-b975-257d626329dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2df12354-6de2-49fd-812e-1354c7c87039", "address": "fa:16:3e:4b:c7:91", "network": {"id": "dbe8caa9-0185-44cf-b45e-f5f0c0f3f81c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-413724990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ee2171e47543fa818dc601abc63ea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df12354-6d", "ovs_interfaceid": "2df12354-6de2-49fd-812e-1354c7c87039", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:48:35 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-e0a5538a-4af7-4ce7-8b23-9bd9bcfc77a4 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Converting VIF {"id": "2df12354-6de2-49fd-812e-1354c7c87039", "address": "fa:16:3e:4b:c7:91", "network": {"id": "dbe8caa9-0185-44cf-b45e-f5f0c0f3f81c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-413724990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ee2171e47543fa818dc601abc63ea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df12354-6d", "ovs_interfaceid": "2df12354-6de2-49fd-812e-1354c7c87039", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:48:35 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-e0a5538a-4af7-4ce7-8b23-9bd9bcfc77a4 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:c7:91,bridge_name='br-int',has_traffic_filtering=True,id=2df12354-6de2-49fd-812e-1354c7c87039,network=Network(dbe8caa9-0185-44cf-b45e-f5f0c0f3f81c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df12354-6d') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:48:35 user nova-compute[74850]: DEBUG os_vif [None req-e0a5538a-4af7-4ce7-8b23-9bd9bcfc77a4 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:c7:91,bridge_name='br-int',has_traffic_filtering=True,id=2df12354-6de2-49fd-812e-1354c7c87039,network=Network(dbe8caa9-0185-44cf-b45e-f5f0c0f3f81c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df12354-6d') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:48:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2df12354-6d, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:48:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a8c71ad8-b6a2-491e-9fe1-47383cc81b1a) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:48:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:48:35 user nova-compute[74850]: INFO os_vif [None req-e0a5538a-4af7-4ce7-8b23-9bd9bcfc77a4 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:c7:91,bridge_name='br-int',has_traffic_filtering=True,id=2df12354-6de2-49fd-812e-1354c7c87039,network=Network(dbe8caa9-0185-44cf-b45e-f5f0c0f3f81c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df12354-6d')
Nov 14 00:48:35 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-e0a5538a-4af7-4ce7-8b23-9bd9bcfc77a4 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Deleting instance files /opt/stack/data/nova/instances/937d7470-ec86-4972-b975-257d626329dd_del
Nov 14 00:48:35 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-e0a5538a-4af7-4ce7-8b23-9bd9bcfc77a4 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Deletion of /opt/stack/data/nova/instances/937d7470-ec86-4972-b975-257d626329dd_del complete
Nov 14 00:48:36 user nova-compute[74850]: INFO nova.compute.manager [None req-e0a5538a-4af7-4ce7-8b23-9bd9bcfc77a4 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] [instance: 937d7470-ec86-4972-b975-257d626329dd] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 14 00:48:36 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-e0a5538a-4af7-4ce7-8b23-9bd9bcfc77a4 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 00:48:36 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: 937d7470-ec86-4972-b975-257d626329dd] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 00:48:36 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 937d7470-ec86-4972-b975-257d626329dd] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 00:48:36 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 937d7470-ec86-4972-b975-257d626329dd] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:48:36 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: 937d7470-ec86-4972-b975-257d626329dd] Took 0.82 seconds to deallocate network for instance.
Nov 14 00:48:36 user nova-compute[74850]: DEBUG nova.compute.manager [req-ae047601-3792-429c-b8ca-7d2f1b3052e4 req-b141814e-a250-4ca0-9685-5f63726dd7e0 service nova] [instance: 937d7470-ec86-4972-b975-257d626329dd] Received event network-vif-deleted-2df12354-6de2-49fd-812e-1354c7c87039 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:48:36 user nova-compute[74850]: INFO nova.compute.manager [req-ae047601-3792-429c-b8ca-7d2f1b3052e4 req-b141814e-a250-4ca0-9685-5f63726dd7e0 service nova] [instance: 937d7470-ec86-4972-b975-257d626329dd] Neutron deleted interface 2df12354-6de2-49fd-812e-1354c7c87039; detaching it from the instance and deleting it from the info cache
Nov 14 00:48:36 user nova-compute[74850]: DEBUG nova.network.neutron [req-ae047601-3792-429c-b8ca-7d2f1b3052e4 req-b141814e-a250-4ca0-9685-5f63726dd7e0 service nova] [instance: 937d7470-ec86-4972-b975-257d626329dd] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:48:36 user nova-compute[74850]: DEBUG nova.compute.manager [req-ae047601-3792-429c-b8ca-7d2f1b3052e4 req-b141814e-a250-4ca0-9685-5f63726dd7e0 service nova] [instance: 937d7470-ec86-4972-b975-257d626329dd] Detach interface failed, port_id=2df12354-6de2-49fd-812e-1354c7c87039, reason: Instance 937d7470-ec86-4972-b975-257d626329dd could not be found. {{(pid=74850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 00:48:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e0a5538a-4af7-4ce7-8b23-9bd9bcfc77a4 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:48:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e0a5538a-4af7-4ce7-8b23-9bd9bcfc77a4 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:48:37 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-e0a5538a-4af7-4ce7-8b23-9bd9bcfc77a4 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:48:37 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-e0a5538a-4af7-4ce7-8b23-9bd9bcfc77a4 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:48:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e0a5538a-4af7-4ce7-8b23-9bd9bcfc77a4 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.285s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:48:37 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-e0a5538a-4af7-4ce7-8b23-9bd9bcfc77a4 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Deleted allocations for instance 937d7470-ec86-4972-b975-257d626329dd
Nov 14 00:48:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e0a5538a-4af7-4ce7-8b23-9bd9bcfc77a4 tempest-TestVolumeSwap-1639962610 tempest-TestVolumeSwap-1639962610-project-member] Lock "937d7470-ec86-4972-b975-257d626329dd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.284s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:48:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:37 user nova-compute[74850]: DEBUG nova.compute.manager [req-775bebbc-f077-4312-a81c-eb9e9523e543 req-e6519c08-5ded-46de-89d9-f946ece77bcf service nova] [instance: 937d7470-ec86-4972-b975-257d626329dd] Received event network-vif-plugged-2df12354-6de2-49fd-812e-1354c7c87039 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:48:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-775bebbc-f077-4312-a81c-eb9e9523e543 req-e6519c08-5ded-46de-89d9-f946ece77bcf service nova] Acquiring lock "937d7470-ec86-4972-b975-257d626329dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:48:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-775bebbc-f077-4312-a81c-eb9e9523e543 req-e6519c08-5ded-46de-89d9-f946ece77bcf service nova] Lock "937d7470-ec86-4972-b975-257d626329dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:48:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-775bebbc-f077-4312-a81c-eb9e9523e543 req-e6519c08-5ded-46de-89d9-f946ece77bcf service nova] Lock "937d7470-ec86-4972-b975-257d626329dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:48:37 user nova-compute[74850]: DEBUG nova.compute.manager [req-775bebbc-f077-4312-a81c-eb9e9523e543 req-e6519c08-5ded-46de-89d9-f946ece77bcf service nova] [instance: 937d7470-ec86-4972-b975-257d626329dd] No waiting events found dispatching network-vif-plugged-2df12354-6de2-49fd-812e-1354c7c87039 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:48:37 user nova-compute[74850]: WARNING nova.compute.manager [req-775bebbc-f077-4312-a81c-eb9e9523e543 req-e6519c08-5ded-46de-89d9-f946ece77bcf service nova] [instance: 937d7470-ec86-4972-b975-257d626329dd] Received unexpected event network-vif-plugged-2df12354-6de2-49fd-812e-1354c7c87039 for instance with vm_state deleted and task_state None.
Nov 14 00:48:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:42 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:48:42 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:48:42 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:48:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:48:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:48:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:48:42 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 00:48:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28212eec-99be-4171-97ed-7748bbb75c88/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28212eec-99be-4171-97ed-7748bbb75c88/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28212eec-99be-4171-97ed-7748bbb75c88/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28212eec-99be-4171-97ed-7748bbb75c88/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3241c4d1-0454-4604-ade4-c38ae72fd64c/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3241c4d1-0454-4604-ade4-c38ae72fd64c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3241c4d1-0454-4604-ade4-c38ae72fd64c/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3241c4d1-0454-4604-ade4-c38ae72fd64c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71af2810-c388-44ad-8bbe-a3052d381e95/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71af2810-c388-44ad-8bbe-a3052d381e95/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71af2810-c388-44ad-8bbe-a3052d381e95/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71af2810-c388-44ad-8bbe-a3052d381e95/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:48:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:45 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:48:45 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:48:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=8028MB free_disk=25.540565490722656GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 00:48:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:48:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:48:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:46 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance a70d0196-f90e-47c4-be67-bf7ef4c3d8c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:48:46 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 1879be4c-9226-4c8c-a56c-f8e37398851b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:48:46 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 28212eec-99be-4171-97ed-7748bbb75c88 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:48:46 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance b54b37bc-8c90-4c48-a943-e489e830b93b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:48:46 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 71af2810-c388-44ad-8bbe-a3052d381e95 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:48:46 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 3241c4d1-0454-4604-ade4-c38ae72fd64c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:48:46 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 00:48:46 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 00:48:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:46 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:48:46 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:48:46 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 00:48:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.393s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:48:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:47 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:48:47 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:48:47 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:48:47 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 00:48:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "refresh_cache-b54b37bc-8c90-4c48-a943-e489e830b93b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:48:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquired lock "refresh_cache-b54b37bc-8c90-4c48-a943-e489e830b93b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:48:47 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Forcefully refreshing network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 00:48:48 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Updating instance_info_cache with network_info: [{"id": "5db497e0-e507-4a13-b0ff-fb4f7608f94d", "address": "fa:16:3e:75:22:ea", "network": {"id": "35cab925-9113-4bab-8203-a81035513ed6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036882895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c05ffa95fcf49d6a87d6dad2b3f0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db497e0-e5", "ovs_interfaceid": "5db497e0-e507-4a13-b0ff-fb4f7608f94d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:48:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Releasing lock "refresh_cache-b54b37bc-8c90-4c48-a943-e489e830b93b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:48:48 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Updated the network info_cache for instance {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 00:48:48 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:48:48 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:48:48 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:48:48 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:48:48 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 00:48:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Acquiring lock "415808a8-c17b-49bf-8a4e-ac19553cdb19" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:48:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Lock "415808a8-c17b-49bf-8a4e-ac19553cdb19" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:48:51 user nova-compute[74850]: DEBUG nova.compute.manager [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 00:48:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:48:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:48:51 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 00:48:51 user nova-compute[74850]: INFO nova.compute.claims [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Claim successful on node user
Nov 14 00:48:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:51 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:48:51 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:48:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.341s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:48:51 user nova-compute[74850]: DEBUG nova.compute.manager [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 00:48:51 user nova-compute[74850]: DEBUG nova.compute.manager [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 00:48:51 user nova-compute[74850]: DEBUG nova.network.neutron [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 00:48:51 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 00:48:52 user nova-compute[74850]: DEBUG nova.compute.manager [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 00:48:52 user nova-compute[74850]: DEBUG nova.compute.manager [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 00:48:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 00:48:52 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Creating image(s)
Nov 14 00:48:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Acquiring lock "/opt/stack/data/nova/instances/415808a8-c17b-49bf-8a4e-ac19553cdb19/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:48:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Lock "/opt/stack/data/nova/instances/415808a8-c17b-49bf-8a4e-ac19553cdb19/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:48:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Lock "/opt/stack/data/nova/instances/415808a8-c17b-49bf-8a4e-ac19553cdb19/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:48:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:52 user nova-compute[74850]: DEBUG nova.policy [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75dd785464c744d2bd90259ae57ca4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cb14c69af840f7aa2f61d57c0fa31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 00:48:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.215s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:48:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:48:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.182s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/415808a8-c17b-49bf-8a4e-ac19553cdb19/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/415808a8-c17b-49bf-8a4e-ac19553cdb19/disk 1073741824" returned: 0 in 0.057s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:48:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.187s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:52 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Checking if we can resize image /opt/stack/data/nova/instances/415808a8-c17b-49bf-8a4e-ac19553cdb19/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 00:48:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415808a8-c17b-49bf-8a4e-ac19553cdb19/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Acquiring lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:48:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:48:52 user nova-compute[74850]: DEBUG nova.compute.manager [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 00:48:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:48:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:48:52 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 00:48:52 user nova-compute[74850]: INFO nova.compute.claims [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Claim successful on node user
Nov 14 00:48:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415808a8-c17b-49bf-8a4e-ac19553cdb19/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:53 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Cannot resize image /opt/stack/data/nova/instances/415808a8-c17b-49bf-8a4e-ac19553cdb19/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 00:48:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 00:48:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Ensure instance console log exists: /opt/stack/data/nova/instances/415808a8-c17b-49bf-8a4e-ac19553cdb19/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 00:48:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:48:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:48:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:48:53 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:48:53 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:48:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.350s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:48:53 user nova-compute[74850]: DEBUG nova.compute.manager [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 00:48:53 user nova-compute[74850]: DEBUG nova.compute.manager [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 00:48:53 user nova-compute[74850]: DEBUG nova.network.neutron [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 00:48:53 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 00:48:53 user nova-compute[74850]: DEBUG nova.compute.manager [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 00:48:53 user nova-compute[74850]: DEBUG nova.network.neutron [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Successfully created port: 7cc43262-84fa-474b-ae96-39758aba662b {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:48:53 user nova-compute[74850]: DEBUG nova.policy [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a2647a5318ce4cdca3154aef93651505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af65f5e7dcc3404292714adcecdd9939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 00:48:53 user nova-compute[74850]: DEBUG nova.compute.manager [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 00:48:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 00:48:53 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Creating image(s)
Nov 14 00:48:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Acquiring lock "/opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:48:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "/opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:48:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "/opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:48:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.169s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:48:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:48:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.188s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk 1073741824" returned: 0 in 0.047s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:48:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:54 user nova-compute[74850]: DEBUG nova.network.neutron [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Successfully created port: 745756ea-b360-423f-8258-5339a80658b5 {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:48:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.183s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:54 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 00:48:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:54 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Cannot resize image /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 00:48:54 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 00:48:54 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Ensure instance console log exists: /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 00:48:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:48:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:48:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:48:54 user nova-compute[74850]: DEBUG nova.network.neutron [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Successfully updated port: 745756ea-b360-423f-8258-5339a80658b5 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:48:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Acquiring lock "refresh_cache-4f1102c5-f5ef-48d5-b271-6e25bee5cc70" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:48:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Acquired lock "refresh_cache-4f1102c5-f5ef-48d5-b271-6e25bee5cc70" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:48:54 user nova-compute[74850]: DEBUG nova.network.neutron [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:48:54 user nova-compute[74850]: DEBUG nova.compute.manager [req-756b294d-25fc-468b-8f72-58e6e260a3fa req-008fcd23-0421-4707-adc1-300e3b46ca32 service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Received event network-changed-745756ea-b360-423f-8258-5339a80658b5 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:48:54 user nova-compute[74850]: DEBUG nova.compute.manager [req-756b294d-25fc-468b-8f72-58e6e260a3fa req-008fcd23-0421-4707-adc1-300e3b46ca32 service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Refreshing instance network info cache due to event network-changed-745756ea-b360-423f-8258-5339a80658b5. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:48:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-756b294d-25fc-468b-8f72-58e6e260a3fa req-008fcd23-0421-4707-adc1-300e3b46ca32 service nova] Acquiring lock "refresh_cache-4f1102c5-f5ef-48d5-b271-6e25bee5cc70" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:48:54 user nova-compute[74850]: DEBUG nova.network.neutron [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Successfully updated port: 7cc43262-84fa-474b-ae96-39758aba662b {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:48:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Acquiring lock "refresh_cache-415808a8-c17b-49bf-8a4e-ac19553cdb19" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:48:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Acquired lock "refresh_cache-415808a8-c17b-49bf-8a4e-ac19553cdb19" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:48:54 user nova-compute[74850]: DEBUG nova.network.neutron [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:48:54 user nova-compute[74850]: DEBUG nova.network.neutron [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:48:54 user nova-compute[74850]: DEBUG nova.compute.manager [req-cb787807-490a-45ce-af8a-3363927a1bd1 req-0221fa8e-7662-40ee-9a30-5140454f9c40 service nova] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Received event network-changed-7cc43262-84fa-474b-ae96-39758aba662b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:48:54 user nova-compute[74850]: DEBUG nova.compute.manager [req-cb787807-490a-45ce-af8a-3363927a1bd1 req-0221fa8e-7662-40ee-9a30-5140454f9c40 service nova] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Refreshing instance network info cache due to event network-changed-7cc43262-84fa-474b-ae96-39758aba662b. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:48:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-cb787807-490a-45ce-af8a-3363927a1bd1 req-0221fa8e-7662-40ee-9a30-5140454f9c40 service nova] Acquiring lock "refresh_cache-415808a8-c17b-49bf-8a4e-ac19553cdb19" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:48:54 user nova-compute[74850]: DEBUG nova.network.neutron [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:48:54 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.network.neutron [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Updating instance_info_cache with network_info: [{"id": "745756ea-b360-423f-8258-5339a80658b5", "address": "fa:16:3e:1e:5a:e7", "network": {"id": "0e3f4d71-4998-448f-b706-8ae0f6d0d960", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-245892937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af65f5e7dcc3404292714adcecdd9939", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745756ea-b3", "ovs_interfaceid": "745756ea-b360-423f-8258-5339a80658b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Releasing lock "refresh_cache-4f1102c5-f5ef-48d5-b271-6e25bee5cc70" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.compute.manager [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Instance network_info: |[{"id": "745756ea-b360-423f-8258-5339a80658b5", "address": "fa:16:3e:1e:5a:e7", "network": {"id": "0e3f4d71-4998-448f-b706-8ae0f6d0d960", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-245892937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af65f5e7dcc3404292714adcecdd9939", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745756ea-b3", "ovs_interfaceid": "745756ea-b360-423f-8258-5339a80658b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-756b294d-25fc-468b-8f72-58e6e260a3fa req-008fcd23-0421-4707-adc1-300e3b46ca32 service nova] Acquired lock "refresh_cache-4f1102c5-f5ef-48d5-b271-6e25bee5cc70" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.network.neutron [req-756b294d-25fc-468b-8f72-58e6e260a3fa req-008fcd23-0421-4707-adc1-300e3b46ca32 service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Refreshing network info cache for port 745756ea-b360-423f-8258-5339a80658b5 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Start _get_guest_xml network_info=[{"id": "745756ea-b360-423f-8258-5339a80658b5", "address": "fa:16:3e:1e:5a:e7", "network": {"id": "0e3f4d71-4998-448f-b706-8ae0f6d0d960", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-245892937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af65f5e7dcc3404292714adcecdd9939", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745756ea-b3", "ovs_interfaceid": "745756ea-b360-423f-8258-5339a80658b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:48:55 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:48:55 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:48:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-601800786',display_name='tempest-ServerActionsTestOtherB-server-601800786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-601800786',id=16,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwPveYWJd2P0BbCb28a9iVIK1Zsz5G3BGaDez0xzoCyU4RzkEN+R7LDyKbiUXGXbhQ6BKU8E1EnTC8pc8cZ9B9nXwhdl3wP+4ydXfXlf6SKZGReFXRGfyOHNNyPoLUUDg==',key_name='tempest-keypair-802679501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af65f5e7dcc3404292714adcecdd9939',ramdisk_id='',reservation_id='r-kr9hd7jm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1251502845',owner_user_name='tempest-ServerActionsTestOtherB-1251502845-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:48:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2647a5318ce4cdca3154aef93651505',uuid=4f1102c5-f5ef-48d5-b271-6e25bee5cc70,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "745756ea-b360-423f-8258-5339a80658b5", "address": "fa:16:3e:1e:5a:e7", "network": {"id": "0e3f4d71-4998-448f-b706-8ae0f6d0d960", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-245892937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af65f5e7dcc3404292714adcecdd9939", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745756ea-b3", "ovs_interfaceid": "745756ea-b360-423f-8258-5339a80658b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Converting VIF {"id": "745756ea-b360-423f-8258-5339a80658b5", "address": "fa:16:3e:1e:5a:e7", "network": {"id": "0e3f4d71-4998-448f-b706-8ae0f6d0d960", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-245892937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af65f5e7dcc3404292714adcecdd9939", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745756ea-b3", "ovs_interfaceid": "745756ea-b360-423f-8258-5339a80658b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:5a:e7,bridge_name='br-int',has_traffic_filtering=True,id=745756ea-b360-423f-8258-5339a80658b5,network=Network(0e3f4d71-4998-448f-b706-8ae0f6d0d960),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745756ea-b3') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.objects.instance [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f1102c5-f5ef-48d5-b271-6e25bee5cc70 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.network.neutron [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Updating instance_info_cache with network_info: [{"id": "7cc43262-84fa-474b-ae96-39758aba662b", "address": "fa:16:3e:e0:b6:3c", "network": {"id": "79085ce8-f8ef-4329-b0d4-0eddda52de22", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "58c870909f43417296374f1a23c8af0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc43262-84", "ovs_interfaceid": "7cc43262-84fa-474b-ae96-39758aba662b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:48:55 user nova-compute[74850]:   <uuid>4f1102c5-f5ef-48d5-b271-6e25bee5cc70</uuid>
Nov 14 00:48:55 user nova-compute[74850]:   <name>instance-00000010</name>
Nov 14 00:48:55 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:48:55 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:48:55 user nova-compute[74850]:   <metadata>
Nov 14 00:48:55 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:48:55 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:48:55 user nova-compute[74850]:       <nova:name>tempest-ServerActionsTestOtherB-server-601800786</nova:name>
Nov 14 00:48:55 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:48:55</nova:creationTime>
Nov 14 00:48:55 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:48:55 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:48:55 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:48:55 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:48:55 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:48:55 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:48:55 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:48:55 user nova-compute[74850]:       <nova:owner>
Nov 14 00:48:55 user nova-compute[74850]:         <nova:user uuid="a2647a5318ce4cdca3154aef93651505">tempest-ServerActionsTestOtherB-1251502845-project-member</nova:user>
Nov 14 00:48:55 user nova-compute[74850]:         <nova:project uuid="af65f5e7dcc3404292714adcecdd9939">tempest-ServerActionsTestOtherB-1251502845</nova:project>
Nov 14 00:48:55 user nova-compute[74850]:       </nova:owner>
Nov 14 00:48:55 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:48:55 user nova-compute[74850]:       <nova:ports>
Nov 14 00:48:55 user nova-compute[74850]:         <nova:port uuid="745756ea-b360-423f-8258-5339a80658b5">
Nov 14 00:48:55 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 00:48:55 user nova-compute[74850]:         </nova:port>
Nov 14 00:48:55 user nova-compute[74850]:       </nova:ports>
Nov 14 00:48:55 user nova-compute[74850]:     </nova:instance>
Nov 14 00:48:55 user nova-compute[74850]:   </metadata>
Nov 14 00:48:55 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:48:55 user nova-compute[74850]:     <system>
Nov 14 00:48:55 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:48:55 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:48:55 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:48:55 user nova-compute[74850]:       <entry name="serial">4f1102c5-f5ef-48d5-b271-6e25bee5cc70</entry>
Nov 14 00:48:55 user nova-compute[74850]:       <entry name="uuid">4f1102c5-f5ef-48d5-b271-6e25bee5cc70</entry>
Nov 14 00:48:55 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:48:55 user nova-compute[74850]:     </system>
Nov 14 00:48:55 user nova-compute[74850]:   </sysinfo>
Nov 14 00:48:55 user nova-compute[74850]:   <os>
Nov 14 00:48:55 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:48:55 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 00:48:55 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:48:55 user nova-compute[74850]:   </os>
Nov 14 00:48:55 user nova-compute[74850]:   <features>
Nov 14 00:48:55 user nova-compute[74850]:     <acpi/>
Nov 14 00:48:55 user nova-compute[74850]:     <apic/>
Nov 14 00:48:55 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:48:55 user nova-compute[74850]:   </features>
Nov 14 00:48:55 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:48:55 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:48:55 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:48:55 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:48:55 user nova-compute[74850]:   </clock>
Nov 14 00:48:55 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:48:55 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:48:55 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:48:55 user nova-compute[74850]:   </cpu>
Nov 14 00:48:55 user nova-compute[74850]:   <devices>
Nov 14 00:48:55 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 00:48:55 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:48:55 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk"/>
Nov 14 00:48:55 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:48:55 user nova-compute[74850]:     </disk>
Nov 14 00:48:55 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:48:55 user nova-compute[74850]:       <mac address="fa:16:3e:1e:5a:e7"/>
Nov 14 00:48:55 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:48:55 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:48:55 user nova-compute[74850]:       <target dev="tap745756ea-b3"/>
Nov 14 00:48:55 user nova-compute[74850]:     </interface>
Nov 14 00:48:55 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:48:55 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/console.log" append="off"/>
Nov 14 00:48:55 user nova-compute[74850]:     </serial>
Nov 14 00:48:55 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:48:55 user nova-compute[74850]:     <video>
Nov 14 00:48:55 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:48:55 user nova-compute[74850]:     </video>
Nov 14 00:48:55 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:48:55 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:48:55 user nova-compute[74850]:     </rng>
Nov 14 00:48:55 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:48:55 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:48:55 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:48:55 user nova-compute[74850]:     </memballoon>
Nov 14 00:48:55 user nova-compute[74850]:   </devices>
Nov 14 00:48:55 user nova-compute[74850]: </domain>
Nov 14 00:48:55 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:48:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-601800786',display_name='tempest-ServerActionsTestOtherB-server-601800786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-601800786',id=16,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwPveYWJd2P0BbCb28a9iVIK1Zsz5G3BGaDez0xzoCyU4RzkEN+R7LDyKbiUXGXbhQ6BKU8E1EnTC8pc8cZ9B9nXwhdl3wP+4ydXfXlf6SKZGReFXRGfyOHNNyPoLUUDg==',key_name='tempest-keypair-802679501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af65f5e7dcc3404292714adcecdd9939',ramdisk_id='',reservation_id='r-kr9hd7jm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1251502845',owner_user_name='tempest-ServerActionsTestOtherB-1251502845-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:48:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2647a5318ce4cdca3154aef93651505',uuid=4f1102c5-f5ef-48d5-b271-6e25bee5cc70,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "745756ea-b360-423f-8258-5339a80658b5", "address": "fa:16:3e:1e:5a:e7", "network": {"id": "0e3f4d71-4998-448f-b706-8ae0f6d0d960", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-245892937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af65f5e7dcc3404292714adcecdd9939", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745756ea-b3", "ovs_interfaceid": "745756ea-b360-423f-8258-5339a80658b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Converting VIF {"id": "745756ea-b360-423f-8258-5339a80658b5", "address": "fa:16:3e:1e:5a:e7", "network": {"id": "0e3f4d71-4998-448f-b706-8ae0f6d0d960", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-245892937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af65f5e7dcc3404292714adcecdd9939", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745756ea-b3", "ovs_interfaceid": "745756ea-b360-423f-8258-5339a80658b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:5a:e7,bridge_name='br-int',has_traffic_filtering=True,id=745756ea-b360-423f-8258-5339a80658b5,network=Network(0e3f4d71-4998-448f-b706-8ae0f6d0d960),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745756ea-b3') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG os_vif [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:5a:e7,bridge_name='br-int',has_traffic_filtering=True,id=745756ea-b360-423f-8258-5339a80658b5,network=Network(0e3f4d71-4998-448f-b706-8ae0f6d0d960),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745756ea-b3') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5c741d96-38cb-574c-be22-7f2400d549d5', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Releasing lock "refresh_cache-415808a8-c17b-49bf-8a4e-ac19553cdb19" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.compute.manager [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Instance network_info: |[{"id": "7cc43262-84fa-474b-ae96-39758aba662b", "address": "fa:16:3e:e0:b6:3c", "network": {"id": "79085ce8-f8ef-4329-b0d4-0eddda52de22", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "58c870909f43417296374f1a23c8af0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc43262-84", "ovs_interfaceid": "7cc43262-84fa-474b-ae96-39758aba662b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-cb787807-490a-45ce-af8a-3363927a1bd1 req-0221fa8e-7662-40ee-9a30-5140454f9c40 service nova] Acquired lock "refresh_cache-415808a8-c17b-49bf-8a4e-ac19553cdb19" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.network.neutron [req-cb787807-490a-45ce-af8a-3363927a1bd1 req-0221fa8e-7662-40ee-9a30-5140454f9c40 service nova] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Refreshing network info cache for port 7cc43262-84fa-474b-ae96-39758aba662b {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Start _get_guest_xml network_info=[{"id": "7cc43262-84fa-474b-ae96-39758aba662b", "address": "fa:16:3e:e0:b6:3c", "network": {"id": "79085ce8-f8ef-4329-b0d4-0eddda52de22", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "58c870909f43417296374f1a23c8af0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc43262-84", "ovs_interfaceid": "7cc43262-84fa-474b-ae96-39758aba662b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap745756ea-b3, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap745756ea-b3, col_values=(('qos', UUID('e0a37cde-095d-4385-b6c0-29e16b1fbbad')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap745756ea-b3, col_values=(('external_ids', {'iface-id': '745756ea-b360-423f-8258-5339a80658b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:5a:e7', 'vm-uuid': '4f1102c5-f5ef-48d5-b271-6e25bee5cc70'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:55 user nova-compute[74850]: INFO os_vif [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:5a:e7,bridge_name='br-int',has_traffic_filtering=True,id=745756ea-b360-423f-8258-5339a80658b5,network=Network(0e3f4d71-4998-448f-b706-8ae0f6d0d960),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745756ea-b3')
Nov 14 00:48:55 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:48:55 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1471401823',display_name='tempest-VolumesNegativeTest-instance-1471401823',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1471401823',id=15,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3cb14c69af840f7aa2f61d57c0fa31d',ramdisk_id='',reservation_id='r-cub7jtxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1112214089',owner_user_name='tempest-VolumesNegativeTest-1112214089-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:48:52Z,user_data=None,user_id='75dd785464c744d2bd90259ae57ca4eb',uuid=415808a8-c17b-49bf-8a4e-ac19553cdb19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cc43262-84fa-474b-ae96-39758aba662b", "address": "fa:16:3e:e0:b6:3c", "network": {"id": "79085ce8-f8ef-4329-b0d4-0eddda52de22", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "58c870909f43417296374f1a23c8af0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc43262-84", "ovs_interfaceid": "7cc43262-84fa-474b-ae96-39758aba662b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Converting VIF {"id": "7cc43262-84fa-474b-ae96-39758aba662b", "address": "fa:16:3e:e0:b6:3c", "network": {"id": "79085ce8-f8ef-4329-b0d4-0eddda52de22", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "58c870909f43417296374f1a23c8af0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc43262-84", "ovs_interfaceid": "7cc43262-84fa-474b-ae96-39758aba662b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:b6:3c,bridge_name='br-int',has_traffic_filtering=True,id=7cc43262-84fa-474b-ae96-39758aba662b,network=Network(79085ce8-f8ef-4329-b0d4-0eddda52de22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc43262-84') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.objects.instance [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Lazy-loading 'pci_devices' on Instance uuid 415808a8-c17b-49bf-8a4e-ac19553cdb19 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:48:55 user nova-compute[74850]:   <uuid>415808a8-c17b-49bf-8a4e-ac19553cdb19</uuid>
Nov 14 00:48:55 user nova-compute[74850]:   <name>instance-0000000f</name>
Nov 14 00:48:55 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:48:55 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:48:55 user nova-compute[74850]:   <metadata>
Nov 14 00:48:55 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:48:55 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:48:55 user nova-compute[74850]:       <nova:name>tempest-VolumesNegativeTest-instance-1471401823</nova:name>
Nov 14 00:48:55 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:48:55</nova:creationTime>
Nov 14 00:48:55 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:48:55 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:48:55 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:48:55 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:48:55 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:48:55 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:48:55 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:48:55 user nova-compute[74850]:       <nova:owner>
Nov 14 00:48:55 user nova-compute[74850]:         <nova:user uuid="75dd785464c744d2bd90259ae57ca4eb">tempest-VolumesNegativeTest-1112214089-project-member</nova:user>
Nov 14 00:48:55 user nova-compute[74850]:         <nova:project uuid="f3cb14c69af840f7aa2f61d57c0fa31d">tempest-VolumesNegativeTest-1112214089</nova:project>
Nov 14 00:48:55 user nova-compute[74850]:       </nova:owner>
Nov 14 00:48:55 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:48:55 user nova-compute[74850]:       <nova:ports>
Nov 14 00:48:55 user nova-compute[74850]:         <nova:port uuid="7cc43262-84fa-474b-ae96-39758aba662b">
Nov 14 00:48:55 user nova-compute[74850]:           <nova:ip type="fixed" address="192.168.233.99" ipVersion="4"/>
Nov 14 00:48:55 user nova-compute[74850]:         </nova:port>
Nov 14 00:48:55 user nova-compute[74850]:       </nova:ports>
Nov 14 00:48:55 user nova-compute[74850]:     </nova:instance>
Nov 14 00:48:55 user nova-compute[74850]:   </metadata>
Nov 14 00:48:55 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:48:55 user nova-compute[74850]:     <system>
Nov 14 00:48:55 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:48:55 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:48:55 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:48:55 user nova-compute[74850]:       <entry name="serial">415808a8-c17b-49bf-8a4e-ac19553cdb19</entry>
Nov 14 00:48:55 user nova-compute[74850]:       <entry name="uuid">415808a8-c17b-49bf-8a4e-ac19553cdb19</entry>
Nov 14 00:48:55 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:48:55 user nova-compute[74850]:     </system>
Nov 14 00:48:55 user nova-compute[74850]:   </sysinfo>
Nov 14 00:48:55 user nova-compute[74850]:   <os>
Nov 14 00:48:55 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:48:55 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 00:48:55 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:48:55 user nova-compute[74850]:   </os>
Nov 14 00:48:55 user nova-compute[74850]:   <features>
Nov 14 00:48:55 user nova-compute[74850]:     <acpi/>
Nov 14 00:48:55 user nova-compute[74850]:     <apic/>
Nov 14 00:48:55 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:48:55 user nova-compute[74850]:   </features>
Nov 14 00:48:55 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:48:55 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:48:55 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:48:55 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:48:55 user nova-compute[74850]:   </clock>
Nov 14 00:48:55 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:48:55 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:48:55 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:48:55 user nova-compute[74850]:   </cpu>
Nov 14 00:48:55 user nova-compute[74850]:   <devices>
Nov 14 00:48:55 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 00:48:55 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:48:55 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/415808a8-c17b-49bf-8a4e-ac19553cdb19/disk"/>
Nov 14 00:48:55 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:48:55 user nova-compute[74850]:     </disk>
Nov 14 00:48:55 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:48:55 user nova-compute[74850]:       <mac address="fa:16:3e:e0:b6:3c"/>
Nov 14 00:48:55 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:48:55 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:48:55 user nova-compute[74850]:       <target dev="tap7cc43262-84"/>
Nov 14 00:48:55 user nova-compute[74850]:     </interface>
Nov 14 00:48:55 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:48:55 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/415808a8-c17b-49bf-8a4e-ac19553cdb19/console.log" append="off"/>
Nov 14 00:48:55 user nova-compute[74850]:     </serial>
Nov 14 00:48:55 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:48:55 user nova-compute[74850]:     <video>
Nov 14 00:48:55 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:48:55 user nova-compute[74850]:     </video>
Nov 14 00:48:55 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:48:55 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:48:55 user nova-compute[74850]:     </rng>
Nov 14 00:48:55 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:48:55 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:48:55 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:48:55 user nova-compute[74850]:     </memballoon>
Nov 14 00:48:55 user nova-compute[74850]:   </devices>
Nov 14 00:48:55 user nova-compute[74850]: </domain>
Nov 14 00:48:55 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1471401823',display_name='tempest-VolumesNegativeTest-instance-1471401823',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1471401823',id=15,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3cb14c69af840f7aa2f61d57c0fa31d',ramdisk_id='',reservation_id='r-cub7jtxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1112214089',owner_user_name='tempest-VolumesNegativeTest-1112214089-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:48:52Z,user_data=None,user_id='75dd785464c744d2bd90259ae57ca4eb',uuid=415808a8-c17b-49bf-8a4e-ac19553cdb19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cc43262-84fa-474b-ae96-39758aba662b", "address": "fa:16:3e:e0:b6:3c", "network": {"id": "79085ce8-f8ef-4329-b0d4-0eddda52de22", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "58c870909f43417296374f1a23c8af0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc43262-84", "ovs_interfaceid": "7cc43262-84fa-474b-ae96-39758aba662b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Converting VIF {"id": "7cc43262-84fa-474b-ae96-39758aba662b", "address": "fa:16:3e:e0:b6:3c", "network": {"id": "79085ce8-f8ef-4329-b0d4-0eddda52de22", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "58c870909f43417296374f1a23c8af0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc43262-84", "ovs_interfaceid": "7cc43262-84fa-474b-ae96-39758aba662b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:b6:3c,bridge_name='br-int',has_traffic_filtering=True,id=7cc43262-84fa-474b-ae96-39758aba662b,network=Network(79085ce8-f8ef-4329-b0d4-0eddda52de22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc43262-84') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG os_vif [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:b6:3c,bridge_name='br-int',has_traffic_filtering=True,id=7cc43262-84fa-474b-ae96-39758aba662b,network=Network(79085ce8-f8ef-4329-b0d4-0eddda52de22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc43262-84') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dbb29de0-c287-50f7-be28-6f30b59b9d81', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] No VIF found with MAC fa:16:3e:1e:5a:e7, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7cc43262-84, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7cc43262-84, col_values=(('qos', UUID('853f688e-edf2-4c6b-914c-29ecfb02342a')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7cc43262-84, col_values=(('external_ids', {'iface-id': '7cc43262-84fa-474b-ae96-39758aba662b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:b6:3c', 'vm-uuid': '415808a8-c17b-49bf-8a4e-ac19553cdb19'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:55 user nova-compute[74850]: INFO os_vif [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:b6:3c,bridge_name='br-int',has_traffic_filtering=True,id=7cc43262-84fa-474b-ae96-39758aba662b,network=Network(79085ce8-f8ef-4329-b0d4-0eddda52de22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc43262-84')
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] No VIF found with MAC fa:16:3e:e0:b6:3c, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.network.neutron [req-756b294d-25fc-468b-8f72-58e6e260a3fa req-008fcd23-0421-4707-adc1-300e3b46ca32 service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Updated VIF entry in instance network info cache for port 745756ea-b360-423f-8258-5339a80658b5. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG nova.network.neutron [req-756b294d-25fc-468b-8f72-58e6e260a3fa req-008fcd23-0421-4707-adc1-300e3b46ca32 service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Updating instance_info_cache with network_info: [{"id": "745756ea-b360-423f-8258-5339a80658b5", "address": "fa:16:3e:1e:5a:e7", "network": {"id": "0e3f4d71-4998-448f-b706-8ae0f6d0d960", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-245892937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af65f5e7dcc3404292714adcecdd9939", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745756ea-b3", "ovs_interfaceid": "745756ea-b360-423f-8258-5339a80658b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:48:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-756b294d-25fc-468b-8f72-58e6e260a3fa req-008fcd23-0421-4707-adc1-300e3b46ca32 service nova] Releasing lock "refresh_cache-4f1102c5-f5ef-48d5-b271-6e25bee5cc70" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:48:56 user nova-compute[74850]: DEBUG nova.network.neutron [req-cb787807-490a-45ce-af8a-3363927a1bd1 req-0221fa8e-7662-40ee-9a30-5140454f9c40 service nova] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Updated VIF entry in instance network info cache for port 7cc43262-84fa-474b-ae96-39758aba662b. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:48:56 user nova-compute[74850]: DEBUG nova.network.neutron [req-cb787807-490a-45ce-af8a-3363927a1bd1 req-0221fa8e-7662-40ee-9a30-5140454f9c40 service nova] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Updating instance_info_cache with network_info: [{"id": "7cc43262-84fa-474b-ae96-39758aba662b", "address": "fa:16:3e:e0:b6:3c", "network": {"id": "79085ce8-f8ef-4329-b0d4-0eddda52de22", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "58c870909f43417296374f1a23c8af0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc43262-84", "ovs_interfaceid": "7cc43262-84fa-474b-ae96-39758aba662b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:48:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-cb787807-490a-45ce-af8a-3363927a1bd1 req-0221fa8e-7662-40ee-9a30-5140454f9c40 service nova] Releasing lock "refresh_cache-415808a8-c17b-49bf-8a4e-ac19553cdb19" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:48:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Acquiring lock "7f115ae8-49da-4bf5-ae7c-62696769420c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:48:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lock "7f115ae8-49da-4bf5-ae7c-62696769420c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:48:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:57 user nova-compute[74850]: DEBUG nova.compute.manager [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 00:48:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:48:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:48:57 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 00:48:57 user nova-compute[74850]: INFO nova.compute.claims [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Claim successful on node user
Nov 14 00:48:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:58 user nova-compute[74850]: DEBUG nova.compute.manager [req-8b1ec148-4fe5-459d-ab3e-b2d7a643272e req-9274a81d-9d08-4644-b8fb-55bfbea9d73d service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Received event network-vif-plugged-745756ea-b360-423f-8258-5339a80658b5 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:48:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-8b1ec148-4fe5-459d-ab3e-b2d7a643272e req-9274a81d-9d08-4644-b8fb-55bfbea9d73d service nova] Acquiring lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:48:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-8b1ec148-4fe5-459d-ab3e-b2d7a643272e req-9274a81d-9d08-4644-b8fb-55bfbea9d73d service nova] Lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:48:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-8b1ec148-4fe5-459d-ab3e-b2d7a643272e req-9274a81d-9d08-4644-b8fb-55bfbea9d73d service nova] Lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:48:58 user nova-compute[74850]: DEBUG nova.compute.manager [req-8b1ec148-4fe5-459d-ab3e-b2d7a643272e req-9274a81d-9d08-4644-b8fb-55bfbea9d73d service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] No waiting events found dispatching network-vif-plugged-745756ea-b360-423f-8258-5339a80658b5 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:48:58 user nova-compute[74850]: WARNING nova.compute.manager [req-8b1ec148-4fe5-459d-ab3e-b2d7a643272e req-9274a81d-9d08-4644-b8fb-55bfbea9d73d service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Received unexpected event network-vif-plugged-745756ea-b360-423f-8258-5339a80658b5 for instance with vm_state building and task_state spawning.
Nov 14 00:48:58 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:48:58 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:48:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.513s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:48:58 user nova-compute[74850]: DEBUG nova.compute.manager [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 00:48:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:58 user nova-compute[74850]: DEBUG nova.compute.manager [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 00:48:58 user nova-compute[74850]: DEBUG nova.network.neutron [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 00:48:58 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 00:48:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:58 user nova-compute[74850]: DEBUG nova.compute.manager [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 00:48:58 user nova-compute[74850]: DEBUG nova.policy [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cebab0c5f0c74784a0d09a696a9b62d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29bf565027342a8ac084f1fd0a9b3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 00:48:58 user nova-compute[74850]: DEBUG nova.compute.manager [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 00:48:58 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 00:48:58 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Creating image(s)
Nov 14 00:48:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Acquiring lock "/opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:48:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lock "/opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:48:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lock "/opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:48:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.182s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:48:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:48:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.185s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/disk 1073741824" returned: 0 in 0.052s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:48:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:48:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.219s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:59 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 00:48:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:48:59 user nova-compute[74850]: DEBUG nova.network.neutron [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Successfully created port: 667273cd-1700-465f-895e-6a1a093f44d8 {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:48:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:48:59 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Cannot resize image /opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 00:48:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 00:48:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Ensure instance console log exists: /opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 00:48:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:48:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:48:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:48:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.network.neutron [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Successfully updated port: 667273cd-1700-465f-895e-6a1a093f44d8 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Acquiring lock "refresh_cache-7f115ae8-49da-4bf5-ae7c-62696769420c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Acquired lock "refresh_cache-7f115ae8-49da-4bf5-ae7c-62696769420c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.network.neutron [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.compute.manager [req-c798d894-de8a-4cce-83b0-e57ab180cfdb req-cca9d295-0a83-4726-9dee-dee39cff3448 service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Received event network-changed-667273cd-1700-465f-895e-6a1a093f44d8 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.compute.manager [req-c798d894-de8a-4cce-83b0-e57ab180cfdb req-cca9d295-0a83-4726-9dee-dee39cff3448 service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Refreshing instance network info cache due to event network-changed-667273cd-1700-465f-895e-6a1a093f44d8. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c798d894-de8a-4cce-83b0-e57ab180cfdb req-cca9d295-0a83-4726-9dee-dee39cff3448 service nova] Acquiring lock "refresh_cache-7f115ae8-49da-4bf5-ae7c-62696769420c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.network.neutron [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.compute.manager [req-f07a5662-db48-46bc-aa7e-0036506bcded req-53b9db86-d440-47dc-a835-db606675ff23 service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Received event network-vif-plugged-745756ea-b360-423f-8258-5339a80658b5 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f07a5662-db48-46bc-aa7e-0036506bcded req-53b9db86-d440-47dc-a835-db606675ff23 service nova] Acquiring lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f07a5662-db48-46bc-aa7e-0036506bcded req-53b9db86-d440-47dc-a835-db606675ff23 service nova] Lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f07a5662-db48-46bc-aa7e-0036506bcded req-53b9db86-d440-47dc-a835-db606675ff23 service nova] Lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.compute.manager [req-f07a5662-db48-46bc-aa7e-0036506bcded req-53b9db86-d440-47dc-a835-db606675ff23 service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] No waiting events found dispatching network-vif-plugged-745756ea-b360-423f-8258-5339a80658b5 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:49:00 user nova-compute[74850]: WARNING nova.compute.manager [req-f07a5662-db48-46bc-aa7e-0036506bcded req-53b9db86-d440-47dc-a835-db606675ff23 service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Received unexpected event network-vif-plugged-745756ea-b360-423f-8258-5339a80658b5 for instance with vm_state building and task_state spawning.
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.network.neutron [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Updating instance_info_cache with network_info: [{"id": "667273cd-1700-465f-895e-6a1a093f44d8", "address": "fa:16:3e:d1:ab:73", "network": {"id": "db78a7e7-17dd-4ef3-940d-96d93df45daa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1114583145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b29bf565027342a8ac084f1fd0a9b3f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap667273cd-17", "ovs_interfaceid": "667273cd-1700-465f-895e-6a1a093f44d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Releasing lock "refresh_cache-7f115ae8-49da-4bf5-ae7c-62696769420c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.compute.manager [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Instance network_info: |[{"id": "667273cd-1700-465f-895e-6a1a093f44d8", "address": "fa:16:3e:d1:ab:73", "network": {"id": "db78a7e7-17dd-4ef3-940d-96d93df45daa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1114583145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b29bf565027342a8ac084f1fd0a9b3f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap667273cd-17", "ovs_interfaceid": "667273cd-1700-465f-895e-6a1a093f44d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c798d894-de8a-4cce-83b0-e57ab180cfdb req-cca9d295-0a83-4726-9dee-dee39cff3448 service nova] Acquired lock "refresh_cache-7f115ae8-49da-4bf5-ae7c-62696769420c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.network.neutron [req-c798d894-de8a-4cce-83b0-e57ab180cfdb req-cca9d295-0a83-4726-9dee-dee39cff3448 service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Refreshing network info cache for port 667273cd-1700-465f-895e-6a1a093f44d8 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Start _get_guest_xml network_info=[{"id": "667273cd-1700-465f-895e-6a1a093f44d8", "address": "fa:16:3e:d1:ab:73", "network": {"id": "db78a7e7-17dd-4ef3-940d-96d93df45daa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1114583145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b29bf565027342a8ac084f1fd0a9b3f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap667273cd-17", "ovs_interfaceid": "667273cd-1700-465f-895e-6a1a093f44d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:49:00 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:49:00 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-622477935',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-622477935',id=17,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBGvhns7XWVf/haNp2AKmH5EhvuBpoE+TGi/Wza7qjLEHR4vfwIGfr3qwoxrfGTiid4eBr+1xVTKisgYQUIZxBKIACazg/Q7FT120267dvZKdM6cwjXC2T4hWuncWpIGw==',key_name='tempest-keypair-783468073',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b29bf565027342a8ac084f1fd0a9b3f5',ramdisk_id='',reservation_id='r-n5valy8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1948159451',owner_user_name='tempest-TaggedAttachmentsTest-1948159451-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:48:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cebab0c5f0c74784a0d09a696a9b62d8',uuid=7f115ae8-49da-4bf5-ae7c-62696769420c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "667273cd-1700-465f-895e-6a1a093f44d8", "address": "fa:16:3e:d1:ab:73", "network": {"id": "db78a7e7-17dd-4ef3-940d-96d93df45daa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1114583145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b29bf565027342a8ac084f1fd0a9b3f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap667273cd-17", "ovs_interfaceid": "667273cd-1700-465f-895e-6a1a093f44d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Converting VIF {"id": "667273cd-1700-465f-895e-6a1a093f44d8", "address": "fa:16:3e:d1:ab:73", "network": {"id": "db78a7e7-17dd-4ef3-940d-96d93df45daa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1114583145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b29bf565027342a8ac084f1fd0a9b3f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap667273cd-17", "ovs_interfaceid": "667273cd-1700-465f-895e-6a1a093f44d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:ab:73,bridge_name='br-int',has_traffic_filtering=True,id=667273cd-1700-465f-895e-6a1a093f44d8,network=Network(db78a7e7-17dd-4ef3-940d-96d93df45daa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap667273cd-17') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.objects.instance [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f115ae8-49da-4bf5-ae7c-62696769420c {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:49:00 user nova-compute[74850]:   <uuid>7f115ae8-49da-4bf5-ae7c-62696769420c</uuid>
Nov 14 00:49:00 user nova-compute[74850]:   <name>instance-00000011</name>
Nov 14 00:49:00 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:49:00 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:49:00 user nova-compute[74850]:   <metadata>
Nov 14 00:49:00 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:49:00 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:49:00 user nova-compute[74850]:       <nova:name>tempest-device-tagging-server-622477935</nova:name>
Nov 14 00:49:00 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:49:00</nova:creationTime>
Nov 14 00:49:00 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:49:00 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:49:00 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:49:00 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:49:00 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:49:00 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:49:00 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:49:00 user nova-compute[74850]:       <nova:owner>
Nov 14 00:49:00 user nova-compute[74850]:         <nova:user uuid="cebab0c5f0c74784a0d09a696a9b62d8">tempest-TaggedAttachmentsTest-1948159451-project-member</nova:user>
Nov 14 00:49:00 user nova-compute[74850]:         <nova:project uuid="b29bf565027342a8ac084f1fd0a9b3f5">tempest-TaggedAttachmentsTest-1948159451</nova:project>
Nov 14 00:49:00 user nova-compute[74850]:       </nova:owner>
Nov 14 00:49:00 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:49:00 user nova-compute[74850]:       <nova:ports>
Nov 14 00:49:00 user nova-compute[74850]:         <nova:port uuid="667273cd-1700-465f-895e-6a1a093f44d8">
Nov 14 00:49:00 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 00:49:00 user nova-compute[74850]:         </nova:port>
Nov 14 00:49:00 user nova-compute[74850]:       </nova:ports>
Nov 14 00:49:00 user nova-compute[74850]:     </nova:instance>
Nov 14 00:49:00 user nova-compute[74850]:   </metadata>
Nov 14 00:49:00 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:49:00 user nova-compute[74850]:     <system>
Nov 14 00:49:00 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:49:00 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:49:00 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:49:00 user nova-compute[74850]:       <entry name="serial">7f115ae8-49da-4bf5-ae7c-62696769420c</entry>
Nov 14 00:49:00 user nova-compute[74850]:       <entry name="uuid">7f115ae8-49da-4bf5-ae7c-62696769420c</entry>
Nov 14 00:49:00 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:49:00 user nova-compute[74850]:     </system>
Nov 14 00:49:00 user nova-compute[74850]:   </sysinfo>
Nov 14 00:49:00 user nova-compute[74850]:   <os>
Nov 14 00:49:00 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:49:00 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 00:49:00 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:49:00 user nova-compute[74850]:   </os>
Nov 14 00:49:00 user nova-compute[74850]:   <features>
Nov 14 00:49:00 user nova-compute[74850]:     <acpi/>
Nov 14 00:49:00 user nova-compute[74850]:     <apic/>
Nov 14 00:49:00 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:49:00 user nova-compute[74850]:   </features>
Nov 14 00:49:00 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:49:00 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:49:00 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:49:00 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:49:00 user nova-compute[74850]:   </clock>
Nov 14 00:49:00 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:49:00 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:49:00 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:49:00 user nova-compute[74850]:   </cpu>
Nov 14 00:49:00 user nova-compute[74850]:   <devices>
Nov 14 00:49:00 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 00:49:00 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:49:00 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/disk"/>
Nov 14 00:49:00 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:49:00 user nova-compute[74850]:     </disk>
Nov 14 00:49:00 user nova-compute[74850]:     <disk type="file" device="cdrom">
Nov 14 00:49:00 user nova-compute[74850]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 00:49:00 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/disk.config"/>
Nov 14 00:49:00 user nova-compute[74850]:       <target dev="hda" bus="ide"/>
Nov 14 00:49:00 user nova-compute[74850]:     </disk>
Nov 14 00:49:00 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:49:00 user nova-compute[74850]:       <mac address="fa:16:3e:d1:ab:73"/>
Nov 14 00:49:00 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:49:00 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:49:00 user nova-compute[74850]:       <target dev="tap667273cd-17"/>
Nov 14 00:49:00 user nova-compute[74850]:     </interface>
Nov 14 00:49:00 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:49:00 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/console.log" append="off"/>
Nov 14 00:49:00 user nova-compute[74850]:     </serial>
Nov 14 00:49:00 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:49:00 user nova-compute[74850]:     <video>
Nov 14 00:49:00 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:49:00 user nova-compute[74850]:     </video>
Nov 14 00:49:00 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:49:00 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:49:00 user nova-compute[74850]:     </rng>
Nov 14 00:49:00 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:49:00 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:49:00 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:49:00 user nova-compute[74850]:     </memballoon>
Nov 14 00:49:00 user nova-compute[74850]:   </devices>
Nov 14 00:49:00 user nova-compute[74850]: </domain>
Nov 14 00:49:00 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-622477935',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-622477935',id=17,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBGvhns7XWVf/haNp2AKmH5EhvuBpoE+TGi/Wza7qjLEHR4vfwIGfr3qwoxrfGTiid4eBr+1xVTKisgYQUIZxBKIACazg/Q7FT120267dvZKdM6cwjXC2T4hWuncWpIGw==',key_name='tempest-keypair-783468073',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b29bf565027342a8ac084f1fd0a9b3f5',ramdisk_id='',reservation_id='r-n5valy8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1948159451',owner_user_name='tempest-TaggedAttachmentsTest-1948159451-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:48:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cebab0c5f0c74784a0d09a696a9b62d8',uuid=7f115ae8-49da-4bf5-ae7c-62696769420c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "667273cd-1700-465f-895e-6a1a093f44d8", "address": "fa:16:3e:d1:ab:73", "network": {"id": "db78a7e7-17dd-4ef3-940d-96d93df45daa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1114583145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b29bf565027342a8ac084f1fd0a9b3f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap667273cd-17", "ovs_interfaceid": "667273cd-1700-465f-895e-6a1a093f44d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Converting VIF {"id": "667273cd-1700-465f-895e-6a1a093f44d8", "address": "fa:16:3e:d1:ab:73", "network": {"id": "db78a7e7-17dd-4ef3-940d-96d93df45daa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1114583145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b29bf565027342a8ac084f1fd0a9b3f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap667273cd-17", "ovs_interfaceid": "667273cd-1700-465f-895e-6a1a093f44d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:ab:73,bridge_name='br-int',has_traffic_filtering=True,id=667273cd-1700-465f-895e-6a1a093f44d8,network=Network(db78a7e7-17dd-4ef3-940d-96d93df45daa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap667273cd-17') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG os_vif [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:ab:73,bridge_name='br-int',has_traffic_filtering=True,id=667273cd-1700-465f-895e-6a1a093f44d8,network=Network(db78a7e7-17dd-4ef3-940d-96d93df45daa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap667273cd-17') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a0ff2f1b-11b0-56bf-b8ef-0c08c74327b6', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap667273cd-17, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap667273cd-17, col_values=(('qos', UUID('7585c258-497a-4ebd-9c89-6538157d85b9')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap667273cd-17, col_values=(('external_ids', {'iface-id': '667273cd-1700-465f-895e-6a1a093f44d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:ab:73', 'vm-uuid': '7f115ae8-49da-4bf5-ae7c-62696769420c'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:00 user nova-compute[74850]: INFO os_vif [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:ab:73,bridge_name='br-int',has_traffic_filtering=True,id=667273cd-1700-465f-895e-6a1a093f44d8,network=Network(db78a7e7-17dd-4ef3-940d-96d93df45daa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap667273cd-17')
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.compute.manager [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 00:49:00 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Instance spawned successfully.
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.compute.manager [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 00:49:00 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Instance spawned successfully.
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] No BDM found with device name hda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] No VIF found with MAC fa:16:3e:d1:ab:73, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:49:00 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Using config drive
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:49:00 user nova-compute[74850]: INFO nova.compute.manager [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Took 7.35 seconds to spawn the instance on the hypervisor.
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.compute.manager [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Acquiring lock "b54b37bc-8c90-4c48-a943-e489e830b93b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Lock "b54b37bc-8c90-4c48-a943-e489e830b93b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Acquiring lock "b54b37bc-8c90-4c48-a943-e489e830b93b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Lock "b54b37bc-8c90-4c48-a943-e489e830b93b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Lock "b54b37bc-8c90-4c48-a943-e489e830b93b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:00 user nova-compute[74850]: INFO nova.compute.manager [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Terminating instance
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.compute.manager [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 00:49:00 user nova-compute[74850]: INFO nova.compute.manager [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Took 8.84 seconds to spawn the instance on the hypervisor.
Nov 14 00:49:00 user nova-compute[74850]: DEBUG nova.compute.manager [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:49:01 user nova-compute[74850]: INFO nova.compute.manager [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Took 8.08 seconds to build instance.
Nov 14 00:49:01 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Creating config drive at /opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/disk.config
Nov 14 00:49:01 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppgctoj94 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a24a20f4-581c-461c-b607-16b95ec7ee61 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.271s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:01 user nova-compute[74850]: DEBUG nova.network.neutron [req-c798d894-de8a-4cce-83b0-e57ab180cfdb req-cca9d295-0a83-4726-9dee-dee39cff3448 service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Updated VIF entry in instance network info cache for port 667273cd-1700-465f-895e-6a1a093f44d8. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:49:01 user nova-compute[74850]: DEBUG nova.network.neutron [req-c798d894-de8a-4cce-83b0-e57ab180cfdb req-cca9d295-0a83-4726-9dee-dee39cff3448 service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Updating instance_info_cache with network_info: [{"id": "667273cd-1700-465f-895e-6a1a093f44d8", "address": "fa:16:3e:d1:ab:73", "network": {"id": "db78a7e7-17dd-4ef3-940d-96d93df45daa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1114583145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b29bf565027342a8ac084f1fd0a9b3f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap667273cd-17", "ovs_interfaceid": "667273cd-1700-465f-895e-6a1a093f44d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:49:01 user nova-compute[74850]: INFO nova.compute.manager [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Took 9.59 seconds to build instance.
Nov 14 00:49:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2f10dd53-f92b-4d25-8f46-c7e23d6432eb tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Lock "415808a8-c17b-49bf-8a4e-ac19553cdb19" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.685s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c798d894-de8a-4cce-83b0-e57ab180cfdb req-cca9d295-0a83-4726-9dee-dee39cff3448 service nova] Releasing lock "refresh_cache-7f115ae8-49da-4bf5-ae7c-62696769420c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:49:01 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppgctoj94" returned: 0 in 0.135s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Acquiring lock "4b60ac08-e954-46d5-a280-a11146b3ebf4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lock "4b60ac08-e954-46d5-a280-a11146b3ebf4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:01 user nova-compute[74850]: DEBUG nova.compute.manager [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 00:49:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:01 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 00:49:01 user nova-compute[74850]: INFO nova.compute.claims [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Claim successful on node user
Nov 14 00:49:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:01 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:49:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:01 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:49:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.566s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:01 user nova-compute[74850]: DEBUG nova.compute.manager [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG nova.compute.manager [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG nova.network.neutron [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 00:49:02 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 00:49:02 user nova-compute[74850]: DEBUG nova.compute.manager [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 00:49:02 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Instance destroyed successfully.
Nov 14 00:49:02 user nova-compute[74850]: DEBUG nova.objects.instance [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Lazy-loading 'resources' on Instance uuid b54b37bc-8c90-4c48-a943-e489e830b93b {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T00:45:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1046338121',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1407646081',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6k6B6AwbocNisCO4Eq2JgavF/MwPMPgsSfJ4CZC+5MU8+G1Higk1jdnJvqwYlgQxsBYLb1AOlev2ixcNIA7eSaJMrT6i+cl48pJKEqDssTEhOLedhY/A00Q2wZRBoCKw==',key_name='tempest-keypair-1347631522',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:47:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c05ffa95fcf49d6a87d6dad2b3f0983',ramdisk_id='',reservation_id='r-3ge02sav',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-676489401',owner_user_name='tempest-ServerActionsV293TestJSON-676489401-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:47:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a609a827db1a4e2ca232e7bc8880ed0b',uuid=b54b37bc-8c90-4c48-a943-e489e830b93b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5db497e0-e507-4a13-b0ff-fb4f7608f94d", "address": "fa:16:3e:75:22:ea", "network": {"id": "35cab925-9113-4bab-8203-a81035513ed6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036882895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c05ffa95fcf49d6a87d6dad2b3f0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db497e0-e5", "ovs_interfaceid": "5db497e0-e507-4a13-b0ff-fb4f7608f94d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Converting VIF {"id": "5db497e0-e507-4a13-b0ff-fb4f7608f94d", "address": "fa:16:3e:75:22:ea", "network": {"id": "35cab925-9113-4bab-8203-a81035513ed6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036882895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c05ffa95fcf49d6a87d6dad2b3f0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db497e0-e5", "ovs_interfaceid": "5db497e0-e507-4a13-b0ff-fb4f7608f94d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:22:ea,bridge_name='br-int',has_traffic_filtering=True,id=5db497e0-e507-4a13-b0ff-fb4f7608f94d,network=Network(35cab925-9113-4bab-8203-a81035513ed6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db497e0-e5') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG os_vif [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:22:ea,bridge_name='br-int',has_traffic_filtering=True,id=5db497e0-e507-4a13-b0ff-fb4f7608f94d,network=Network(35cab925-9113-4bab-8203-a81035513ed6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db497e0-e5') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5db497e0-e5, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c8daf114-16fc-4226-97bb-71bc59c750e7) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG nova.policy [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9e945e1f8b6a4b269d54e0e8293b59e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed4742aedf24e90a866dd0a8692635e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG nova.compute.manager [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 00:49:02 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Creating image(s)
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lock "/opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lock "/opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:02 user nova-compute[74850]: INFO os_vif [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:22:ea,bridge_name='br-int',has_traffic_filtering=True,id=5db497e0-e507-4a13-b0ff-fb4f7608f94d,network=Network(35cab925-9113-4bab-8203-a81035513ed6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db497e0-e5')
Nov 14 00:49:02 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lwKDFPxQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:49:02 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:49:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bde75d0-25be-48dd-9e03-201261117772]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 00:49:02 user nova-compute[74850]: No targets found.
Nov 14 00:49:02 user nova-compute[74850]: iSNS:
Nov 14 00:49:02 user nova-compute[74850]: No targets found.
Nov 14 00:49:02 user nova-compute[74850]: STATIC:
Nov 14 00:49:02 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a
Nov 14 00:49:02 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:49:02 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:49:02 user nova-compute[74850]: FIRMWARE:
Nov 14 00:49:02 user nova-compute[74850]: No targets found.
Nov 14 00:49:02 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 00:49:02 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 00:49:02 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[dddb8628-cc11-47b4-959d-65c14ae9e2a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[165623fd-fff1-47fc-9bc5-dbf37c770ff4]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:49:02 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a (non-flash)
Nov 14 00:49:02 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a3c2ec8b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a'): ({'sdb'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Removing single pathed devices sdb {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2bf3c4-791d-4d21-bcd1-d6eea471a0d3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f09d4d-47d0-4cdc-8ac2-227b466936d2]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Flushing IO for device /dev/sdb {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[799ffd43-bc14-4624-93e1-8e9b61ba1d5c]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.232s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[712f813e-fc40-4ce3-90c4-531733be66bd]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[60130b8d-814e-40b5-a24a-32f9afb6b944]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4a933e-ad98-47bc-be4c-877666a9502f]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a, portal: 172.16.0.220,3260]
Nov 14 00:49:02 user nova-compute[74850]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a, portal: 172.16.0.220,3260] successful.
Nov 14 00:49:02 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef003978-0c16-4a36-b762-c86ac032e85a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69bc22b-0a31-4054-b82e-069d090e2c45]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] <== disconnect_volume: return (367ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 00:49:02 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Deleting instance files /opt/stack/data/nova/instances/b54b37bc-8c90-4c48-a943-e489e830b93b_del
Nov 14 00:49:02 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Deletion of /opt/stack/data/nova/instances/b54b37bc-8c90-4c48-a943-e489e830b93b_del complete
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.211s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk 1073741824" returned: 0 in 0.057s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:02 user nova-compute[74850]: INFO nova.compute.manager [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Took 1.94 seconds to destroy the instance on the hypervisor.
Nov 14 00:49:02 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 00:49:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.223s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:03 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 00:49:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:03 user nova-compute[74850]: DEBUG nova.network.neutron [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Successfully created port: 06e3d114-d80f-4634-840a-d4e120c77a88 {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:49:03 user nova-compute[74850]: DEBUG nova.compute.manager [req-29c32883-f753-4a68-ad08-7f1300b0413e req-85bc02d1-5987-4b87-8127-8363aea3023c service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Received event network-vif-plugged-667273cd-1700-465f-895e-6a1a093f44d8 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:49:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-29c32883-f753-4a68-ad08-7f1300b0413e req-85bc02d1-5987-4b87-8127-8363aea3023c service nova] Acquiring lock "7f115ae8-49da-4bf5-ae7c-62696769420c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-29c32883-f753-4a68-ad08-7f1300b0413e req-85bc02d1-5987-4b87-8127-8363aea3023c service nova] Lock "7f115ae8-49da-4bf5-ae7c-62696769420c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-29c32883-f753-4a68-ad08-7f1300b0413e req-85bc02d1-5987-4b87-8127-8363aea3023c service nova] Lock "7f115ae8-49da-4bf5-ae7c-62696769420c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:03 user nova-compute[74850]: DEBUG nova.compute.manager [req-29c32883-f753-4a68-ad08-7f1300b0413e req-85bc02d1-5987-4b87-8127-8363aea3023c service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] No waiting events found dispatching network-vif-plugged-667273cd-1700-465f-895e-6a1a093f44d8 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:49:03 user nova-compute[74850]: WARNING nova.compute.manager [req-29c32883-f753-4a68-ad08-7f1300b0413e req-85bc02d1-5987-4b87-8127-8363aea3023c service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Received unexpected event network-vif-plugged-667273cd-1700-465f-895e-6a1a093f44d8 for instance with vm_state building and task_state spawning.
Nov 14 00:49:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk --force-share --output=json" returned: 0 in 0.322s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:03 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Cannot resize image /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 00:49:03 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 00:49:03 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Ensure instance console log exists: /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 00:49:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:03 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:49:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:03 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Took 0.97 seconds to deallocate network for instance.
Nov 14 00:49:03 user nova-compute[74850]: DEBUG nova.compute.manager [req-99b43a32-eee5-4519-834b-1db09735ef90 req-04691ee4-c1aa-4d9e-9c80-42c2a248fe14 service nova] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Received event network-vif-deleted-5db497e0-e507-4a13-b0ff-fb4f7608f94d {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:49:03 user nova-compute[74850]: DEBUG nova.network.neutron [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Successfully updated port: 06e3d114-d80f-4634-840a-d4e120c77a88 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:49:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Acquiring lock "refresh_cache-4b60ac08-e954-46d5-a280-a11146b3ebf4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:49:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Acquired lock "refresh_cache-4b60ac08-e954-46d5-a280-a11146b3ebf4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:49:03 user nova-compute[74850]: DEBUG nova.network.neutron [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG nova.compute.manager [req-fba77f30-9138-43ea-94fd-0d6363487709 req-4540a69c-a220-4222-9fb7-c667b3e2ce31 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Received event network-changed-06e3d114-d80f-4634-840a-d4e120c77a88 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG nova.compute.manager [req-fba77f30-9138-43ea-94fd-0d6363487709 req-4540a69c-a220-4222-9fb7-c667b3e2ce31 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Refreshing instance network info cache due to event network-changed-06e3d114-d80f-4634-840a-d4e120c77a88. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fba77f30-9138-43ea-94fd-0d6363487709 req-4540a69c-a220-4222-9fb7-c667b3e2ce31 service nova] Acquiring lock "refresh_cache-4b60ac08-e954-46d5-a280-a11146b3ebf4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG nova.network.neutron [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG nova.network.neutron [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Updating instance_info_cache with network_info: [{"id": "06e3d114-d80f-4634-840a-d4e120c77a88", "address": "fa:16:3e:ef:7a:d7", "network": {"id": "a32d38d7-3a21-4c1b-886b-473c5cac50a4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-777089423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ed4742aedf24e90a866dd0a8692635e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e3d114-d8", "ovs_interfaceid": "06e3d114-d80f-4634-840a-d4e120c77a88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Releasing lock "refresh_cache-4b60ac08-e954-46d5-a280-a11146b3ebf4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG nova.compute.manager [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Instance network_info: |[{"id": "06e3d114-d80f-4634-840a-d4e120c77a88", "address": "fa:16:3e:ef:7a:d7", "network": {"id": "a32d38d7-3a21-4c1b-886b-473c5cac50a4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-777089423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ed4742aedf24e90a866dd0a8692635e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e3d114-d8", "ovs_interfaceid": "06e3d114-d80f-4634-840a-d4e120c77a88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fba77f30-9138-43ea-94fd-0d6363487709 req-4540a69c-a220-4222-9fb7-c667b3e2ce31 service nova] Acquired lock "refresh_cache-4b60ac08-e954-46d5-a280-a11146b3ebf4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG nova.network.neutron [req-fba77f30-9138-43ea-94fd-0d6363487709 req-4540a69c-a220-4222-9fb7-c667b3e2ce31 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Refreshing network info cache for port 06e3d114-d80f-4634-840a-d4e120c77a88 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Start _get_guest_xml network_info=[{"id": "06e3d114-d80f-4634-840a-d4e120c77a88", "address": "fa:16:3e:ef:7a:d7", "network": {"id": "a32d38d7-3a21-4c1b-886b-473c5cac50a4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-777089423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ed4742aedf24e90a866dd0a8692635e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e3d114-d8", "ovs_interfaceid": "06e3d114-d80f-4634-840a-d4e120c77a88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:49:04 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:49:04 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:49:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-502986324',display_name='tempest-ServerStableDeviceRescueTest-server-502986324',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-502986324',id=18,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7DltpeR7TImMhiz+vzatLidyU5MCPKFXrwJ76ilV9bswy73VBpt9fNiyC6+uDzkOHbbKXSHJv4ktbAISFjmBLQtaWHTbA8NxX8MGw55IlShPGquLMCYgZgWN/gER1IGQ==',key_name='tempest-keypair-1374070990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ed4742aedf24e90a866dd0a8692635e',ramdisk_id='',reservation_id='r-hyy4v5xs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1482343790',owner_user_name='tempest-ServerStableDeviceRescueTest-1482343790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:49:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e945e1f8b6a4b269d54e0e8293b59e7',uuid=4b60ac08-e954-46d5-a280-a11146b3ebf4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06e3d114-d80f-4634-840a-d4e120c77a88", "address": "fa:16:3e:ef:7a:d7", "network": {"id": "a32d38d7-3a21-4c1b-886b-473c5cac50a4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-777089423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ed4742aedf24e90a866dd0a8692635e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e3d114-d8", "ovs_interfaceid": "06e3d114-d80f-4634-840a-d4e120c77a88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Converting VIF {"id": "06e3d114-d80f-4634-840a-d4e120c77a88", "address": "fa:16:3e:ef:7a:d7", "network": {"id": "a32d38d7-3a21-4c1b-886b-473c5cac50a4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-777089423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ed4742aedf24e90a866dd0a8692635e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e3d114-d8", "ovs_interfaceid": "06e3d114-d80f-4634-840a-d4e120c77a88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:7a:d7,bridge_name='br-int',has_traffic_filtering=True,id=06e3d114-d80f-4634-840a-d4e120c77a88,network=Network(a32d38d7-3a21-4c1b-886b-473c5cac50a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06e3d114-d8') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG nova.objects.instance [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b60ac08-e954-46d5-a280-a11146b3ebf4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:49:04 user nova-compute[74850]:   <uuid>4b60ac08-e954-46d5-a280-a11146b3ebf4</uuid>
Nov 14 00:49:04 user nova-compute[74850]:   <name>instance-00000012</name>
Nov 14 00:49:04 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:49:04 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:49:04 user nova-compute[74850]:   <metadata>
Nov 14 00:49:04 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:49:04 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:49:04 user nova-compute[74850]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-502986324</nova:name>
Nov 14 00:49:04 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:49:04</nova:creationTime>
Nov 14 00:49:04 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:49:04 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:49:04 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:49:04 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:49:04 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:49:04 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:49:04 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:49:04 user nova-compute[74850]:       <nova:owner>
Nov 14 00:49:04 user nova-compute[74850]:         <nova:user uuid="9e945e1f8b6a4b269d54e0e8293b59e7">tempest-ServerStableDeviceRescueTest-1482343790-project-member</nova:user>
Nov 14 00:49:04 user nova-compute[74850]:         <nova:project uuid="9ed4742aedf24e90a866dd0a8692635e">tempest-ServerStableDeviceRescueTest-1482343790</nova:project>
Nov 14 00:49:04 user nova-compute[74850]:       </nova:owner>
Nov 14 00:49:04 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:49:04 user nova-compute[74850]:       <nova:ports>
Nov 14 00:49:04 user nova-compute[74850]:         <nova:port uuid="06e3d114-d80f-4634-840a-d4e120c77a88">
Nov 14 00:49:04 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 00:49:04 user nova-compute[74850]:         </nova:port>
Nov 14 00:49:04 user nova-compute[74850]:       </nova:ports>
Nov 14 00:49:04 user nova-compute[74850]:     </nova:instance>
Nov 14 00:49:04 user nova-compute[74850]:   </metadata>
Nov 14 00:49:04 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:49:04 user nova-compute[74850]:     <system>
Nov 14 00:49:04 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:49:04 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:49:04 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:49:04 user nova-compute[74850]:       <entry name="serial">4b60ac08-e954-46d5-a280-a11146b3ebf4</entry>
Nov 14 00:49:04 user nova-compute[74850]:       <entry name="uuid">4b60ac08-e954-46d5-a280-a11146b3ebf4</entry>
Nov 14 00:49:04 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:49:04 user nova-compute[74850]:     </system>
Nov 14 00:49:04 user nova-compute[74850]:   </sysinfo>
Nov 14 00:49:04 user nova-compute[74850]:   <os>
Nov 14 00:49:04 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:49:04 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 00:49:04 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:49:04 user nova-compute[74850]:   </os>
Nov 14 00:49:04 user nova-compute[74850]:   <features>
Nov 14 00:49:04 user nova-compute[74850]:     <acpi/>
Nov 14 00:49:04 user nova-compute[74850]:     <apic/>
Nov 14 00:49:04 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:49:04 user nova-compute[74850]:   </features>
Nov 14 00:49:04 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:49:04 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:49:04 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:49:04 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:49:04 user nova-compute[74850]:   </clock>
Nov 14 00:49:04 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:49:04 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:49:04 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:49:04 user nova-compute[74850]:   </cpu>
Nov 14 00:49:04 user nova-compute[74850]:   <devices>
Nov 14 00:49:04 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 00:49:04 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:49:04 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk"/>
Nov 14 00:49:04 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:49:04 user nova-compute[74850]:     </disk>
Nov 14 00:49:04 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:49:04 user nova-compute[74850]:       <mac address="fa:16:3e:ef:7a:d7"/>
Nov 14 00:49:04 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:49:04 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:49:04 user nova-compute[74850]:       <target dev="tap06e3d114-d8"/>
Nov 14 00:49:04 user nova-compute[74850]:     </interface>
Nov 14 00:49:04 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:49:04 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/console.log" append="off"/>
Nov 14 00:49:04 user nova-compute[74850]:     </serial>
Nov 14 00:49:04 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:49:04 user nova-compute[74850]:     <video>
Nov 14 00:49:04 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:49:04 user nova-compute[74850]:     </video>
Nov 14 00:49:04 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:49:04 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:49:04 user nova-compute[74850]:     </rng>
Nov 14 00:49:04 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:49:04 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:49:04 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:49:04 user nova-compute[74850]:     </memballoon>
Nov 14 00:49:04 user nova-compute[74850]:   </devices>
Nov 14 00:49:04 user nova-compute[74850]: </domain>
Nov 14 00:49:04 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-502986324',display_name='tempest-ServerStableDeviceRescueTest-server-502986324',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-502986324',id=18,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7DltpeR7TImMhiz+vzatLidyU5MCPKFXrwJ76ilV9bswy73VBpt9fNiyC6+uDzkOHbbKXSHJv4ktbAISFjmBLQtaWHTbA8NxX8MGw55IlShPGquLMCYgZgWN/gER1IGQ==',key_name='tempest-keypair-1374070990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ed4742aedf24e90a866dd0a8692635e',ramdisk_id='',reservation_id='r-hyy4v5xs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1482343790',owner_user_name='tempest-ServerStableDeviceRescueTest-1482343790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:49:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e945e1f8b6a4b269d54e0e8293b59e7',uuid=4b60ac08-e954-46d5-a280-a11146b3ebf4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06e3d114-d80f-4634-840a-d4e120c77a88", "address": "fa:16:3e:ef:7a:d7", "network": {"id": "a32d38d7-3a21-4c1b-886b-473c5cac50a4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-777089423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ed4742aedf24e90a866dd0a8692635e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e3d114-d8", "ovs_interfaceid": "06e3d114-d80f-4634-840a-d4e120c77a88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Converting VIF {"id": "06e3d114-d80f-4634-840a-d4e120c77a88", "address": "fa:16:3e:ef:7a:d7", "network": {"id": "a32d38d7-3a21-4c1b-886b-473c5cac50a4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-777089423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ed4742aedf24e90a866dd0a8692635e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e3d114-d8", "ovs_interfaceid": "06e3d114-d80f-4634-840a-d4e120c77a88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:7a:d7,bridge_name='br-int',has_traffic_filtering=True,id=06e3d114-d80f-4634-840a-d4e120c77a88,network=Network(a32d38d7-3a21-4c1b-886b-473c5cac50a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06e3d114-d8') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG os_vif [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:7a:d7,bridge_name='br-int',has_traffic_filtering=True,id=06e3d114-d80f-4634-840a-d4e120c77a88,network=Network(a32d38d7-3a21-4c1b-886b-473c5cac50a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06e3d114-d8') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '701a36e1-350a-5141-85f1-3d343d2d4818', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06e3d114-d8, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap06e3d114-d8, col_values=(('qos', UUID('0f2d5234-80f7-4d63-8e17-66b44bcd9b7b')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap06e3d114-d8, col_values=(('external_ids', {'iface-id': '06e3d114-d80f-4634-840a-d4e120c77a88', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:7a:d7', 'vm-uuid': '4b60ac08-e954-46d5-a280-a11146b3ebf4'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:04 user nova-compute[74850]: INFO os_vif [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:7a:d7,bridge_name='br-int',has_traffic_filtering=True,id=06e3d114-d80f-4634-840a-d4e120c77a88,network=Network(a32d38d7-3a21-4c1b-886b-473c5cac50a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06e3d114-d8')
Nov 14 00:49:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] No VIF found with MAC fa:16:3e:ef:7a:d7, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG nova.network.neutron [req-fba77f30-9138-43ea-94fd-0d6363487709 req-4540a69c-a220-4222-9fb7-c667b3e2ce31 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Updated VIF entry in instance network info cache for port 06e3d114-d80f-4634-840a-d4e120c77a88. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG nova.network.neutron [req-fba77f30-9138-43ea-94fd-0d6363487709 req-4540a69c-a220-4222-9fb7-c667b3e2ce31 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Updating instance_info_cache with network_info: [{"id": "06e3d114-d80f-4634-840a-d4e120c77a88", "address": "fa:16:3e:ef:7a:d7", "network": {"id": "a32d38d7-3a21-4c1b-886b-473c5cac50a4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-777089423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ed4742aedf24e90a866dd0a8692635e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e3d114-d8", "ovs_interfaceid": "06e3d114-d80f-4634-840a-d4e120c77a88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fba77f30-9138-43ea-94fd-0d6363487709 req-4540a69c-a220-4222-9fb7-c667b3e2ce31 service nova] Releasing lock "refresh_cache-4b60ac08-e954-46d5-a280-a11146b3ebf4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:49:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:04 user nova-compute[74850]: INFO nova.compute.manager [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Took 1.11 seconds to detach 1 volumes for instance.
Nov 14 00:49:04 user nova-compute[74850]: DEBUG nova.compute.manager [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] [instance: b54b37bc-8c90-4c48-a943-e489e830b93b] Deleting volume: ef003978-0c16-4a36-b762-c86ac032e85a {{(pid=74850) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 00:49:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:05 user nova-compute[74850]: DEBUG nova.compute.manager [req-ecab69c6-f105-4827-86ff-4eb11191c1b0 req-582f5fde-fd45-4b31-b479-4f95a86b3c56 service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Received event network-vif-plugged-667273cd-1700-465f-895e-6a1a093f44d8 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:49:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ecab69c6-f105-4827-86ff-4eb11191c1b0 req-582f5fde-fd45-4b31-b479-4f95a86b3c56 service nova] Acquiring lock "7f115ae8-49da-4bf5-ae7c-62696769420c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ecab69c6-f105-4827-86ff-4eb11191c1b0 req-582f5fde-fd45-4b31-b479-4f95a86b3c56 service nova] Lock "7f115ae8-49da-4bf5-ae7c-62696769420c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ecab69c6-f105-4827-86ff-4eb11191c1b0 req-582f5fde-fd45-4b31-b479-4f95a86b3c56 service nova] Lock "7f115ae8-49da-4bf5-ae7c-62696769420c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:05 user nova-compute[74850]: DEBUG nova.compute.manager [req-ecab69c6-f105-4827-86ff-4eb11191c1b0 req-582f5fde-fd45-4b31-b479-4f95a86b3c56 service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] No waiting events found dispatching network-vif-plugged-667273cd-1700-465f-895e-6a1a093f44d8 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:49:05 user nova-compute[74850]: WARNING nova.compute.manager [req-ecab69c6-f105-4827-86ff-4eb11191c1b0 req-582f5fde-fd45-4b31-b479-4f95a86b3c56 service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Received unexpected event network-vif-plugged-667273cd-1700-465f-895e-6a1a093f44d8 for instance with vm_state building and task_state spawning.
Nov 14 00:49:05 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:49:05 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:49:05 user nova-compute[74850]: DEBUG nova.compute.manager [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:49:05 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 00:49:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:05 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Instance spawned successfully.
Nov 14 00:49:05 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 00:49:05 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:49:05 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:49:05 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:49:05 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:49:05 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:49:05 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:49:05 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Deleted allocations for instance b54b37bc-8c90-4c48-a943-e489e830b93b
Nov 14 00:49:05 user nova-compute[74850]: INFO nova.compute.manager [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Took 6.98 seconds to spawn the instance on the hypervisor.
Nov 14 00:49:05 user nova-compute[74850]: DEBUG nova.compute.manager [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:49:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9b2e7085-4fcc-4164-b705-68875724d125 tempest-ServerActionsV293TestJSON-676489401 tempest-ServerActionsV293TestJSON-676489401-project-member] Lock "b54b37bc-8c90-4c48-a943-e489e830b93b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.794s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:05 user nova-compute[74850]: INFO nova.compute.manager [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Took 7.88 seconds to build instance.
Nov 14 00:49:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9d6c6aed-5885-47a2-9fe7-ff2aac47c68d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lock "7f115ae8-49da-4bf5-ae7c-62696769420c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.010s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:06 user nova-compute[74850]: DEBUG nova.compute.manager [req-58f1db04-dbfe-4c42-82db-a4f5210afebe req-35d393de-174c-4eda-b5a0-e70517735a18 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Received event network-vif-plugged-06e3d114-d80f-4634-840a-d4e120c77a88 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:49:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-58f1db04-dbfe-4c42-82db-a4f5210afebe req-35d393de-174c-4eda-b5a0-e70517735a18 service nova] Acquiring lock "4b60ac08-e954-46d5-a280-a11146b3ebf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-58f1db04-dbfe-4c42-82db-a4f5210afebe req-35d393de-174c-4eda-b5a0-e70517735a18 service nova] Lock "4b60ac08-e954-46d5-a280-a11146b3ebf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-58f1db04-dbfe-4c42-82db-a4f5210afebe req-35d393de-174c-4eda-b5a0-e70517735a18 service nova] Lock "4b60ac08-e954-46d5-a280-a11146b3ebf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:06 user nova-compute[74850]: DEBUG nova.compute.manager [req-58f1db04-dbfe-4c42-82db-a4f5210afebe req-35d393de-174c-4eda-b5a0-e70517735a18 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] No waiting events found dispatching network-vif-plugged-06e3d114-d80f-4634-840a-d4e120c77a88 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:49:06 user nova-compute[74850]: WARNING nova.compute.manager [req-58f1db04-dbfe-4c42-82db-a4f5210afebe req-35d393de-174c-4eda-b5a0-e70517735a18 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Received unexpected event network-vif-plugged-06e3d114-d80f-4634-840a-d4e120c77a88 for instance with vm_state building and task_state spawning.
Nov 14 00:49:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:08 user nova-compute[74850]: DEBUG nova.compute.manager [req-43aeebbc-4a33-4df4-9b37-8160931f1430 req-8336dc4d-88e0-4042-bc3d-9bb585ebe7fb service nova] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Received event network-vif-plugged-7cc43262-84fa-474b-ae96-39758aba662b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:49:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-43aeebbc-4a33-4df4-9b37-8160931f1430 req-8336dc4d-88e0-4042-bc3d-9bb585ebe7fb service nova] Acquiring lock "415808a8-c17b-49bf-8a4e-ac19553cdb19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-43aeebbc-4a33-4df4-9b37-8160931f1430 req-8336dc4d-88e0-4042-bc3d-9bb585ebe7fb service nova] Lock "415808a8-c17b-49bf-8a4e-ac19553cdb19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-43aeebbc-4a33-4df4-9b37-8160931f1430 req-8336dc4d-88e0-4042-bc3d-9bb585ebe7fb service nova] Lock "415808a8-c17b-49bf-8a4e-ac19553cdb19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:08 user nova-compute[74850]: DEBUG nova.compute.manager [req-43aeebbc-4a33-4df4-9b37-8160931f1430 req-8336dc4d-88e0-4042-bc3d-9bb585ebe7fb service nova] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] No waiting events found dispatching network-vif-plugged-7cc43262-84fa-474b-ae96-39758aba662b {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:49:08 user nova-compute[74850]: WARNING nova.compute.manager [req-43aeebbc-4a33-4df4-9b37-8160931f1430 req-8336dc4d-88e0-4042-bc3d-9bb585ebe7fb service nova] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Received unexpected event network-vif-plugged-7cc43262-84fa-474b-ae96-39758aba662b for instance with vm_state active and task_state None.
Nov 14 00:49:08 user nova-compute[74850]: DEBUG nova.compute.manager [req-84d5919e-ee48-45b0-b33e-ffb2e9b38b9f req-f723b45d-8a34-4ee1-80a7-2f37b2c2c1d8 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Received event network-vif-plugged-06e3d114-d80f-4634-840a-d4e120c77a88 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:49:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-84d5919e-ee48-45b0-b33e-ffb2e9b38b9f req-f723b45d-8a34-4ee1-80a7-2f37b2c2c1d8 service nova] Acquiring lock "4b60ac08-e954-46d5-a280-a11146b3ebf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-84d5919e-ee48-45b0-b33e-ffb2e9b38b9f req-f723b45d-8a34-4ee1-80a7-2f37b2c2c1d8 service nova] Lock "4b60ac08-e954-46d5-a280-a11146b3ebf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-84d5919e-ee48-45b0-b33e-ffb2e9b38b9f req-f723b45d-8a34-4ee1-80a7-2f37b2c2c1d8 service nova] Lock "4b60ac08-e954-46d5-a280-a11146b3ebf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:08 user nova-compute[74850]: DEBUG nova.compute.manager [req-84d5919e-ee48-45b0-b33e-ffb2e9b38b9f req-f723b45d-8a34-4ee1-80a7-2f37b2c2c1d8 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] No waiting events found dispatching network-vif-plugged-06e3d114-d80f-4634-840a-d4e120c77a88 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:49:08 user nova-compute[74850]: WARNING nova.compute.manager [req-84d5919e-ee48-45b0-b33e-ffb2e9b38b9f req-f723b45d-8a34-4ee1-80a7-2f37b2c2c1d8 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Received unexpected event network-vif-plugged-06e3d114-d80f-4634-840a-d4e120c77a88 for instance with vm_state building and task_state spawning.
Nov 14 00:49:08 user nova-compute[74850]: DEBUG nova.compute.manager [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:49:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 00:49:08 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Instance spawned successfully.
Nov 14 00:49:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 00:49:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:49:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:49:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:49:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:49:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:49:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:49:08 user nova-compute[74850]: INFO nova.compute.manager [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Took 6.64 seconds to spawn the instance on the hypervisor.
Nov 14 00:49:08 user nova-compute[74850]: DEBUG nova.compute.manager [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:49:09 user nova-compute[74850]: INFO nova.compute.manager [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Took 7.70 seconds to build instance.
Nov 14 00:49:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5eda8eb5-dccb-4a61-b160-63c5d59ac586 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lock "4b60ac08-e954-46d5-a280-a11146b3ebf4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.825s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:10 user nova-compute[74850]: DEBUG nova.compute.manager [req-e5320b3b-4c12-45ce-82f5-ffdfa61293db req-06ffccf2-ae7d-48f3-a224-c9c1411718e2 service nova] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Received event network-vif-plugged-7cc43262-84fa-474b-ae96-39758aba662b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:49:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e5320b3b-4c12-45ce-82f5-ffdfa61293db req-06ffccf2-ae7d-48f3-a224-c9c1411718e2 service nova] Acquiring lock "415808a8-c17b-49bf-8a4e-ac19553cdb19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e5320b3b-4c12-45ce-82f5-ffdfa61293db req-06ffccf2-ae7d-48f3-a224-c9c1411718e2 service nova] Lock "415808a8-c17b-49bf-8a4e-ac19553cdb19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e5320b3b-4c12-45ce-82f5-ffdfa61293db req-06ffccf2-ae7d-48f3-a224-c9c1411718e2 service nova] Lock "415808a8-c17b-49bf-8a4e-ac19553cdb19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:10 user nova-compute[74850]: DEBUG nova.compute.manager [req-e5320b3b-4c12-45ce-82f5-ffdfa61293db req-06ffccf2-ae7d-48f3-a224-c9c1411718e2 service nova] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] No waiting events found dispatching network-vif-plugged-7cc43262-84fa-474b-ae96-39758aba662b {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:49:10 user nova-compute[74850]: WARNING nova.compute.manager [req-e5320b3b-4c12-45ce-82f5-ffdfa61293db req-06ffccf2-ae7d-48f3-a224-c9c1411718e2 service nova] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Received unexpected event network-vif-plugged-7cc43262-84fa-474b-ae96-39758aba662b for instance with vm_state active and task_state None.
Nov 14 00:49:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Acquiring lock "a62a2eab-2502-4275-948b-3f18c3fcff36" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Lock "a62a2eab-2502-4275-948b-3f18c3fcff36" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:27 user nova-compute[74850]: DEBUG nova.compute.manager [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 00:49:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:27 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 00:49:27 user nova-compute[74850]: INFO nova.compute.claims [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Claim successful on node user
Nov 14 00:49:27 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:49:27 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:49:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.385s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:27 user nova-compute[74850]: DEBUG nova.compute.manager [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 00:49:27 user nova-compute[74850]: DEBUG nova.compute.manager [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 00:49:27 user nova-compute[74850]: DEBUG nova.network.neutron [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 00:49:27 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 00:49:27 user nova-compute[74850]: DEBUG nova.compute.manager [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 00:49:28 user nova-compute[74850]: DEBUG nova.policy [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1fb1ab671fa64b55ac3d30df3d41cb3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf004672a7b54f718937d1a0db6cec04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 00:49:28 user nova-compute[74850]: DEBUG nova.compute.manager [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 00:49:28 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 00:49:28 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Creating image(s)
Nov 14 00:49:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Acquiring lock "/opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Lock "/opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Lock "/opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.176s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.173s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk 1073741824" returned: 0 in 0.050s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:28 user nova-compute[74850]: DEBUG nova.network.neutron [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Successfully created port: 12f841ee-4cd7-42bc-b5c7-4881419e2e26 {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:49:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.183s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:28 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 00:49:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:28 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Cannot resize image /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 00:49:28 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 00:49:28 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Ensure instance console log exists: /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 00:49:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG nova.network.neutron [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Successfully updated port: 12f841ee-4cd7-42bc-b5c7-4881419e2e26 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Acquiring lock "refresh_cache-a62a2eab-2502-4275-948b-3f18c3fcff36" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Acquired lock "refresh_cache-a62a2eab-2502-4275-948b-3f18c3fcff36" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG nova.network.neutron [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG nova.compute.manager [req-9143b677-92e3-4398-b3d8-f8a8222213cb req-c6edb85d-c7ca-4490-b0cb-11805d71f567 service nova] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Received event network-changed-12f841ee-4cd7-42bc-b5c7-4881419e2e26 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG nova.compute.manager [req-9143b677-92e3-4398-b3d8-f8a8222213cb req-c6edb85d-c7ca-4490-b0cb-11805d71f567 service nova] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Refreshing instance network info cache due to event network-changed-12f841ee-4cd7-42bc-b5c7-4881419e2e26. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9143b677-92e3-4398-b3d8-f8a8222213cb req-c6edb85d-c7ca-4490-b0cb-11805d71f567 service nova] Acquiring lock "refresh_cache-a62a2eab-2502-4275-948b-3f18c3fcff36" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG nova.network.neutron [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG nova.network.neutron [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Updating instance_info_cache with network_info: [{"id": "12f841ee-4cd7-42bc-b5c7-4881419e2e26", "address": "fa:16:3e:14:c5:ac", "network": {"id": "70b59622-f2a8-4dfc-9f03-828f4824be1e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1478695014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf004672a7b54f718937d1a0db6cec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12f841ee-4c", "ovs_interfaceid": "12f841ee-4cd7-42bc-b5c7-4881419e2e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Releasing lock "refresh_cache-a62a2eab-2502-4275-948b-3f18c3fcff36" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG nova.compute.manager [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Instance network_info: |[{"id": "12f841ee-4cd7-42bc-b5c7-4881419e2e26", "address": "fa:16:3e:14:c5:ac", "network": {"id": "70b59622-f2a8-4dfc-9f03-828f4824be1e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1478695014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf004672a7b54f718937d1a0db6cec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12f841ee-4c", "ovs_interfaceid": "12f841ee-4cd7-42bc-b5c7-4881419e2e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9143b677-92e3-4398-b3d8-f8a8222213cb req-c6edb85d-c7ca-4490-b0cb-11805d71f567 service nova] Acquired lock "refresh_cache-a62a2eab-2502-4275-948b-3f18c3fcff36" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG nova.network.neutron [req-9143b677-92e3-4398-b3d8-f8a8222213cb req-c6edb85d-c7ca-4490-b0cb-11805d71f567 service nova] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Refreshing network info cache for port 12f841ee-4cd7-42bc-b5c7-4881419e2e26 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Start _get_guest_xml network_info=[{"id": "12f841ee-4cd7-42bc-b5c7-4881419e2e26", "address": "fa:16:3e:14:c5:ac", "network": {"id": "70b59622-f2a8-4dfc-9f03-828f4824be1e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1478695014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf004672a7b54f718937d1a0db6cec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12f841ee-4c", "ovs_interfaceid": "12f841ee-4cd7-42bc-b5c7-4881419e2e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:49:29 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:49:29 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:49:29 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:49:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-624514644',display_name='tempest-ServersNegativeTestJSON-server-624514644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-624514644',id=19,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf004672a7b54f718937d1a0db6cec04',ramdisk_id='',reservation_id='r-bfsai53n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1191110421',owner_user_name='tempest-ServersNegativeTestJSON-1191110421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:49:28Z,user_data=None,user_id='1fb1ab671fa64b55ac3d30df3d41cb3b',uuid=a62a2eab-2502-4275-948b-3f18c3fcff36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12f841ee-4cd7-42bc-b5c7-4881419e2e26", "address": "fa:16:3e:14:c5:ac", "network": {"id": "70b59622-f2a8-4dfc-9f03-828f4824be1e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1478695014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf004672a7b54f718937d1a0db6cec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12f841ee-4c", "ovs_interfaceid": "12f841ee-4cd7-42bc-b5c7-4881419e2e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Converting VIF {"id": "12f841ee-4cd7-42bc-b5c7-4881419e2e26", "address": "fa:16:3e:14:c5:ac", "network": {"id": "70b59622-f2a8-4dfc-9f03-828f4824be1e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1478695014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf004672a7b54f718937d1a0db6cec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12f841ee-4c", "ovs_interfaceid": "12f841ee-4cd7-42bc-b5c7-4881419e2e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:c5:ac,bridge_name='br-int',has_traffic_filtering=True,id=12f841ee-4cd7-42bc-b5c7-4881419e2e26,network=Network(70b59622-f2a8-4dfc-9f03-828f4824be1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12f841ee-4c') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG nova.objects.instance [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Lazy-loading 'pci_devices' on Instance uuid a62a2eab-2502-4275-948b-3f18c3fcff36 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:49:29 user nova-compute[74850]:   <uuid>a62a2eab-2502-4275-948b-3f18c3fcff36</uuid>
Nov 14 00:49:29 user nova-compute[74850]:   <name>instance-00000013</name>
Nov 14 00:49:29 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:49:29 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:49:29 user nova-compute[74850]:   <metadata>
Nov 14 00:49:29 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:49:29 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:49:29 user nova-compute[74850]:       <nova:name>tempest-ServersNegativeTestJSON-server-624514644</nova:name>
Nov 14 00:49:29 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:49:29</nova:creationTime>
Nov 14 00:49:29 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:49:29 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:49:29 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:49:29 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:49:29 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:49:29 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:49:29 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:49:29 user nova-compute[74850]:       <nova:owner>
Nov 14 00:49:29 user nova-compute[74850]:         <nova:user uuid="1fb1ab671fa64b55ac3d30df3d41cb3b">tempest-ServersNegativeTestJSON-1191110421-project-member</nova:user>
Nov 14 00:49:29 user nova-compute[74850]:         <nova:project uuid="bf004672a7b54f718937d1a0db6cec04">tempest-ServersNegativeTestJSON-1191110421</nova:project>
Nov 14 00:49:29 user nova-compute[74850]:       </nova:owner>
Nov 14 00:49:29 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:49:29 user nova-compute[74850]:       <nova:ports>
Nov 14 00:49:29 user nova-compute[74850]:         <nova:port uuid="12f841ee-4cd7-42bc-b5c7-4881419e2e26">
Nov 14 00:49:29 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 00:49:29 user nova-compute[74850]:         </nova:port>
Nov 14 00:49:29 user nova-compute[74850]:       </nova:ports>
Nov 14 00:49:29 user nova-compute[74850]:     </nova:instance>
Nov 14 00:49:29 user nova-compute[74850]:   </metadata>
Nov 14 00:49:29 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:49:29 user nova-compute[74850]:     <system>
Nov 14 00:49:29 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:49:29 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:49:29 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:49:29 user nova-compute[74850]:       <entry name="serial">a62a2eab-2502-4275-948b-3f18c3fcff36</entry>
Nov 14 00:49:29 user nova-compute[74850]:       <entry name="uuid">a62a2eab-2502-4275-948b-3f18c3fcff36</entry>
Nov 14 00:49:29 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:49:29 user nova-compute[74850]:     </system>
Nov 14 00:49:29 user nova-compute[74850]:   </sysinfo>
Nov 14 00:49:29 user nova-compute[74850]:   <os>
Nov 14 00:49:29 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:49:29 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 00:49:29 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:49:29 user nova-compute[74850]:   </os>
Nov 14 00:49:29 user nova-compute[74850]:   <features>
Nov 14 00:49:29 user nova-compute[74850]:     <acpi/>
Nov 14 00:49:29 user nova-compute[74850]:     <apic/>
Nov 14 00:49:29 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:49:29 user nova-compute[74850]:   </features>
Nov 14 00:49:29 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:49:29 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:49:29 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:49:29 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:49:29 user nova-compute[74850]:   </clock>
Nov 14 00:49:29 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:49:29 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:49:29 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:49:29 user nova-compute[74850]:   </cpu>
Nov 14 00:49:29 user nova-compute[74850]:   <devices>
Nov 14 00:49:29 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 00:49:29 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:49:29 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk"/>
Nov 14 00:49:29 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:49:29 user nova-compute[74850]:     </disk>
Nov 14 00:49:29 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:49:29 user nova-compute[74850]:       <mac address="fa:16:3e:14:c5:ac"/>
Nov 14 00:49:29 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:49:29 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:49:29 user nova-compute[74850]:       <target dev="tap12f841ee-4c"/>
Nov 14 00:49:29 user nova-compute[74850]:     </interface>
Nov 14 00:49:29 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:49:29 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/console.log" append="off"/>
Nov 14 00:49:29 user nova-compute[74850]:     </serial>
Nov 14 00:49:29 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:49:29 user nova-compute[74850]:     <video>
Nov 14 00:49:29 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:49:29 user nova-compute[74850]:     </video>
Nov 14 00:49:29 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:49:29 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:49:29 user nova-compute[74850]:     </rng>
Nov 14 00:49:29 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:49:29 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:49:29 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:49:29 user nova-compute[74850]:     </memballoon>
Nov 14 00:49:29 user nova-compute[74850]:   </devices>
Nov 14 00:49:29 user nova-compute[74850]: </domain>
Nov 14 00:49:29 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:49:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-624514644',display_name='tempest-ServersNegativeTestJSON-server-624514644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-624514644',id=19,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf004672a7b54f718937d1a0db6cec04',ramdisk_id='',reservation_id='r-bfsai53n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1191110421',owner_user_name='tempest-ServersNegativeTestJSON-1191110421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:49:28Z,user_data=None,user_id='1fb1ab671fa64b55ac3d30df3d41cb3b',uuid=a62a2eab-2502-4275-948b-3f18c3fcff36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12f841ee-4cd7-42bc-b5c7-4881419e2e26", "address": "fa:16:3e:14:c5:ac", "network": {"id": "70b59622-f2a8-4dfc-9f03-828f4824be1e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1478695014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf004672a7b54f718937d1a0db6cec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12f841ee-4c", "ovs_interfaceid": "12f841ee-4cd7-42bc-b5c7-4881419e2e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Converting VIF {"id": "12f841ee-4cd7-42bc-b5c7-4881419e2e26", "address": "fa:16:3e:14:c5:ac", "network": {"id": "70b59622-f2a8-4dfc-9f03-828f4824be1e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1478695014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf004672a7b54f718937d1a0db6cec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12f841ee-4c", "ovs_interfaceid": "12f841ee-4cd7-42bc-b5c7-4881419e2e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:c5:ac,bridge_name='br-int',has_traffic_filtering=True,id=12f841ee-4cd7-42bc-b5c7-4881419e2e26,network=Network(70b59622-f2a8-4dfc-9f03-828f4824be1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12f841ee-4c') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG os_vif [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:c5:ac,bridge_name='br-int',has_traffic_filtering=True,id=12f841ee-4cd7-42bc-b5c7-4881419e2e26,network=Network(70b59622-f2a8-4dfc-9f03-828f4824be1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12f841ee-4c') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '452f4f90-dbe7-54cc-9145-d1d1581ce0da', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap12f841ee-4c, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap12f841ee-4c, col_values=(('qos', UUID('f8ebd876-9374-48b0-8f68-490aba710d89')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap12f841ee-4c, col_values=(('external_ids', {'iface-id': '12f841ee-4cd7-42bc-b5c7-4881419e2e26', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:c5:ac', 'vm-uuid': 'a62a2eab-2502-4275-948b-3f18c3fcff36'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:29 user nova-compute[74850]: INFO os_vif [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:c5:ac,bridge_name='br-int',has_traffic_filtering=True,id=12f841ee-4cd7-42bc-b5c7-4881419e2e26,network=Network(70b59622-f2a8-4dfc-9f03-828f4824be1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12f841ee-4c')
Nov 14 00:49:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:49:29 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] No VIF found with MAC fa:16:3e:14:c5:ac, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:49:30 user nova-compute[74850]: DEBUG nova.network.neutron [req-9143b677-92e3-4398-b3d8-f8a8222213cb req-c6edb85d-c7ca-4490-b0cb-11805d71f567 service nova] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Updated VIF entry in instance network info cache for port 12f841ee-4cd7-42bc-b5c7-4881419e2e26. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:49:30 user nova-compute[74850]: DEBUG nova.network.neutron [req-9143b677-92e3-4398-b3d8-f8a8222213cb req-c6edb85d-c7ca-4490-b0cb-11805d71f567 service nova] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Updating instance_info_cache with network_info: [{"id": "12f841ee-4cd7-42bc-b5c7-4881419e2e26", "address": "fa:16:3e:14:c5:ac", "network": {"id": "70b59622-f2a8-4dfc-9f03-828f4824be1e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1478695014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf004672a7b54f718937d1a0db6cec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12f841ee-4c", "ovs_interfaceid": "12f841ee-4cd7-42bc-b5c7-4881419e2e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:49:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9143b677-92e3-4398-b3d8-f8a8222213cb req-c6edb85d-c7ca-4490-b0cb-11805d71f567 service nova] Releasing lock "refresh_cache-a62a2eab-2502-4275-948b-3f18c3fcff36" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:49:30 user nova-compute[74850]: INFO nova.compute.manager [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Rescuing
Nov 14 00:49:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "refresh_cache-a70d0196-f90e-47c4-be67-bf7ef4c3d8c4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:49:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquired lock "refresh_cache-a70d0196-f90e-47c4-be67-bf7ef4c3d8c4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:49:30 user nova-compute[74850]: DEBUG nova.network.neutron [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:49:30 user nova-compute[74850]: DEBUG nova.network.neutron [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Updating instance_info_cache with network_info: [{"id": "f0de03a3-fd19-4cd1-a408-5168dcf267d7", "address": "fa:16:3e:44:d7:64", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0de03a3-fd", "ovs_interfaceid": "f0de03a3-fd19-4cd1-a408-5168dcf267d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:49:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Releasing lock "refresh_cache-a70d0196-f90e-47c4-be67-bf7ef4c3d8c4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:49:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:31 user nova-compute[74850]: DEBUG nova.compute.manager [req-73e4932b-a6f9-4cbb-a7e1-9dd0135001e1 req-b8db96cd-10c1-434c-b175-03f9f4284a34 service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Received event network-vif-unplugged-f0de03a3-fd19-4cd1-a408-5168dcf267d7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:49:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-73e4932b-a6f9-4cbb-a7e1-9dd0135001e1 req-b8db96cd-10c1-434c-b175-03f9f4284a34 service nova] Acquiring lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-73e4932b-a6f9-4cbb-a7e1-9dd0135001e1 req-b8db96cd-10c1-434c-b175-03f9f4284a34 service nova] Lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-73e4932b-a6f9-4cbb-a7e1-9dd0135001e1 req-b8db96cd-10c1-434c-b175-03f9f4284a34 service nova] Lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:31 user nova-compute[74850]: DEBUG nova.compute.manager [req-73e4932b-a6f9-4cbb-a7e1-9dd0135001e1 req-b8db96cd-10c1-434c-b175-03f9f4284a34 service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] No waiting events found dispatching network-vif-unplugged-f0de03a3-fd19-4cd1-a408-5168dcf267d7 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:49:31 user nova-compute[74850]: WARNING nova.compute.manager [req-73e4932b-a6f9-4cbb-a7e1-9dd0135001e1 req-b8db96cd-10c1-434c-b175-03f9f4284a34 service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Received unexpected event network-vif-unplugged-f0de03a3-fd19-4cd1-a408-5168dcf267d7 for instance with vm_state active and task_state rescuing.
Nov 14 00:49:31 user nova-compute[74850]: DEBUG nova.compute.manager [req-62c4d574-848b-4a8e-8054-132661c56816 req-13b77ad8-d95a-4557-aa24-d7e5b2852760 service nova] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Received event network-vif-plugged-12f841ee-4cd7-42bc-b5c7-4881419e2e26 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:49:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-62c4d574-848b-4a8e-8054-132661c56816 req-13b77ad8-d95a-4557-aa24-d7e5b2852760 service nova] Acquiring lock "a62a2eab-2502-4275-948b-3f18c3fcff36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-62c4d574-848b-4a8e-8054-132661c56816 req-13b77ad8-d95a-4557-aa24-d7e5b2852760 service nova] Lock "a62a2eab-2502-4275-948b-3f18c3fcff36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-62c4d574-848b-4a8e-8054-132661c56816 req-13b77ad8-d95a-4557-aa24-d7e5b2852760 service nova] Lock "a62a2eab-2502-4275-948b-3f18c3fcff36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:31 user nova-compute[74850]: DEBUG nova.compute.manager [req-62c4d574-848b-4a8e-8054-132661c56816 req-13b77ad8-d95a-4557-aa24-d7e5b2852760 service nova] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] No waiting events found dispatching network-vif-plugged-12f841ee-4cd7-42bc-b5c7-4881419e2e26 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:49:31 user nova-compute[74850]: WARNING nova.compute.manager [req-62c4d574-848b-4a8e-8054-132661c56816 req-13b77ad8-d95a-4557-aa24-d7e5b2852760 service nova] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Received unexpected event network-vif-plugged-12f841ee-4cd7-42bc-b5c7-4881419e2e26 for instance with vm_state building and task_state spawning.
Nov 14 00:49:31 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Instance destroyed successfully.
Nov 14 00:49:31 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Attempting rescue
Nov 14 00:49:31 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74850) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 00:49:31 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Instance directory exists: not creating {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 00:49:31 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Creating image(s)
Nov 14 00:49:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "/opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "/opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "/opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:31 user nova-compute[74850]: DEBUG nova.objects.instance [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lazy-loading 'trusted_certs' on Instance uuid a70d0196-f90e-47c4-be67-bf7ef4c3d8c4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:49:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.172s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk.rescue {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk.rescue" returned: 0 in 0.045s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG nova.objects.instance [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lazy-loading 'migration_context' on Instance uuid a70d0196-f90e-47c4-be67-bf7ef4c3d8c4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG nova.objects.base [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Object Instance<a70d0196-f90e-47c4-be67-bf7ef4c3d8c4> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Start _get_guest_xml network_info=[{"id": "f0de03a3-fd19-4cd1-a408-5168dcf267d7", "address": "fa:16:3e:44:d7:64", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "vif_mac": "fa:16:3e:44:d7:64"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0de03a3-fd", "ovs_interfaceid": "f0de03a3-fd19-4cd1-a408-5168dcf267d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG nova.objects.instance [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lazy-loading 'resources' on Instance uuid a70d0196-f90e-47c4-be67-bf7ef4c3d8c4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG nova.objects.base [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Object Instance<a70d0196-f90e-47c4-be67-bf7ef4c3d8c4> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG nova.objects.instance [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lazy-loading 'numa_topology' on Instance uuid a70d0196-f90e-47c4-be67-bf7ef4c3d8c4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG nova.objects.base [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Object Instance<a70d0196-f90e-47c4-be67-bf7ef4c3d8c4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 00:49:32 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:49:32 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:49:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG nova.objects.instance [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lazy-loading 'vcpu_model' on Instance uuid a70d0196-f90e-47c4-be67-bf7ef4c3d8c4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG nova.objects.base [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Object Instance<a70d0196-f90e-47c4-be67-bf7ef4c3d8c4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:44:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1788047839',display_name='tempest-ServerRescueNegativeTestJSON-server-1788047839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1788047839',id=1,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:44:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e933e8bc63bd442d882ff59243bd7faa',ramdisk_id='',reservation_id='r-ex3095uo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-103787426',owner_user_name='tempest-ServerRescueNegativeTestJSON-103787426-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:44:59Z,user_data=None,user_id='84158c07e3344e01bf82e0e25e2a7244',uuid=a70d0196-f90e-47c4-be67-bf7ef4c3d8c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0de03a3-fd19-4cd1-a408-5168dcf267d7", "address": "fa:16:3e:44:d7:64", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "vif_mac": "fa:16:3e:44:d7:64"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0de03a3-fd", "ovs_interfaceid": "f0de03a3-fd19-4cd1-a408-5168dcf267d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Converting VIF {"id": "f0de03a3-fd19-4cd1-a408-5168dcf267d7", "address": "fa:16:3e:44:d7:64", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "vif_mac": "fa:16:3e:44:d7:64"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0de03a3-fd", "ovs_interfaceid": "f0de03a3-fd19-4cd1-a408-5168dcf267d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:d7:64,bridge_name='br-int',has_traffic_filtering=True,id=f0de03a3-fd19-4cd1-a408-5168dcf267d7,network=Network(4bb9b9bb-4485-4fed-bf0e-f549b29f09da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0de03a3-fd') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG nova.objects.instance [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lazy-loading 'pci_devices' on Instance uuid a70d0196-f90e-47c4-be67-bf7ef4c3d8c4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG nova.objects.base [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Object Instance<a70d0196-f90e-47c4-be67-bf7ef4c3d8c4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:49:32 user nova-compute[74850]:   <uuid>a70d0196-f90e-47c4-be67-bf7ef4c3d8c4</uuid>
Nov 14 00:49:32 user nova-compute[74850]:   <name>instance-00000001</name>
Nov 14 00:49:32 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:49:32 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:49:32 user nova-compute[74850]:   <metadata>
Nov 14 00:49:32 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:49:32 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:49:32 user nova-compute[74850]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1788047839</nova:name>
Nov 14 00:49:32 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:49:32</nova:creationTime>
Nov 14 00:49:32 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:49:32 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:49:32 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:49:32 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:49:32 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:49:32 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:49:32 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:49:32 user nova-compute[74850]:       <nova:owner>
Nov 14 00:49:32 user nova-compute[74850]:         <nova:user uuid="84158c07e3344e01bf82e0e25e2a7244">tempest-ServerRescueNegativeTestJSON-103787426-project-member</nova:user>
Nov 14 00:49:32 user nova-compute[74850]:         <nova:project uuid="e933e8bc63bd442d882ff59243bd7faa">tempest-ServerRescueNegativeTestJSON-103787426</nova:project>
Nov 14 00:49:32 user nova-compute[74850]:       </nova:owner>
Nov 14 00:49:32 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:49:32 user nova-compute[74850]:       <nova:ports>
Nov 14 00:49:32 user nova-compute[74850]:         <nova:port uuid="f0de03a3-fd19-4cd1-a408-5168dcf267d7">
Nov 14 00:49:32 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 00:49:32 user nova-compute[74850]:         </nova:port>
Nov 14 00:49:32 user nova-compute[74850]:       </nova:ports>
Nov 14 00:49:32 user nova-compute[74850]:     </nova:instance>
Nov 14 00:49:32 user nova-compute[74850]:   </metadata>
Nov 14 00:49:32 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:49:32 user nova-compute[74850]:     <system>
Nov 14 00:49:32 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:49:32 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:49:32 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:49:32 user nova-compute[74850]:       <entry name="serial">a70d0196-f90e-47c4-be67-bf7ef4c3d8c4</entry>
Nov 14 00:49:32 user nova-compute[74850]:       <entry name="uuid">a70d0196-f90e-47c4-be67-bf7ef4c3d8c4</entry>
Nov 14 00:49:32 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:49:32 user nova-compute[74850]:     </system>
Nov 14 00:49:32 user nova-compute[74850]:   </sysinfo>
Nov 14 00:49:32 user nova-compute[74850]:   <os>
Nov 14 00:49:32 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:49:32 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:49:32 user nova-compute[74850]:   </os>
Nov 14 00:49:32 user nova-compute[74850]:   <features>
Nov 14 00:49:32 user nova-compute[74850]:     <acpi/>
Nov 14 00:49:32 user nova-compute[74850]:     <apic/>
Nov 14 00:49:32 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:49:32 user nova-compute[74850]:   </features>
Nov 14 00:49:32 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:49:32 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:49:32 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:49:32 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:49:32 user nova-compute[74850]:   </clock>
Nov 14 00:49:32 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:49:32 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:49:32 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:49:32 user nova-compute[74850]:   </cpu>
Nov 14 00:49:32 user nova-compute[74850]:   <devices>
Nov 14 00:49:32 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 00:49:32 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:49:32 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk.rescue"/>
Nov 14 00:49:32 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:49:32 user nova-compute[74850]:     </disk>
Nov 14 00:49:32 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 00:49:32 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:49:32 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk"/>
Nov 14 00:49:32 user nova-compute[74850]:       <target dev="vdb" bus="virtio"/>
Nov 14 00:49:32 user nova-compute[74850]:     </disk>
Nov 14 00:49:32 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:49:32 user nova-compute[74850]:       <mac address="fa:16:3e:44:d7:64"/>
Nov 14 00:49:32 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:49:32 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:49:32 user nova-compute[74850]:       <target dev="tapf0de03a3-fd"/>
Nov 14 00:49:32 user nova-compute[74850]:     </interface>
Nov 14 00:49:32 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:49:32 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/console.log" append="off"/>
Nov 14 00:49:32 user nova-compute[74850]:     </serial>
Nov 14 00:49:32 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:49:32 user nova-compute[74850]:     <video>
Nov 14 00:49:32 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:49:32 user nova-compute[74850]:     </video>
Nov 14 00:49:32 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:49:32 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:49:32 user nova-compute[74850]:     </rng>
Nov 14 00:49:32 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:49:32 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:49:32 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:49:32 user nova-compute[74850]:     </memballoon>
Nov 14 00:49:32 user nova-compute[74850]:   </devices>
Nov 14 00:49:32 user nova-compute[74850]: </domain>
Nov 14 00:49:32 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:49:32 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Instance destroyed successfully.
Nov 14 00:49:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:49:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] No VIF found with MAC fa:16:3e:44:d7:64, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:49:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:33 user nova-compute[74850]: DEBUG nova.compute.manager [req-d73e834e-ad47-4d80-ba4f-5ce3cd9fc055 req-42cc2212-9c6c-455d-8347-c940a0fca4e8 service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Received event network-vif-plugged-f0de03a3-fd19-4cd1-a408-5168dcf267d7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:49:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d73e834e-ad47-4d80-ba4f-5ce3cd9fc055 req-42cc2212-9c6c-455d-8347-c940a0fca4e8 service nova] Acquiring lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d73e834e-ad47-4d80-ba4f-5ce3cd9fc055 req-42cc2212-9c6c-455d-8347-c940a0fca4e8 service nova] Lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d73e834e-ad47-4d80-ba4f-5ce3cd9fc055 req-42cc2212-9c6c-455d-8347-c940a0fca4e8 service nova] Lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:33 user nova-compute[74850]: DEBUG nova.compute.manager [req-d73e834e-ad47-4d80-ba4f-5ce3cd9fc055 req-42cc2212-9c6c-455d-8347-c940a0fca4e8 service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] No waiting events found dispatching network-vif-plugged-f0de03a3-fd19-4cd1-a408-5168dcf267d7 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:49:33 user nova-compute[74850]: WARNING nova.compute.manager [req-d73e834e-ad47-4d80-ba4f-5ce3cd9fc055 req-42cc2212-9c6c-455d-8347-c940a0fca4e8 service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Received unexpected event network-vif-plugged-f0de03a3-fd19-4cd1-a408-5168dcf267d7 for instance with vm_state active and task_state rescuing.
Nov 14 00:49:33 user nova-compute[74850]: DEBUG nova.compute.manager [req-b1f2e727-dd9a-49b7-a4a5-5dc8a46f6592 req-e33c93ed-1260-4038-9033-6a8a52ec1993 service nova] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Received event network-vif-plugged-12f841ee-4cd7-42bc-b5c7-4881419e2e26 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:49:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b1f2e727-dd9a-49b7-a4a5-5dc8a46f6592 req-e33c93ed-1260-4038-9033-6a8a52ec1993 service nova] Acquiring lock "a62a2eab-2502-4275-948b-3f18c3fcff36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b1f2e727-dd9a-49b7-a4a5-5dc8a46f6592 req-e33c93ed-1260-4038-9033-6a8a52ec1993 service nova] Lock "a62a2eab-2502-4275-948b-3f18c3fcff36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b1f2e727-dd9a-49b7-a4a5-5dc8a46f6592 req-e33c93ed-1260-4038-9033-6a8a52ec1993 service nova] Lock "a62a2eab-2502-4275-948b-3f18c3fcff36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:33 user nova-compute[74850]: DEBUG nova.compute.manager [req-b1f2e727-dd9a-49b7-a4a5-5dc8a46f6592 req-e33c93ed-1260-4038-9033-6a8a52ec1993 service nova] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] No waiting events found dispatching network-vif-plugged-12f841ee-4cd7-42bc-b5c7-4881419e2e26 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:49:33 user nova-compute[74850]: WARNING nova.compute.manager [req-b1f2e727-dd9a-49b7-a4a5-5dc8a46f6592 req-e33c93ed-1260-4038-9033-6a8a52ec1993 service nova] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Received unexpected event network-vif-plugged-12f841ee-4cd7-42bc-b5c7-4881419e2e26 for instance with vm_state building and task_state spawning.
Nov 14 00:49:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:33 user nova-compute[74850]: DEBUG nova.compute.manager [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:49:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 00:49:33 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Instance spawned successfully.
Nov 14 00:49:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 00:49:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:49:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:49:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:49:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:49:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:49:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:49:33 user nova-compute[74850]: INFO nova.compute.manager [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Took 5.83 seconds to spawn the instance on the hypervisor.
Nov 14 00:49:33 user nova-compute[74850]: DEBUG nova.compute.manager [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:49:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:33 user nova-compute[74850]: INFO nova.compute.manager [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Took 6.54 seconds to build instance.
Nov 14 00:49:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9cbc6d16-4ba9-43d6-8c0a-99ebfceb6c38 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Lock "a62a2eab-2502-4275-948b-3f18c3fcff36" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.656s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:35 user nova-compute[74850]: DEBUG nova.compute.manager [req-16641a1e-8b87-4667-9f0e-156399434b5a req-d8b24b55-44d5-44dc-9b20-431e6d7bdce7 service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Received event network-vif-plugged-f0de03a3-fd19-4cd1-a408-5168dcf267d7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:49:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-16641a1e-8b87-4667-9f0e-156399434b5a req-d8b24b55-44d5-44dc-9b20-431e6d7bdce7 service nova] Acquiring lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-16641a1e-8b87-4667-9f0e-156399434b5a req-d8b24b55-44d5-44dc-9b20-431e6d7bdce7 service nova] Lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-16641a1e-8b87-4667-9f0e-156399434b5a req-d8b24b55-44d5-44dc-9b20-431e6d7bdce7 service nova] Lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:35 user nova-compute[74850]: DEBUG nova.compute.manager [req-16641a1e-8b87-4667-9f0e-156399434b5a req-d8b24b55-44d5-44dc-9b20-431e6d7bdce7 service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] No waiting events found dispatching network-vif-plugged-f0de03a3-fd19-4cd1-a408-5168dcf267d7 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:49:35 user nova-compute[74850]: WARNING nova.compute.manager [req-16641a1e-8b87-4667-9f0e-156399434b5a req-d8b24b55-44d5-44dc-9b20-431e6d7bdce7 service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Received unexpected event network-vif-plugged-f0de03a3-fd19-4cd1-a408-5168dcf267d7 for instance with vm_state active and task_state rescuing.
Nov 14 00:49:35 user nova-compute[74850]: DEBUG nova.compute.manager [req-16641a1e-8b87-4667-9f0e-156399434b5a req-d8b24b55-44d5-44dc-9b20-431e6d7bdce7 service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Received event network-vif-plugged-f0de03a3-fd19-4cd1-a408-5168dcf267d7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:49:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-16641a1e-8b87-4667-9f0e-156399434b5a req-d8b24b55-44d5-44dc-9b20-431e6d7bdce7 service nova] Acquiring lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-16641a1e-8b87-4667-9f0e-156399434b5a req-d8b24b55-44d5-44dc-9b20-431e6d7bdce7 service nova] Lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-16641a1e-8b87-4667-9f0e-156399434b5a req-d8b24b55-44d5-44dc-9b20-431e6d7bdce7 service nova] Lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:35 user nova-compute[74850]: DEBUG nova.compute.manager [req-16641a1e-8b87-4667-9f0e-156399434b5a req-d8b24b55-44d5-44dc-9b20-431e6d7bdce7 service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] No waiting events found dispatching network-vif-plugged-f0de03a3-fd19-4cd1-a408-5168dcf267d7 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:49:35 user nova-compute[74850]: WARNING nova.compute.manager [req-16641a1e-8b87-4667-9f0e-156399434b5a req-d8b24b55-44d5-44dc-9b20-431e6d7bdce7 service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Received unexpected event network-vif-plugged-f0de03a3-fd19-4cd1-a408-5168dcf267d7 for instance with vm_state active and task_state rescuing.
Nov 14 00:49:36 user nova-compute[74850]: DEBUG nova.compute.manager [None req-fd6451eb-cae5-4e84-a148-70514c8c8c2b tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:49:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fcc1c171-efb4-4f62-9e3a-d1f1cac33252 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Acquiring lock "71af2810-c388-44ad-8bbe-a3052d381e95" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fcc1c171-efb4-4f62-9e3a-d1f1cac33252 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Lock "71af2810-c388-44ad-8bbe-a3052d381e95" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fcc1c171-efb4-4f62-9e3a-d1f1cac33252 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Acquiring lock "71af2810-c388-44ad-8bbe-a3052d381e95-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fcc1c171-efb4-4f62-9e3a-d1f1cac33252 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Lock "71af2810-c388-44ad-8bbe-a3052d381e95-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fcc1c171-efb4-4f62-9e3a-d1f1cac33252 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Lock "71af2810-c388-44ad-8bbe-a3052d381e95-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:41 user nova-compute[74850]: INFO nova.compute.manager [None req-fcc1c171-efb4-4f62-9e3a-d1f1cac33252 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Terminating instance
Nov 14 00:49:41 user nova-compute[74850]: DEBUG nova.compute.manager [None req-fcc1c171-efb4-4f62-9e3a-d1f1cac33252 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 00:49:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:41 user nova-compute[74850]: DEBUG nova.compute.manager [req-e49750c4-a134-474a-a53f-7745280b4df5 req-64f6c887-3d76-4f02-bb9a-c16e21092e0f service nova] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Received event network-vif-unplugged-81e07ee5-cd42-468b-b815-d7a1ce8dcfb9 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:49:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e49750c4-a134-474a-a53f-7745280b4df5 req-64f6c887-3d76-4f02-bb9a-c16e21092e0f service nova] Acquiring lock "71af2810-c388-44ad-8bbe-a3052d381e95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e49750c4-a134-474a-a53f-7745280b4df5 req-64f6c887-3d76-4f02-bb9a-c16e21092e0f service nova] Lock "71af2810-c388-44ad-8bbe-a3052d381e95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e49750c4-a134-474a-a53f-7745280b4df5 req-64f6c887-3d76-4f02-bb9a-c16e21092e0f service nova] Lock "71af2810-c388-44ad-8bbe-a3052d381e95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:41 user nova-compute[74850]: DEBUG nova.compute.manager [req-e49750c4-a134-474a-a53f-7745280b4df5 req-64f6c887-3d76-4f02-bb9a-c16e21092e0f service nova] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] No waiting events found dispatching network-vif-unplugged-81e07ee5-cd42-468b-b815-d7a1ce8dcfb9 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:49:41 user nova-compute[74850]: DEBUG nova.compute.manager [req-e49750c4-a134-474a-a53f-7745280b4df5 req-64f6c887-3d76-4f02-bb9a-c16e21092e0f service nova] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Received event network-vif-unplugged-81e07ee5-cd42-468b-b815-d7a1ce8dcfb9 for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 00:49:41 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Instance destroyed successfully.
Nov 14 00:49:41 user nova-compute[74850]: DEBUG nova.objects.instance [None req-fcc1c171-efb4-4f62-9e3a-d1f1cac33252 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Lazy-loading 'resources' on Instance uuid 71af2810-c388-44ad-8bbe-a3052d381e95 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:49:41 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-fcc1c171-efb4-4f62-9e3a-d1f1cac33252 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:47:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-348664367',display_name='tempest-VolumesActionsTest-instance-348664367',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-348664367',id=13,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:47:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8cae3e5d11c40f0b499837464422c86',ramdisk_id='',reservation_id='r-7m40q6ru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-810325091',owner_user_name='tempest-VolumesActionsTest-810325091-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:47:58Z,user_data=None,user_id='895d12a3660d43ffbdbc8cd4d5e1b989',uuid=71af2810-c388-44ad-8bbe-a3052d381e95,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81e07ee5-cd42-468b-b815-d7a1ce8dcfb9", "address": "fa:16:3e:63:70:44", "network": {"id": "a510ed73-2a44-4945-9e3c-685351d93486", "bridge": "br-int", "label": "tempest-VolumesActionsTest-957592581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8cae3e5d11c40f0b499837464422c86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e07ee5-cd", "ovs_interfaceid": "81e07ee5-cd42-468b-b815-d7a1ce8dcfb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:49:41 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-fcc1c171-efb4-4f62-9e3a-d1f1cac33252 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Converting VIF {"id": "81e07ee5-cd42-468b-b815-d7a1ce8dcfb9", "address": "fa:16:3e:63:70:44", "network": {"id": "a510ed73-2a44-4945-9e3c-685351d93486", "bridge": "br-int", "label": "tempest-VolumesActionsTest-957592581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8cae3e5d11c40f0b499837464422c86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e07ee5-cd", "ovs_interfaceid": "81e07ee5-cd42-468b-b815-d7a1ce8dcfb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:49:41 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-fcc1c171-efb4-4f62-9e3a-d1f1cac33252 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:70:44,bridge_name='br-int',has_traffic_filtering=True,id=81e07ee5-cd42-468b-b815-d7a1ce8dcfb9,network=Network(a510ed73-2a44-4945-9e3c-685351d93486),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81e07ee5-cd') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:49:41 user nova-compute[74850]: DEBUG os_vif [None req-fcc1c171-efb4-4f62-9e3a-d1f1cac33252 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:70:44,bridge_name='br-int',has_traffic_filtering=True,id=81e07ee5-cd42-468b-b815-d7a1ce8dcfb9,network=Network(a510ed73-2a44-4945-9e3c-685351d93486),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81e07ee5-cd') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:49:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81e07ee5-cd, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:49:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4da768d1-5d53-48c2-aa28-5af489c1a92d) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:49:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:42 user nova-compute[74850]: INFO os_vif [None req-fcc1c171-efb4-4f62-9e3a-d1f1cac33252 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:70:44,bridge_name='br-int',has_traffic_filtering=True,id=81e07ee5-cd42-468b-b815-d7a1ce8dcfb9,network=Network(a510ed73-2a44-4945-9e3c-685351d93486),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81e07ee5-cd')
Nov 14 00:49:42 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-fcc1c171-efb4-4f62-9e3a-d1f1cac33252 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Deleting instance files /opt/stack/data/nova/instances/71af2810-c388-44ad-8bbe-a3052d381e95_del
Nov 14 00:49:42 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-fcc1c171-efb4-4f62-9e3a-d1f1cac33252 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Deletion of /opt/stack/data/nova/instances/71af2810-c388-44ad-8bbe-a3052d381e95_del complete
Nov 14 00:49:42 user nova-compute[74850]: INFO nova.compute.manager [None req-fcc1c171-efb4-4f62-9e3a-d1f1cac33252 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Took 0.74 seconds to destroy the instance on the hypervisor.
Nov 14 00:49:42 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-fcc1c171-efb4-4f62-9e3a-d1f1cac33252 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 00:49:42 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 00:49:42 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 00:49:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:42 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:49:42 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Took 0.79 seconds to deallocate network for instance.
Nov 14 00:49:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fcc1c171-efb4-4f62-9e3a-d1f1cac33252 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fcc1c171-efb4-4f62-9e3a-d1f1cac33252 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:43 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-fcc1c171-efb4-4f62-9e3a-d1f1cac33252 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:49:43 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-fcc1c171-efb4-4f62-9e3a-d1f1cac33252 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:49:43 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fcc1c171-efb4-4f62-9e3a-d1f1cac33252 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.413s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:43 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-fcc1c171-efb4-4f62-9e3a-d1f1cac33252 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Deleted allocations for instance 71af2810-c388-44ad-8bbe-a3052d381e95
Nov 14 00:49:43 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fcc1c171-efb4-4f62-9e3a-d1f1cac33252 tempest-VolumesActionsTest-810325091 tempest-VolumesActionsTest-810325091-project-member] Lock "71af2810-c388-44ad-8bbe-a3052d381e95" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.138s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:43 user nova-compute[74850]: DEBUG nova.compute.manager [req-e64e3e6b-c4ae-4830-be7d-2d75d9ced14c req-a5ee9972-aeaa-4e26-bb6c-57da17159932 service nova] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Received event network-vif-plugged-81e07ee5-cd42-468b-b815-d7a1ce8dcfb9 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:49:43 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e64e3e6b-c4ae-4830-be7d-2d75d9ced14c req-a5ee9972-aeaa-4e26-bb6c-57da17159932 service nova] Acquiring lock "71af2810-c388-44ad-8bbe-a3052d381e95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:43 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e64e3e6b-c4ae-4830-be7d-2d75d9ced14c req-a5ee9972-aeaa-4e26-bb6c-57da17159932 service nova] Lock "71af2810-c388-44ad-8bbe-a3052d381e95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:43 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e64e3e6b-c4ae-4830-be7d-2d75d9ced14c req-a5ee9972-aeaa-4e26-bb6c-57da17159932 service nova] Lock "71af2810-c388-44ad-8bbe-a3052d381e95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:43 user nova-compute[74850]: DEBUG nova.compute.manager [req-e64e3e6b-c4ae-4830-be7d-2d75d9ced14c req-a5ee9972-aeaa-4e26-bb6c-57da17159932 service nova] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] No waiting events found dispatching network-vif-plugged-81e07ee5-cd42-468b-b815-d7a1ce8dcfb9 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:49:43 user nova-compute[74850]: WARNING nova.compute.manager [req-e64e3e6b-c4ae-4830-be7d-2d75d9ced14c req-a5ee9972-aeaa-4e26-bb6c-57da17159932 service nova] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Received unexpected event network-vif-plugged-81e07ee5-cd42-468b-b815-d7a1ce8dcfb9 for instance with vm_state deleted and task_state None.
Nov 14 00:49:43 user nova-compute[74850]: DEBUG nova.compute.manager [req-e64e3e6b-c4ae-4830-be7d-2d75d9ced14c req-a5ee9972-aeaa-4e26-bb6c-57da17159932 service nova] [instance: 71af2810-c388-44ad-8bbe-a3052d381e95] Received event network-vif-deleted-81e07ee5-cd42-468b-b815-d7a1ce8dcfb9 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:49:43 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:49:43 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:49:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:44 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:49:44 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:49:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:44 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 00:49:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415808a8-c17b-49bf-8a4e-ac19553cdb19/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415808a8-c17b-49bf-8a4e-ac19553cdb19/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415808a8-c17b-49bf-8a4e-ac19553cdb19/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415808a8-c17b-49bf-8a4e-ac19553cdb19/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28212eec-99be-4171-97ed-7748bbb75c88/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28212eec-99be-4171-97ed-7748bbb75c88/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28212eec-99be-4171-97ed-7748bbb75c88/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28212eec-99be-4171-97ed-7748bbb75c88/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3241c4d1-0454-4604-ade4-c38ae72fd64c/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3241c4d1-0454-4604-ade4-c38ae72fd64c/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3241c4d1-0454-4604-ade4-c38ae72fd64c/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3241c4d1-0454-4604-ade4-c38ae72fd64c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "748d0da7-bbb9-4e86-aae3-e48b1fa04c14" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "748d0da7-bbb9-4e86-aae3-e48b1fa04c14" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:47 user nova-compute[74850]: DEBUG nova.compute.manager [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 00:49:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:47 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 00:49:47 user nova-compute[74850]: INFO nova.compute.claims [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Claim successful on node user
Nov 14 00:49:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:47 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:49:47 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:49:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.571s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:48 user nova-compute[74850]: DEBUG nova.compute.manager [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 00:49:48 user nova-compute[74850]: DEBUG nova.compute.manager [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 00:49:48 user nova-compute[74850]: DEBUG nova.network.neutron [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 00:49:48 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 00:49:48 user nova-compute[74850]: DEBUG nova.compute.manager [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 00:49:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:48 user nova-compute[74850]: DEBUG nova.policy [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dab7bcadfc32457e8bfa6fa81cba2702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d09cd8d15a4b058988fa348d7fdc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 00:49:48 user nova-compute[74850]: DEBUG nova.compute.manager [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 00:49:48 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 00:49:48 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Creating image(s)
Nov 14 00:49:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "/opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "/opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "/opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.171s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.187s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk 1073741824" returned: 0 in 0.092s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:48 user nova-compute[74850]: DEBUG nova.network.neutron [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Successfully created port: 11d8d21f-e53e-4277-a1d1-36e99c3bcd62 {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:49:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.183s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:48 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Checking if we can resize image /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 00:49:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:49:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:49 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Cannot resize image /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 00:49:49 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 00:49:49 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Ensure instance console log exists: /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 00:49:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:49:49 user nova-compute[74850]: DEBUG nova.network.neutron [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Successfully updated port: 11d8d21f-e53e-4277-a1d1-36e99c3bcd62 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:49:49 user nova-compute[74850]: DEBUG nova.compute.manager [req-c926eb5f-6275-46f8-b23b-463355e1c117 req-c592acd6-441a-4f37-98ef-53c2e553d597 service nova] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Received event network-changed-11d8d21f-e53e-4277-a1d1-36e99c3bcd62 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:49:49 user nova-compute[74850]: DEBUG nova.compute.manager [req-c926eb5f-6275-46f8-b23b-463355e1c117 req-c592acd6-441a-4f37-98ef-53c2e553d597 service nova] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Refreshing instance network info cache due to event network-changed-11d8d21f-e53e-4277-a1d1-36e99c3bcd62. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:49:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c926eb5f-6275-46f8-b23b-463355e1c117 req-c592acd6-441a-4f37-98ef-53c2e553d597 service nova] Acquiring lock "refresh_cache-748d0da7-bbb9-4e86-aae3-e48b1fa04c14" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:49:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c926eb5f-6275-46f8-b23b-463355e1c117 req-c592acd6-441a-4f37-98ef-53c2e553d597 service nova] Acquired lock "refresh_cache-748d0da7-bbb9-4e86-aae3-e48b1fa04c14" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:49:49 user nova-compute[74850]: DEBUG nova.network.neutron [req-c926eb5f-6275-46f8-b23b-463355e1c117 req-c592acd6-441a-4f37-98ef-53c2e553d597 service nova] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Refreshing network info cache for port 11d8d21f-e53e-4277-a1d1-36e99c3bcd62 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:49:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "refresh_cache-748d0da7-bbb9-4e86-aae3-e48b1fa04c14" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:49:49 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:49:49 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:49:49 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=7538MB free_disk=25.436851501464844GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 00:49:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:49 user nova-compute[74850]: DEBUG nova.network.neutron [req-c926eb5f-6275-46f8-b23b-463355e1c117 req-c592acd6-441a-4f37-98ef-53c2e553d597 service nova] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:49:49 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance a70d0196-f90e-47c4-be67-bf7ef4c3d8c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:49:49 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 1879be4c-9226-4c8c-a56c-f8e37398851b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:49:49 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 28212eec-99be-4171-97ed-7748bbb75c88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:49:49 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 3241c4d1-0454-4604-ade4-c38ae72fd64c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:49:49 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 415808a8-c17b-49bf-8a4e-ac19553cdb19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:49:49 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 4f1102c5-f5ef-48d5-b271-6e25bee5cc70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:49:49 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 7f115ae8-49da-4bf5-ae7c-62696769420c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:49:49 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 4b60ac08-e954-46d5-a280-a11146b3ebf4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:49:49 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance a62a2eab-2502-4275-948b-3f18c3fcff36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:49:49 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 748d0da7-bbb9-4e86-aae3-e48b1fa04c14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:49:49 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 00:49:49 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 00:49:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:49 user nova-compute[74850]: DEBUG nova.network.neutron [req-c926eb5f-6275-46f8-b23b-463355e1c117 req-c592acd6-441a-4f37-98ef-53c2e553d597 service nova] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:49:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c926eb5f-6275-46f8-b23b-463355e1c117 req-c592acd6-441a-4f37-98ef-53c2e553d597 service nova] Releasing lock "refresh_cache-748d0da7-bbb9-4e86-aae3-e48b1fa04c14" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:49:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquired lock "refresh_cache-748d0da7-bbb9-4e86-aae3-e48b1fa04c14" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:49:49 user nova-compute[74850]: DEBUG nova.network.neutron [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG nova.network.neutron [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.429s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG nova.network.neutron [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Updating instance_info_cache with network_info: [{"id": "11d8d21f-e53e-4277-a1d1-36e99c3bcd62", "address": "fa:16:3e:f2:d6:a0", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d8d21f-e5", "ovs_interfaceid": "11d8d21f-e53e-4277-a1d1-36e99c3bcd62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Releasing lock "refresh_cache-748d0da7-bbb9-4e86-aae3-e48b1fa04c14" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG nova.compute.manager [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Instance network_info: |[{"id": "11d8d21f-e53e-4277-a1d1-36e99c3bcd62", "address": "fa:16:3e:f2:d6:a0", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d8d21f-e5", "ovs_interfaceid": "11d8d21f-e53e-4277-a1d1-36e99c3bcd62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Start _get_guest_xml network_info=[{"id": "11d8d21f-e53e-4277-a1d1-36e99c3bcd62", "address": "fa:16:3e:f2:d6:a0", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d8d21f-e5", "ovs_interfaceid": "11d8d21f-e53e-4277-a1d1-36e99c3bcd62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:49:50 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:49:50 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:49:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:49:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-38839616',display_name='tempest-ServerActionsTestOtherA-server-38839616',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-38839616',id=20,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEDBs7Es/72p/FM9xIVe3NSPFzUvxLUb0JwmaT04oo+hgQgHwN4cwLNmRX2VhLFhce2UGzsRv1c1pV/ZeRW8oCrRJ/Tmr/k2YN/XTGeAv4iUUyvZpvQioCuIlgWRqA+LA==',key_name='tempest-keypair-638803187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67d09cd8d15a4b058988fa348d7fdc2e',ramdisk_id='',reservation_id='r-4lmh5v1t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1680693726',owner_user_name='tempest-ServerActionsTestOtherA-1680693726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:49:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dab7bcadfc32457e8bfa6fa81cba2702',uuid=748d0da7-bbb9-4e86-aae3-e48b1fa04c14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11d8d21f-e53e-4277-a1d1-36e99c3bcd62", "address": "fa:16:3e:f2:d6:a0", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d8d21f-e5", "ovs_interfaceid": "11d8d21f-e53e-4277-a1d1-36e99c3bcd62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Converting VIF {"id": "11d8d21f-e53e-4277-a1d1-36e99c3bcd62", "address": "fa:16:3e:f2:d6:a0", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d8d21f-e5", "ovs_interfaceid": "11d8d21f-e53e-4277-a1d1-36e99c3bcd62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:d6:a0,bridge_name='br-int',has_traffic_filtering=True,id=11d8d21f-e53e-4277-a1d1-36e99c3bcd62,network=Network(6e563565-dc0c-4f19-9030-742bf28811d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11d8d21f-e5') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG nova.objects.instance [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lazy-loading 'pci_devices' on Instance uuid 748d0da7-bbb9-4e86-aae3-e48b1fa04c14 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:49:50 user nova-compute[74850]:   <uuid>748d0da7-bbb9-4e86-aae3-e48b1fa04c14</uuid>
Nov 14 00:49:50 user nova-compute[74850]:   <name>instance-00000014</name>
Nov 14 00:49:50 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:49:50 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:49:50 user nova-compute[74850]:   <metadata>
Nov 14 00:49:50 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:49:50 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:49:50 user nova-compute[74850]:       <nova:name>tempest-ServerActionsTestOtherA-server-38839616</nova:name>
Nov 14 00:49:50 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:49:50</nova:creationTime>
Nov 14 00:49:50 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:49:50 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:49:50 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:49:50 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:49:50 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:49:50 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:49:50 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:49:50 user nova-compute[74850]:       <nova:owner>
Nov 14 00:49:50 user nova-compute[74850]:         <nova:user uuid="dab7bcadfc32457e8bfa6fa81cba2702">tempest-ServerActionsTestOtherA-1680693726-project-member</nova:user>
Nov 14 00:49:50 user nova-compute[74850]:         <nova:project uuid="67d09cd8d15a4b058988fa348d7fdc2e">tempest-ServerActionsTestOtherA-1680693726</nova:project>
Nov 14 00:49:50 user nova-compute[74850]:       </nova:owner>
Nov 14 00:49:50 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:49:50 user nova-compute[74850]:       <nova:ports>
Nov 14 00:49:50 user nova-compute[74850]:         <nova:port uuid="11d8d21f-e53e-4277-a1d1-36e99c3bcd62">
Nov 14 00:49:50 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 00:49:50 user nova-compute[74850]:         </nova:port>
Nov 14 00:49:50 user nova-compute[74850]:       </nova:ports>
Nov 14 00:49:50 user nova-compute[74850]:     </nova:instance>
Nov 14 00:49:50 user nova-compute[74850]:   </metadata>
Nov 14 00:49:50 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:49:50 user nova-compute[74850]:     <system>
Nov 14 00:49:50 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:49:50 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:49:50 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:49:50 user nova-compute[74850]:       <entry name="serial">748d0da7-bbb9-4e86-aae3-e48b1fa04c14</entry>
Nov 14 00:49:50 user nova-compute[74850]:       <entry name="uuid">748d0da7-bbb9-4e86-aae3-e48b1fa04c14</entry>
Nov 14 00:49:50 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:49:50 user nova-compute[74850]:     </system>
Nov 14 00:49:50 user nova-compute[74850]:   </sysinfo>
Nov 14 00:49:50 user nova-compute[74850]:   <os>
Nov 14 00:49:50 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:49:50 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 00:49:50 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:49:50 user nova-compute[74850]:   </os>
Nov 14 00:49:50 user nova-compute[74850]:   <features>
Nov 14 00:49:50 user nova-compute[74850]:     <acpi/>
Nov 14 00:49:50 user nova-compute[74850]:     <apic/>
Nov 14 00:49:50 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:49:50 user nova-compute[74850]:   </features>
Nov 14 00:49:50 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:49:50 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:49:50 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:49:50 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:49:50 user nova-compute[74850]:   </clock>
Nov 14 00:49:50 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:49:50 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:49:50 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:49:50 user nova-compute[74850]:   </cpu>
Nov 14 00:49:50 user nova-compute[74850]:   <devices>
Nov 14 00:49:50 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 00:49:50 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:49:50 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk"/>
Nov 14 00:49:50 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:49:50 user nova-compute[74850]:     </disk>
Nov 14 00:49:50 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:49:50 user nova-compute[74850]:       <mac address="fa:16:3e:f2:d6:a0"/>
Nov 14 00:49:50 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:49:50 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:49:50 user nova-compute[74850]:       <target dev="tap11d8d21f-e5"/>
Nov 14 00:49:50 user nova-compute[74850]:     </interface>
Nov 14 00:49:50 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:49:50 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/console.log" append="off"/>
Nov 14 00:49:50 user nova-compute[74850]:     </serial>
Nov 14 00:49:50 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:49:50 user nova-compute[74850]:     <video>
Nov 14 00:49:50 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:49:50 user nova-compute[74850]:     </video>
Nov 14 00:49:50 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:49:50 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:49:50 user nova-compute[74850]:     </rng>
Nov 14 00:49:50 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:49:50 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:49:50 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:49:50 user nova-compute[74850]:     </memballoon>
Nov 14 00:49:50 user nova-compute[74850]:   </devices>
Nov 14 00:49:50 user nova-compute[74850]: </domain>
Nov 14 00:49:50 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:49:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-38839616',display_name='tempest-ServerActionsTestOtherA-server-38839616',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-38839616',id=20,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEDBs7Es/72p/FM9xIVe3NSPFzUvxLUb0JwmaT04oo+hgQgHwN4cwLNmRX2VhLFhce2UGzsRv1c1pV/ZeRW8oCrRJ/Tmr/k2YN/XTGeAv4iUUyvZpvQioCuIlgWRqA+LA==',key_name='tempest-keypair-638803187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67d09cd8d15a4b058988fa348d7fdc2e',ramdisk_id='',reservation_id='r-4lmh5v1t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1680693726',owner_user_name='tempest-ServerActionsTestOtherA-1680693726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:49:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dab7bcadfc32457e8bfa6fa81cba2702',uuid=748d0da7-bbb9-4e86-aae3-e48b1fa04c14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11d8d21f-e53e-4277-a1d1-36e99c3bcd62", "address": "fa:16:3e:f2:d6:a0", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d8d21f-e5", "ovs_interfaceid": "11d8d21f-e53e-4277-a1d1-36e99c3bcd62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Converting VIF {"id": "11d8d21f-e53e-4277-a1d1-36e99c3bcd62", "address": "fa:16:3e:f2:d6:a0", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d8d21f-e5", "ovs_interfaceid": "11d8d21f-e53e-4277-a1d1-36e99c3bcd62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:d6:a0,bridge_name='br-int',has_traffic_filtering=True,id=11d8d21f-e53e-4277-a1d1-36e99c3bcd62,network=Network(6e563565-dc0c-4f19-9030-742bf28811d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11d8d21f-e5') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG os_vif [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:d6:a0,bridge_name='br-int',has_traffic_filtering=True,id=11d8d21f-e53e-4277-a1d1-36e99c3bcd62,network=Network(6e563565-dc0c-4f19-9030-742bf28811d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11d8d21f-e5') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fcb36764-dff3-5dca-b430-3dfcab70b788', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11d8d21f-e5, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap11d8d21f-e5, col_values=(('qos', UUID('62aa55c1-ff27-4d98-844e-9ddc6732d459')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap11d8d21f-e5, col_values=(('external_ids', {'iface-id': '11d8d21f-e53e-4277-a1d1-36e99c3bcd62', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:d6:a0', 'vm-uuid': '748d0da7-bbb9-4e86-aae3-e48b1fa04c14'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:50 user nova-compute[74850]: INFO os_vif [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:d6:a0,bridge_name='br-int',has_traffic_filtering=True,id=11d8d21f-e53e-4277-a1d1-36e99c3bcd62,network=Network(6e563565-dc0c-4f19-9030-742bf28811d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11d8d21f-e5')
Nov 14 00:49:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:49:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] No VIF found with MAC fa:16:3e:f2:d6:a0, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:49:51 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:49:51 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:49:51 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 00:49:51 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Didn't find any instances for network info cache update. {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 00:49:51 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:49:51 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:49:51 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:49:51 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 00:49:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:51 user nova-compute[74850]: DEBUG nova.compute.manager [req-9fbe66f8-2d12-47e5-9cd5-a2d15794ce17 req-6895c4d8-d8c8-4a6f-b986-fb32bb6869e6 service nova] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Received event network-vif-plugged-11d8d21f-e53e-4277-a1d1-36e99c3bcd62 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:49:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9fbe66f8-2d12-47e5-9cd5-a2d15794ce17 req-6895c4d8-d8c8-4a6f-b986-fb32bb6869e6 service nova] Acquiring lock "748d0da7-bbb9-4e86-aae3-e48b1fa04c14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9fbe66f8-2d12-47e5-9cd5-a2d15794ce17 req-6895c4d8-d8c8-4a6f-b986-fb32bb6869e6 service nova] Lock "748d0da7-bbb9-4e86-aae3-e48b1fa04c14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9fbe66f8-2d12-47e5-9cd5-a2d15794ce17 req-6895c4d8-d8c8-4a6f-b986-fb32bb6869e6 service nova] Lock "748d0da7-bbb9-4e86-aae3-e48b1fa04c14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:51 user nova-compute[74850]: DEBUG nova.compute.manager [req-9fbe66f8-2d12-47e5-9cd5-a2d15794ce17 req-6895c4d8-d8c8-4a6f-b986-fb32bb6869e6 service nova] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] No waiting events found dispatching network-vif-plugged-11d8d21f-e53e-4277-a1d1-36e99c3bcd62 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:49:51 user nova-compute[74850]: WARNING nova.compute.manager [req-9fbe66f8-2d12-47e5-9cd5-a2d15794ce17 req-6895c4d8-d8c8-4a6f-b986-fb32bb6869e6 service nova] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Received unexpected event network-vif-plugged-11d8d21f-e53e-4277-a1d1-36e99c3bcd62 for instance with vm_state building and task_state spawning.
Nov 14 00:49:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:53 user nova-compute[74850]: DEBUG nova.compute.manager [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:49:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 00:49:53 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Instance spawned successfully.
Nov 14 00:49:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 00:49:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:49:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:49:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:49:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:49:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:49:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:49:54 user nova-compute[74850]: DEBUG nova.compute.manager [req-eede354e-fccd-403f-aa93-3d92adb70263 req-058af2ee-99d0-4a1e-acae-18b14271adfd service nova] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Received event network-vif-plugged-11d8d21f-e53e-4277-a1d1-36e99c3bcd62 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:49:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-eede354e-fccd-403f-aa93-3d92adb70263 req-058af2ee-99d0-4a1e-acae-18b14271adfd service nova] Acquiring lock "748d0da7-bbb9-4e86-aae3-e48b1fa04c14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:49:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-eede354e-fccd-403f-aa93-3d92adb70263 req-058af2ee-99d0-4a1e-acae-18b14271adfd service nova] Lock "748d0da7-bbb9-4e86-aae3-e48b1fa04c14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:49:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-eede354e-fccd-403f-aa93-3d92adb70263 req-058af2ee-99d0-4a1e-acae-18b14271adfd service nova] Lock "748d0da7-bbb9-4e86-aae3-e48b1fa04c14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:54 user nova-compute[74850]: DEBUG nova.compute.manager [req-eede354e-fccd-403f-aa93-3d92adb70263 req-058af2ee-99d0-4a1e-acae-18b14271adfd service nova] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] No waiting events found dispatching network-vif-plugged-11d8d21f-e53e-4277-a1d1-36e99c3bcd62 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:49:54 user nova-compute[74850]: WARNING nova.compute.manager [req-eede354e-fccd-403f-aa93-3d92adb70263 req-058af2ee-99d0-4a1e-acae-18b14271adfd service nova] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Received unexpected event network-vif-plugged-11d8d21f-e53e-4277-a1d1-36e99c3bcd62 for instance with vm_state building and task_state spawning.
Nov 14 00:49:54 user nova-compute[74850]: INFO nova.compute.manager [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Took 5.74 seconds to spawn the instance on the hypervisor.
Nov 14 00:49:54 user nova-compute[74850]: DEBUG nova.compute.manager [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:49:54 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:54 user nova-compute[74850]: INFO nova.compute.manager [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Took 6.75 seconds to build instance.
Nov 14 00:49:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b0e16f5a-e60c-4342-8de3-14a2e4f94c46 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "748d0da7-bbb9-4e86-aae3-e48b1fa04c14" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.861s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:49:54 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:49:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5a0611ae-57ad-423b-813c-218de1f077ce tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Acquiring lock "3241c4d1-0454-4604-ade4-c38ae72fd64c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:50:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5a0611ae-57ad-423b-813c-218de1f077ce tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "3241c4d1-0454-4604-ade4-c38ae72fd64c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:50:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5a0611ae-57ad-423b-813c-218de1f077ce tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Acquiring lock "3241c4d1-0454-4604-ade4-c38ae72fd64c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:50:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5a0611ae-57ad-423b-813c-218de1f077ce tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "3241c4d1-0454-4604-ade4-c38ae72fd64c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:50:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5a0611ae-57ad-423b-813c-218de1f077ce tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "3241c4d1-0454-4604-ade4-c38ae72fd64c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:50:00 user nova-compute[74850]: INFO nova.compute.manager [None req-5a0611ae-57ad-423b-813c-218de1f077ce tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Terminating instance
Nov 14 00:50:00 user nova-compute[74850]: DEBUG nova.compute.manager [None req-5a0611ae-57ad-423b-813c-218de1f077ce tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 00:50:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:01 user nova-compute[74850]: DEBUG nova.compute.manager [req-800bdeeb-8287-48dc-bfd9-95968d45e7ed req-06933e29-6fa0-4613-988d-ef71107f7c85 service nova] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Received event network-vif-unplugged-2df34162-ff76-4cd8-a7b8-26517bcfdb8d {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:50:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-800bdeeb-8287-48dc-bfd9-95968d45e7ed req-06933e29-6fa0-4613-988d-ef71107f7c85 service nova] Acquiring lock "3241c4d1-0454-4604-ade4-c38ae72fd64c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:50:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-800bdeeb-8287-48dc-bfd9-95968d45e7ed req-06933e29-6fa0-4613-988d-ef71107f7c85 service nova] Lock "3241c4d1-0454-4604-ade4-c38ae72fd64c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:50:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-800bdeeb-8287-48dc-bfd9-95968d45e7ed req-06933e29-6fa0-4613-988d-ef71107f7c85 service nova] Lock "3241c4d1-0454-4604-ade4-c38ae72fd64c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:50:01 user nova-compute[74850]: DEBUG nova.compute.manager [req-800bdeeb-8287-48dc-bfd9-95968d45e7ed req-06933e29-6fa0-4613-988d-ef71107f7c85 service nova] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] No waiting events found dispatching network-vif-unplugged-2df34162-ff76-4cd8-a7b8-26517bcfdb8d {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:50:01 user nova-compute[74850]: DEBUG nova.compute.manager [req-800bdeeb-8287-48dc-bfd9-95968d45e7ed req-06933e29-6fa0-4613-988d-ef71107f7c85 service nova] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Received event network-vif-unplugged-2df34162-ff76-4cd8-a7b8-26517bcfdb8d for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 00:50:01 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Instance destroyed successfully.
Nov 14 00:50:01 user nova-compute[74850]: DEBUG nova.objects.instance [None req-5a0611ae-57ad-423b-813c-218de1f077ce tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lazy-loading 'resources' on Instance uuid 3241c4d1-0454-4604-ade4-c38ae72fd64c {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:50:01 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-5a0611ae-57ad-423b-813c-218de1f077ce tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:48:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2050352988',display_name='tempest-VolumesAdminNegativeTest-server-2050352988',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2050352988',id=14,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:48:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51c848440ceb46dabf1eb8cca6533f09',ramdisk_id='',reservation_id='r-6sksu2gr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-43619810',owner_user_name='tempest-VolumesAdminNegativeTest-43619810-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:48:13Z,user_data=None,user_id='7cb1b3c8b5c24f399c674f9dde90aadc',uuid=3241c4d1-0454-4604-ade4-c38ae72fd64c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2df34162-ff76-4cd8-a7b8-26517bcfdb8d", "address": "fa:16:3e:26:84:1a", "network": {"id": "25547f45-3d27-4a3f-b2d2-6f0a0b4ae730", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-464974831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51c848440ceb46dabf1eb8cca6533f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df34162-ff", "ovs_interfaceid": "2df34162-ff76-4cd8-a7b8-26517bcfdb8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:50:01 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-5a0611ae-57ad-423b-813c-218de1f077ce tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Converting VIF {"id": "2df34162-ff76-4cd8-a7b8-26517bcfdb8d", "address": "fa:16:3e:26:84:1a", "network": {"id": "25547f45-3d27-4a3f-b2d2-6f0a0b4ae730", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-464974831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51c848440ceb46dabf1eb8cca6533f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df34162-ff", "ovs_interfaceid": "2df34162-ff76-4cd8-a7b8-26517bcfdb8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:50:01 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-5a0611ae-57ad-423b-813c-218de1f077ce tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:84:1a,bridge_name='br-int',has_traffic_filtering=True,id=2df34162-ff76-4cd8-a7b8-26517bcfdb8d,network=Network(25547f45-3d27-4a3f-b2d2-6f0a0b4ae730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df34162-ff') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:50:01 user nova-compute[74850]: DEBUG os_vif [None req-5a0611ae-57ad-423b-813c-218de1f077ce tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:84:1a,bridge_name='br-int',has_traffic_filtering=True,id=2df34162-ff76-4cd8-a7b8-26517bcfdb8d,network=Network(25547f45-3d27-4a3f-b2d2-6f0a0b4ae730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df34162-ff') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:50:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2df34162-ff, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:50:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:50:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b4b3641-4853-4ea5-8953-08907d56c83f) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:50:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:01 user nova-compute[74850]: INFO os_vif [None req-5a0611ae-57ad-423b-813c-218de1f077ce tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:84:1a,bridge_name='br-int',has_traffic_filtering=True,id=2df34162-ff76-4cd8-a7b8-26517bcfdb8d,network=Network(25547f45-3d27-4a3f-b2d2-6f0a0b4ae730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df34162-ff')
Nov 14 00:50:01 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-5a0611ae-57ad-423b-813c-218de1f077ce tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Deleting instance files /opt/stack/data/nova/instances/3241c4d1-0454-4604-ade4-c38ae72fd64c_del
Nov 14 00:50:01 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-5a0611ae-57ad-423b-813c-218de1f077ce tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Deletion of /opt/stack/data/nova/instances/3241c4d1-0454-4604-ade4-c38ae72fd64c_del complete
Nov 14 00:50:01 user nova-compute[74850]: INFO nova.compute.manager [None req-5a0611ae-57ad-423b-813c-218de1f077ce tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 00:50:01 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-5a0611ae-57ad-423b-813c-218de1f077ce tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 00:50:01 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 00:50:01 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 00:50:02 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:50:02 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Took 0.41 seconds to deallocate network for instance.
Nov 14 00:50:02 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5a0611ae-57ad-423b-813c-218de1f077ce tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:50:02 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5a0611ae-57ad-423b-813c-218de1f077ce tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:50:02 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-5a0611ae-57ad-423b-813c-218de1f077ce tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:50:02 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-5a0611ae-57ad-423b-813c-218de1f077ce tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:50:02 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5a0611ae-57ad-423b-813c-218de1f077ce tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.316s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:50:02 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-5a0611ae-57ad-423b-813c-218de1f077ce tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Deleted allocations for instance 3241c4d1-0454-4604-ade4-c38ae72fd64c
Nov 14 00:50:02 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5a0611ae-57ad-423b-813c-218de1f077ce tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "3241c4d1-0454-4604-ade4-c38ae72fd64c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.792s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:50:03 user nova-compute[74850]: DEBUG nova.compute.manager [req-0d698689-59a8-4b73-93b5-4aaa457d8709 req-249b9f33-91a8-4205-ab21-75171ee6ade6 service nova] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Received event network-vif-plugged-2df34162-ff76-4cd8-a7b8-26517bcfdb8d {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:50:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-0d698689-59a8-4b73-93b5-4aaa457d8709 req-249b9f33-91a8-4205-ab21-75171ee6ade6 service nova] Acquiring lock "3241c4d1-0454-4604-ade4-c38ae72fd64c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:50:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-0d698689-59a8-4b73-93b5-4aaa457d8709 req-249b9f33-91a8-4205-ab21-75171ee6ade6 service nova] Lock "3241c4d1-0454-4604-ade4-c38ae72fd64c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:50:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-0d698689-59a8-4b73-93b5-4aaa457d8709 req-249b9f33-91a8-4205-ab21-75171ee6ade6 service nova] Lock "3241c4d1-0454-4604-ade4-c38ae72fd64c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:50:03 user nova-compute[74850]: DEBUG nova.compute.manager [req-0d698689-59a8-4b73-93b5-4aaa457d8709 req-249b9f33-91a8-4205-ab21-75171ee6ade6 service nova] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] No waiting events found dispatching network-vif-plugged-2df34162-ff76-4cd8-a7b8-26517bcfdb8d {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:50:03 user nova-compute[74850]: WARNING nova.compute.manager [req-0d698689-59a8-4b73-93b5-4aaa457d8709 req-249b9f33-91a8-4205-ab21-75171ee6ade6 service nova] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Received unexpected event network-vif-plugged-2df34162-ff76-4cd8-a7b8-26517bcfdb8d for instance with vm_state deleted and task_state None.
Nov 14 00:50:03 user nova-compute[74850]: DEBUG nova.compute.manager [req-0d698689-59a8-4b73-93b5-4aaa457d8709 req-249b9f33-91a8-4205-ab21-75171ee6ade6 service nova] [instance: 3241c4d1-0454-4604-ade4-c38ae72fd64c] Received event network-vif-deleted-2df34162-ff76-4cd8-a7b8-26517bcfdb8d {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:50:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:30 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Acquiring lock "1f3a0b8f-1591-49c8-afb1-88437d65fb75" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:50:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lock "1f3a0b8f-1591-49c8-afb1-88437d65fb75" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:50:34 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 00:50:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:50:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:50:35 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 00:50:35 user nova-compute[74850]: INFO nova.compute.claims [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Claim successful on node user
Nov 14 00:50:35 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:50:35 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:50:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.386s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:50:35 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 00:50:35 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 00:50:35 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 00:50:35 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 00:50:35 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 00:50:35 user nova-compute[74850]: DEBUG nova.policy [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a8ca83acba64f15bd10d275fd053475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04a48df2b1c42f4a0a8826c66357f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 00:50:35 user nova-compute[74850]: INFO nova.virt.block_device [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Booting with volume e558166b-85d2-4742-ac34-c2ee02202390 at /dev/vda
Nov 14 00:50:35 user nova-compute[74850]: DEBUG os_brick.utils [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:50:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:50:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a678b104-db77-40ac-98e9-8d9e855432ee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:50:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:50:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db43e35-d0e3-40a3-8cad-765e5c47ac1f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:50:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:50:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c971cc1f-6459-4a16-8612-88d52eb774e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:50:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f569676d-c4fb-42f1-93c6-c27ea5173167]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:50:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:50:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 00:50:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:50:35 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 00:50:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a31bd58-c448-45d4-a6f3-9787d4dc2c8a]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:50:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 00:50:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 00:50:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 00:50:35 user nova-compute[74850]: DEBUG os_brick.utils [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:50:35 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Updating existing volume attachment record: f076fb6f-de37-4ffc-9f5c-5a06ac960079 {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 00:50:36 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Successfully created port: b3afdbc0-4840-47bb-b5f9-71944340f04b {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:50:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:37 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Successfully updated port: b3afdbc0-4840-47bb-b5f9-71944340f04b {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:50:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Acquiring lock "refresh_cache-1f3a0b8f-1591-49c8-afb1-88437d65fb75" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:50:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Acquired lock "refresh_cache-1f3a0b8f-1591-49c8-afb1-88437d65fb75" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:50:37 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:50:37 user nova-compute[74850]: DEBUG nova.compute.manager [req-20d68745-1d49-4ee7-bd00-8b0a9a8ff7a6 req-10534ed9-f817-42b8-ba81-753b568bb3f9 service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Received event network-changed-b3afdbc0-4840-47bb-b5f9-71944340f04b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:50:37 user nova-compute[74850]: DEBUG nova.compute.manager [req-20d68745-1d49-4ee7-bd00-8b0a9a8ff7a6 req-10534ed9-f817-42b8-ba81-753b568bb3f9 service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Refreshing instance network info cache due to event network-changed-b3afdbc0-4840-47bb-b5f9-71944340f04b. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:50:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-20d68745-1d49-4ee7-bd00-8b0a9a8ff7a6 req-10534ed9-f817-42b8-ba81-753b568bb3f9 service nova] Acquiring lock "refresh_cache-1f3a0b8f-1591-49c8-afb1-88437d65fb75" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:50:37 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:50:37 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Updating instance_info_cache with network_info: [{"id": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "address": "fa:16:3e:a9:ef:9b", "network": {"id": "d7fe6bb8-ec3e-4bc8-9afe-161897a805b0", "bridge": "br-int", "label": "tempest-TestShelveInstance-236791102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d04a48df2b1c42f4a0a8826c66357f28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3afdbc0-48", "ovs_interfaceid": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:50:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Releasing lock "refresh_cache-1f3a0b8f-1591-49c8-afb1-88437d65fb75" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:50:37 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Instance network_info: |[{"id": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "address": "fa:16:3e:a9:ef:9b", "network": {"id": "d7fe6bb8-ec3e-4bc8-9afe-161897a805b0", "bridge": "br-int", "label": "tempest-TestShelveInstance-236791102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d04a48df2b1c42f4a0a8826c66357f28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3afdbc0-48", "ovs_interfaceid": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 00:50:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-20d68745-1d49-4ee7-bd00-8b0a9a8ff7a6 req-10534ed9-f817-42b8-ba81-753b568bb3f9 service nova] Acquired lock "refresh_cache-1f3a0b8f-1591-49c8-afb1-88437d65fb75" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:50:37 user nova-compute[74850]: DEBUG nova.network.neutron [req-20d68745-1d49-4ee7-bd00-8b0a9a8ff7a6 req-10534ed9-f817-42b8-ba81-753b568bb3f9 service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Refreshing network info cache for port b3afdbc0-4840-47bb-b5f9-71944340f04b {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:50:38 user nova-compute[74850]: DEBUG nova.network.neutron [req-20d68745-1d49-4ee7-bd00-8b0a9a8ff7a6 req-10534ed9-f817-42b8-ba81-753b568bb3f9 service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Updated VIF entry in instance network info cache for port b3afdbc0-4840-47bb-b5f9-71944340f04b. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:50:38 user nova-compute[74850]: DEBUG nova.network.neutron [req-20d68745-1d49-4ee7-bd00-8b0a9a8ff7a6 req-10534ed9-f817-42b8-ba81-753b568bb3f9 service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Updating instance_info_cache with network_info: [{"id": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "address": "fa:16:3e:a9:ef:9b", "network": {"id": "d7fe6bb8-ec3e-4bc8-9afe-161897a805b0", "bridge": "br-int", "label": "tempest-TestShelveInstance-236791102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d04a48df2b1c42f4a0a8826c66357f28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3afdbc0-48", "ovs_interfaceid": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:50:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-20d68745-1d49-4ee7-bd00-8b0a9a8ff7a6 req-10534ed9-f817-42b8-ba81-753b568bb3f9 service nova] Releasing lock "refresh_cache-1f3a0b8f-1591-49c8-afb1-88437d65fb75" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:50:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 00:50:40 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Creating image(s)
Nov 14 00:50:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Did not create local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Ensure instance console log exists: /opt/stack/data/nova/instances/1f3a0b8f-1591-49c8-afb1-88437d65fb75/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Start _get_guest_xml network_info=[{"id": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "address": "fa:16:3e:a9:ef:9b", "network": {"id": "d7fe6bb8-ec3e-4bc8-9afe-161897a805b0", "bridge": "br-int", "label": "tempest-TestShelveInstance-236791102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d04a48df2b1c42f4a0a8826c66357f28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3afdbc0-48", "ovs_interfaceid": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f076fb6f-de37-4ffc-9f5c-5a06ac960079', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pEVTGKrm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1f3a0b8f-1591-49c8-afb1-88437d65fb75', 'attached_at': '', 'detached_at': '', 'volume_id': 'e558166b-85d2-4742-ac34-c2ee02202390', 'serial': 'e558166b-85d2-4742-ac34-c2ee02202390'}, 'volume_type': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:50:40 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:50:40 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:50:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pEVTGKrm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:50:40 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:50:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:50:40 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:50:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:50:40 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 00:50:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[52951d70-c015-473a-a99f-af80c80b2b5a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 00:50:40 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1f2c8f-b409-413a-88f0-0db7aa7799a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390] added
Nov 14 00:50:40 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9fd452-1123-4424-b678-a08cddd429ee]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9e33fd-ec52-46b9-b293-54acfb6e0515]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pEVTGKrm {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pEVTGKrm" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2653df9-5fb6-4d6d-92f1-a583eb4ac723]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pEVTGKrm'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0374ec-2cd0-469c-b1aa-4f737ce8f35e]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94d483c-67cd-4576-8e7b-34c14d0acf8c]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:603979ca-232a-4b24-b454-e3c257f6579a (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:603979ca-232a-4b24-b454-e3c257f6579a (non-flash)
Nov 14 00:50:40 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:603979ca-232a-4b24-b454-e3c257f6579a (non-flash)
Nov 14 00:50:40 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3197525-1990-4cc6-b9df-0177696874e8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390, portal: 172.16.0.220,3260]
Nov 14 00:50:40 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390, portal: 172.16.0.220,3260] successful.
Nov 14 00:50:40 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2068423d-8301-4a7d-ae63-43e0811facc1]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0901df4-1257-4afd-acfb-a4a1929be35a]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:603979ca-232a-4b24-b454-e3c257f6579a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:603979ca-232a-4b24-b454-e3c257f6579a (non-flash)
Nov 14 00:50:40 user nova-compute[74850]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:50:40 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:603979ca-232a-4b24-b454-e3c257f6579a (non-flash)
Nov 14 00:50:40 user nova-compute[74850]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:50:40 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[426b636c-88c9-4020-af98-487b9ce8e6e4]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:50:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pEVTGKrm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 00:50:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e00ac811-e5d8-489d-a5c9-9443214622a7 tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Acquiring lock "415808a8-c17b-49bf-8a4e-ac19553cdb19" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:50:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e00ac811-e5d8-489d-a5c9-9443214622a7 tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Lock "415808a8-c17b-49bf-8a4e-ac19553cdb19" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:50:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e00ac811-e5d8-489d-a5c9-9443214622a7 tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Acquiring lock "415808a8-c17b-49bf-8a4e-ac19553cdb19-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:50:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e00ac811-e5d8-489d-a5c9-9443214622a7 tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Lock "415808a8-c17b-49bf-8a4e-ac19553cdb19-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:50:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e00ac811-e5d8-489d-a5c9-9443214622a7 tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Lock "415808a8-c17b-49bf-8a4e-ac19553cdb19-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:50:41 user nova-compute[74850]: INFO nova.compute.manager [None req-e00ac811-e5d8-489d-a5c9-9443214622a7 tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Terminating instance
Nov 14 00:50:41 user nova-compute[74850]: DEBUG nova.compute.manager [None req-e00ac811-e5d8-489d-a5c9-9443214622a7 tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 00:50:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:50:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26561353661326566', 'path': '/dev/sdc'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:50:41 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561353661326566', 'path': '/dev/sdc'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 00:50:41 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:50:41 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74850) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 00:50:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:41 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:50:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-999057832',display_name='tempest-TestShelveInstance-server-999057832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-999057832',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPe2MCunpaIWCOf138MPN4AN0ndS8NEmSmQgzRt5Y5fsb9WbIXubhh1yAaf/vbnkIZksktAFNFaWcv6Px9mLlE23DucapJ22iB3KR+pjspwx/iLSs3EpKTn1M7OrESAuKg==',key_name='tempest-TestShelveInstance-2033278270',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d04a48df2b1c42f4a0a8826c66357f28',ramdisk_id='',reservation_id='r-cuownc8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1921981995',owner_user_name='tempest-TestShelveInstance-1921981995-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:50:36Z,user_data=None,user_id='5a8ca83acba64f15bd10d275fd053475',uuid=1f3a0b8f-1591-49c8-afb1-88437d65fb75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "address": "fa:16:3e:a9:ef:9b", "network": {"id": "d7fe6bb8-ec3e-4bc8-9afe-161897a805b0", "bridge": "br-int", "label": "tempest-TestShelveInstance-236791102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d04a48df2b1c42f4a0a8826c66357f28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3afdbc0-48", "ovs_interfaceid": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:50:41 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Converting VIF {"id": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "address": "fa:16:3e:a9:ef:9b", "network": {"id": "d7fe6bb8-ec3e-4bc8-9afe-161897a805b0", "bridge": "br-int", "label": "tempest-TestShelveInstance-236791102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d04a48df2b1c42f4a0a8826c66357f28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3afdbc0-48", "ovs_interfaceid": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:50:41 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:ef:9b,bridge_name='br-int',has_traffic_filtering=True,id=b3afdbc0-4840-47bb-b5f9-71944340f04b,network=Network(d7fe6bb8-ec3e-4bc8-9afe-161897a805b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3afdbc0-48') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:50:41 user nova-compute[74850]: DEBUG nova.objects.instance [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lazy-loading 'pci_devices' on Instance uuid 1f3a0b8f-1591-49c8-afb1-88437d65fb75 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:50:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:41 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:50:41 user nova-compute[74850]:   <uuid>1f3a0b8f-1591-49c8-afb1-88437d65fb75</uuid>
Nov 14 00:50:41 user nova-compute[74850]:   <name>instance-00000015</name>
Nov 14 00:50:41 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:50:41 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:50:41 user nova-compute[74850]:   <metadata>
Nov 14 00:50:41 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:50:41 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:50:41 user nova-compute[74850]:       <nova:name>tempest-TestShelveInstance-server-999057832</nova:name>
Nov 14 00:50:41 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:50:40</nova:creationTime>
Nov 14 00:50:41 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:50:41 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:50:41 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:50:41 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:50:41 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:50:41 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:50:41 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:50:41 user nova-compute[74850]:       <nova:owner>
Nov 14 00:50:41 user nova-compute[74850]:         <nova:user uuid="5a8ca83acba64f15bd10d275fd053475">tempest-TestShelveInstance-1921981995-project-member</nova:user>
Nov 14 00:50:41 user nova-compute[74850]:         <nova:project uuid="d04a48df2b1c42f4a0a8826c66357f28">tempest-TestShelveInstance-1921981995</nova:project>
Nov 14 00:50:41 user nova-compute[74850]:       </nova:owner>
Nov 14 00:50:41 user nova-compute[74850]:       <nova:ports>
Nov 14 00:50:41 user nova-compute[74850]:         <nova:port uuid="b3afdbc0-4840-47bb-b5f9-71944340f04b">
Nov 14 00:50:41 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 00:50:41 user nova-compute[74850]:         </nova:port>
Nov 14 00:50:41 user nova-compute[74850]:       </nova:ports>
Nov 14 00:50:41 user nova-compute[74850]:     </nova:instance>
Nov 14 00:50:41 user nova-compute[74850]:   </metadata>
Nov 14 00:50:41 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:50:41 user nova-compute[74850]:     <system>
Nov 14 00:50:41 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:50:41 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:50:41 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:50:41 user nova-compute[74850]:       <entry name="serial">1f3a0b8f-1591-49c8-afb1-88437d65fb75</entry>
Nov 14 00:50:41 user nova-compute[74850]:       <entry name="uuid">1f3a0b8f-1591-49c8-afb1-88437d65fb75</entry>
Nov 14 00:50:41 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:50:41 user nova-compute[74850]:     </system>
Nov 14 00:50:41 user nova-compute[74850]:   </sysinfo>
Nov 14 00:50:41 user nova-compute[74850]:   <os>
Nov 14 00:50:41 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:50:41 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 00:50:41 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:50:41 user nova-compute[74850]:   </os>
Nov 14 00:50:41 user nova-compute[74850]:   <features>
Nov 14 00:50:41 user nova-compute[74850]:     <acpi/>
Nov 14 00:50:41 user nova-compute[74850]:     <apic/>
Nov 14 00:50:41 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:50:41 user nova-compute[74850]:   </features>
Nov 14 00:50:41 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:50:41 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:50:41 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:50:41 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:50:41 user nova-compute[74850]:   </clock>
Nov 14 00:50:41 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:50:41 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:50:41 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:50:41 user nova-compute[74850]:   </cpu>
Nov 14 00:50:41 user nova-compute[74850]:   <devices>
Nov 14 00:50:41 user nova-compute[74850]:     <disk type="block" device="disk">
Nov 14 00:50:41 user nova-compute[74850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:50:41 user nova-compute[74850]:       <source dev="/dev/sdc"/>
Nov 14 00:50:41 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:50:41 user nova-compute[74850]:       <serial>e558166b-85d2-4742-ac34-c2ee02202390</serial>
Nov 14 00:50:41 user nova-compute[74850]:     </disk>
Nov 14 00:50:41 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:50:41 user nova-compute[74850]:       <mac address="fa:16:3e:a9:ef:9b"/>
Nov 14 00:50:41 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:50:41 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:50:41 user nova-compute[74850]:       <target dev="tapb3afdbc0-48"/>
Nov 14 00:50:41 user nova-compute[74850]:     </interface>
Nov 14 00:50:41 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:50:41 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/1f3a0b8f-1591-49c8-afb1-88437d65fb75/console.log" append="off"/>
Nov 14 00:50:41 user nova-compute[74850]:     </serial>
Nov 14 00:50:41 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:50:41 user nova-compute[74850]:     <video>
Nov 14 00:50:41 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:50:41 user nova-compute[74850]:     </video>
Nov 14 00:50:41 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:50:41 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:50:41 user nova-compute[74850]:     </rng>
Nov 14 00:50:41 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:50:41 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:50:41 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:50:41 user nova-compute[74850]:     </memballoon>
Nov 14 00:50:41 user nova-compute[74850]:   </devices>
Nov 14 00:50:41 user nova-compute[74850]: </domain>
Nov 14 00:50:41 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:50:41 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:50:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-999057832',display_name='tempest-TestShelveInstance-server-999057832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-999057832',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPe2MCunpaIWCOf138MPN4AN0ndS8NEmSmQgzRt5Y5fsb9WbIXubhh1yAaf/vbnkIZksktAFNFaWcv6Px9mLlE23DucapJ22iB3KR+pjspwx/iLSs3EpKTn1M7OrESAuKg==',key_name='tempest-TestShelveInstance-2033278270',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d04a48df2b1c42f4a0a8826c66357f28',ramdisk_id='',reservation_id='r-cuownc8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1921981995',owner_user_name='tempest-TestShelveInstance-1921981995-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:50:36Z,user_data=None,user_id='5a8ca83acba64f15bd10d275fd053475',uuid=1f3a0b8f-1591-49c8-afb1-88437d65fb75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "address": "fa:16:3e:a9:ef:9b", "network": {"id": "d7fe6bb8-ec3e-4bc8-9afe-161897a805b0", "bridge": "br-int", "label": "tempest-TestShelveInstance-236791102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d04a48df2b1c42f4a0a8826c66357f28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3afdbc0-48", "ovs_interfaceid": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Converting VIF {"id": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "address": "fa:16:3e:a9:ef:9b", "network": {"id": "d7fe6bb8-ec3e-4bc8-9afe-161897a805b0", "bridge": "br-int", "label": "tempest-TestShelveInstance-236791102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d04a48df2b1c42f4a0a8826c66357f28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3afdbc0-48", "ovs_interfaceid": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:ef:9b,bridge_name='br-int',has_traffic_filtering=True,id=b3afdbc0-4840-47bb-b5f9-71944340f04b,network=Network(d7fe6bb8-ec3e-4bc8-9afe-161897a805b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3afdbc0-48') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG os_vif [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:ef:9b,bridge_name='br-int',has_traffic_filtering=True,id=b3afdbc0-4840-47bb-b5f9-71944340f04b,network=Network(d7fe6bb8-ec3e-4bc8-9afe-161897a805b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3afdbc0-48') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f20647e7-ccc8-58a9-9e5d-e1d42c3fda97', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3afdbc0-48, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb3afdbc0-48, col_values=(('qos', UUID('274ce7ac-c629-46fc-b758-c7ccb8a855d6')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb3afdbc0-48, col_values=(('external_ids', {'iface-id': 'b3afdbc0-4840-47bb-b5f9-71944340f04b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:ef:9b', 'vm-uuid': '1f3a0b8f-1591-49c8-afb1-88437d65fb75'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:42 user nova-compute[74850]: INFO os_vif [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:ef:9b,bridge_name='br-int',has_traffic_filtering=True,id=b3afdbc0-4840-47bb-b5f9-71944340f04b,network=Network(d7fe6bb8-ec3e-4bc8-9afe-161897a805b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3afdbc0-48')
Nov 14 00:50:42 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] No VIF found with MAC fa:16:3e:a9:ef:9b, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG nova.compute.manager [req-57595e6a-8c82-4899-8b99-ff6767cef9fb req-c77d5834-f4c4-4b90-89f5-0e52a3bd79d8 service nova] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Received event network-vif-unplugged-7cc43262-84fa-474b-ae96-39758aba662b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-57595e6a-8c82-4899-8b99-ff6767cef9fb req-c77d5834-f4c4-4b90-89f5-0e52a3bd79d8 service nova] Acquiring lock "415808a8-c17b-49bf-8a4e-ac19553cdb19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-57595e6a-8c82-4899-8b99-ff6767cef9fb req-c77d5834-f4c4-4b90-89f5-0e52a3bd79d8 service nova] Lock "415808a8-c17b-49bf-8a4e-ac19553cdb19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-57595e6a-8c82-4899-8b99-ff6767cef9fb req-c77d5834-f4c4-4b90-89f5-0e52a3bd79d8 service nova] Lock "415808a8-c17b-49bf-8a4e-ac19553cdb19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG nova.compute.manager [req-57595e6a-8c82-4899-8b99-ff6767cef9fb req-c77d5834-f4c4-4b90-89f5-0e52a3bd79d8 service nova] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] No waiting events found dispatching network-vif-unplugged-7cc43262-84fa-474b-ae96-39758aba662b {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG nova.compute.manager [req-57595e6a-8c82-4899-8b99-ff6767cef9fb req-c77d5834-f4c4-4b90-89f5-0e52a3bd79d8 service nova] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Received event network-vif-unplugged-7cc43262-84fa-474b-ae96-39758aba662b for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:42 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Instance destroyed successfully.
Nov 14 00:50:42 user nova-compute[74850]: DEBUG nova.objects.instance [None req-e00ac811-e5d8-489d-a5c9-9443214622a7 tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Lazy-loading 'resources' on Instance uuid 415808a8-c17b-49bf-8a4e-ac19553cdb19 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-e00ac811-e5d8-489d-a5c9-9443214622a7 tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1471401823',display_name='tempest-VolumesNegativeTest-instance-1471401823',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1471401823',id=15,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:49:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f3cb14c69af840f7aa2f61d57c0fa31d',ramdisk_id='',reservation_id='r-cub7jtxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1112214089',owner_user_name='tempest-VolumesNegativeTest-1112214089-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:49:01Z,user_data=None,user_id='75dd785464c744d2bd90259ae57ca4eb',uuid=415808a8-c17b-49bf-8a4e-ac19553cdb19,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7cc43262-84fa-474b-ae96-39758aba662b", "address": "fa:16:3e:e0:b6:3c", "network": {"id": "79085ce8-f8ef-4329-b0d4-0eddda52de22", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "58c870909f43417296374f1a23c8af0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc43262-84", "ovs_interfaceid": "7cc43262-84fa-474b-ae96-39758aba662b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-e00ac811-e5d8-489d-a5c9-9443214622a7 tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Converting VIF {"id": "7cc43262-84fa-474b-ae96-39758aba662b", "address": "fa:16:3e:e0:b6:3c", "network": {"id": "79085ce8-f8ef-4329-b0d4-0eddda52de22", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "58c870909f43417296374f1a23c8af0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc43262-84", "ovs_interfaceid": "7cc43262-84fa-474b-ae96-39758aba662b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-e00ac811-e5d8-489d-a5c9-9443214622a7 tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:b6:3c,bridge_name='br-int',has_traffic_filtering=True,id=7cc43262-84fa-474b-ae96-39758aba662b,network=Network(79085ce8-f8ef-4329-b0d4-0eddda52de22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc43262-84') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG os_vif [None req-e00ac811-e5d8-489d-a5c9-9443214622a7 tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:b6:3c,bridge_name='br-int',has_traffic_filtering=True,id=7cc43262-84fa-474b-ae96-39758aba662b,network=Network(79085ce8-f8ef-4329-b0d4-0eddda52de22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc43262-84') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7cc43262-84, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=853f688e-edf2-4c6b-914c-29ecfb02342a) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:42 user nova-compute[74850]: INFO os_vif [None req-e00ac811-e5d8-489d-a5c9-9443214622a7 tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:b6:3c,bridge_name='br-int',has_traffic_filtering=True,id=7cc43262-84fa-474b-ae96-39758aba662b,network=Network(79085ce8-f8ef-4329-b0d4-0eddda52de22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc43262-84')
Nov 14 00:50:42 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-e00ac811-e5d8-489d-a5c9-9443214622a7 tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Deleting instance files /opt/stack/data/nova/instances/415808a8-c17b-49bf-8a4e-ac19553cdb19_del
Nov 14 00:50:42 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-e00ac811-e5d8-489d-a5c9-9443214622a7 tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Deletion of /opt/stack/data/nova/instances/415808a8-c17b-49bf-8a4e-ac19553cdb19_del complete
Nov 14 00:50:42 user nova-compute[74850]: INFO nova.compute.manager [None req-e00ac811-e5d8-489d-a5c9-9443214622a7 tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 14 00:50:42 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-e00ac811-e5d8-489d-a5c9-9443214622a7 tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 00:50:42 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 00:50:43 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:43 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:43 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:43 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:43 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:43 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:50:44 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Took 0.75 seconds to deallocate network for instance.
Nov 14 00:50:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e00ac811-e5d8-489d-a5c9-9443214622a7 tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e00ac811-e5d8-489d-a5c9-9443214622a7 tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG nova.compute.manager [req-9bfbac06-f4aa-4009-9e8d-37ab21ca5753 req-635e724a-66d6-4b9c-aa22-c57e7f9a5c9f service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Received event network-changed-745756ea-b360-423f-8258-5339a80658b5 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG nova.compute.manager [req-9bfbac06-f4aa-4009-9e8d-37ab21ca5753 req-635e724a-66d6-4b9c-aa22-c57e7f9a5c9f service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Refreshing instance network info cache due to event network-changed-745756ea-b360-423f-8258-5339a80658b5. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9bfbac06-f4aa-4009-9e8d-37ab21ca5753 req-635e724a-66d6-4b9c-aa22-c57e7f9a5c9f service nova] Acquiring lock "refresh_cache-4f1102c5-f5ef-48d5-b271-6e25bee5cc70" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9bfbac06-f4aa-4009-9e8d-37ab21ca5753 req-635e724a-66d6-4b9c-aa22-c57e7f9a5c9f service nova] Acquired lock "refresh_cache-4f1102c5-f5ef-48d5-b271-6e25bee5cc70" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG nova.network.neutron [req-9bfbac06-f4aa-4009-9e8d-37ab21ca5753 req-635e724a-66d6-4b9c-aa22-c57e7f9a5c9f service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Refreshing network info cache for port 745756ea-b360-423f-8258-5339a80658b5 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG nova.compute.manager [req-31fcb497-aaef-42cb-9b3e-a715e14619e0 req-84444708-6264-4f5c-8a9b-8709d357bfae service nova] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Received event network-vif-plugged-7cc43262-84fa-474b-ae96-39758aba662b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-31fcb497-aaef-42cb-9b3e-a715e14619e0 req-84444708-6264-4f5c-8a9b-8709d357bfae service nova] Acquiring lock "415808a8-c17b-49bf-8a4e-ac19553cdb19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-31fcb497-aaef-42cb-9b3e-a715e14619e0 req-84444708-6264-4f5c-8a9b-8709d357bfae service nova] Lock "415808a8-c17b-49bf-8a4e-ac19553cdb19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-31fcb497-aaef-42cb-9b3e-a715e14619e0 req-84444708-6264-4f5c-8a9b-8709d357bfae service nova] Lock "415808a8-c17b-49bf-8a4e-ac19553cdb19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG nova.compute.manager [req-31fcb497-aaef-42cb-9b3e-a715e14619e0 req-84444708-6264-4f5c-8a9b-8709d357bfae service nova] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] No waiting events found dispatching network-vif-plugged-7cc43262-84fa-474b-ae96-39758aba662b {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:50:44 user nova-compute[74850]: WARNING nova.compute.manager [req-31fcb497-aaef-42cb-9b3e-a715e14619e0 req-84444708-6264-4f5c-8a9b-8709d357bfae service nova] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Received unexpected event network-vif-plugged-7cc43262-84fa-474b-ae96-39758aba662b for instance with vm_state deleted and task_state None.
Nov 14 00:50:44 user nova-compute[74850]: DEBUG nova.compute.manager [req-31fcb497-aaef-42cb-9b3e-a715e14619e0 req-84444708-6264-4f5c-8a9b-8709d357bfae service nova] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Received event network-vif-plugged-7cc43262-84fa-474b-ae96-39758aba662b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-31fcb497-aaef-42cb-9b3e-a715e14619e0 req-84444708-6264-4f5c-8a9b-8709d357bfae service nova] Acquiring lock "415808a8-c17b-49bf-8a4e-ac19553cdb19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-31fcb497-aaef-42cb-9b3e-a715e14619e0 req-84444708-6264-4f5c-8a9b-8709d357bfae service nova] Lock "415808a8-c17b-49bf-8a4e-ac19553cdb19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-31fcb497-aaef-42cb-9b3e-a715e14619e0 req-84444708-6264-4f5c-8a9b-8709d357bfae service nova] Lock "415808a8-c17b-49bf-8a4e-ac19553cdb19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG nova.compute.manager [req-31fcb497-aaef-42cb-9b3e-a715e14619e0 req-84444708-6264-4f5c-8a9b-8709d357bfae service nova] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] No waiting events found dispatching network-vif-plugged-7cc43262-84fa-474b-ae96-39758aba662b {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:50:44 user nova-compute[74850]: WARNING nova.compute.manager [req-31fcb497-aaef-42cb-9b3e-a715e14619e0 req-84444708-6264-4f5c-8a9b-8709d357bfae service nova] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Received unexpected event network-vif-plugged-7cc43262-84fa-474b-ae96-39758aba662b for instance with vm_state deleted and task_state None.
Nov 14 00:50:44 user nova-compute[74850]: DEBUG nova.compute.manager [req-31fcb497-aaef-42cb-9b3e-a715e14619e0 req-84444708-6264-4f5c-8a9b-8709d357bfae service nova] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Received event network-vif-plugged-7cc43262-84fa-474b-ae96-39758aba662b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-31fcb497-aaef-42cb-9b3e-a715e14619e0 req-84444708-6264-4f5c-8a9b-8709d357bfae service nova] Acquiring lock "415808a8-c17b-49bf-8a4e-ac19553cdb19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-31fcb497-aaef-42cb-9b3e-a715e14619e0 req-84444708-6264-4f5c-8a9b-8709d357bfae service nova] Lock "415808a8-c17b-49bf-8a4e-ac19553cdb19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-31fcb497-aaef-42cb-9b3e-a715e14619e0 req-84444708-6264-4f5c-8a9b-8709d357bfae service nova] Lock "415808a8-c17b-49bf-8a4e-ac19553cdb19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG nova.compute.manager [req-31fcb497-aaef-42cb-9b3e-a715e14619e0 req-84444708-6264-4f5c-8a9b-8709d357bfae service nova] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] No waiting events found dispatching network-vif-plugged-7cc43262-84fa-474b-ae96-39758aba662b {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:50:44 user nova-compute[74850]: WARNING nova.compute.manager [req-31fcb497-aaef-42cb-9b3e-a715e14619e0 req-84444708-6264-4f5c-8a9b-8709d357bfae service nova] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Received unexpected event network-vif-plugged-7cc43262-84fa-474b-ae96-39758aba662b for instance with vm_state deleted and task_state None.
Nov 14 00:50:44 user nova-compute[74850]: DEBUG nova.compute.manager [req-31fcb497-aaef-42cb-9b3e-a715e14619e0 req-84444708-6264-4f5c-8a9b-8709d357bfae service nova] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Received event network-vif-unplugged-7cc43262-84fa-474b-ae96-39758aba662b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-31fcb497-aaef-42cb-9b3e-a715e14619e0 req-84444708-6264-4f5c-8a9b-8709d357bfae service nova] Acquiring lock "415808a8-c17b-49bf-8a4e-ac19553cdb19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-31fcb497-aaef-42cb-9b3e-a715e14619e0 req-84444708-6264-4f5c-8a9b-8709d357bfae service nova] Lock "415808a8-c17b-49bf-8a4e-ac19553cdb19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-31fcb497-aaef-42cb-9b3e-a715e14619e0 req-84444708-6264-4f5c-8a9b-8709d357bfae service nova] Lock "415808a8-c17b-49bf-8a4e-ac19553cdb19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG nova.compute.manager [req-31fcb497-aaef-42cb-9b3e-a715e14619e0 req-84444708-6264-4f5c-8a9b-8709d357bfae service nova] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] No waiting events found dispatching network-vif-unplugged-7cc43262-84fa-474b-ae96-39758aba662b {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:50:44 user nova-compute[74850]: WARNING nova.compute.manager [req-31fcb497-aaef-42cb-9b3e-a715e14619e0 req-84444708-6264-4f5c-8a9b-8709d357bfae service nova] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Received unexpected event network-vif-unplugged-7cc43262-84fa-474b-ae96-39758aba662b for instance with vm_state deleted and task_state None.
Nov 14 00:50:44 user nova-compute[74850]: DEBUG nova.compute.manager [req-31fcb497-aaef-42cb-9b3e-a715e14619e0 req-84444708-6264-4f5c-8a9b-8709d357bfae service nova] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Received event network-vif-plugged-7cc43262-84fa-474b-ae96-39758aba662b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-31fcb497-aaef-42cb-9b3e-a715e14619e0 req-84444708-6264-4f5c-8a9b-8709d357bfae service nova] Acquiring lock "415808a8-c17b-49bf-8a4e-ac19553cdb19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-31fcb497-aaef-42cb-9b3e-a715e14619e0 req-84444708-6264-4f5c-8a9b-8709d357bfae service nova] Lock "415808a8-c17b-49bf-8a4e-ac19553cdb19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-31fcb497-aaef-42cb-9b3e-a715e14619e0 req-84444708-6264-4f5c-8a9b-8709d357bfae service nova] Lock "415808a8-c17b-49bf-8a4e-ac19553cdb19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG nova.compute.manager [req-31fcb497-aaef-42cb-9b3e-a715e14619e0 req-84444708-6264-4f5c-8a9b-8709d357bfae service nova] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] No waiting events found dispatching network-vif-plugged-7cc43262-84fa-474b-ae96-39758aba662b {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:50:44 user nova-compute[74850]: WARNING nova.compute.manager [req-31fcb497-aaef-42cb-9b3e-a715e14619e0 req-84444708-6264-4f5c-8a9b-8709d357bfae service nova] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Received unexpected event network-vif-plugged-7cc43262-84fa-474b-ae96-39758aba662b for instance with vm_state deleted and task_state None.
Nov 14 00:50:44 user nova-compute[74850]: DEBUG nova.compute.manager [req-31fcb497-aaef-42cb-9b3e-a715e14619e0 req-84444708-6264-4f5c-8a9b-8709d357bfae service nova] [instance: 415808a8-c17b-49bf-8a4e-ac19553cdb19] Received event network-vif-deleted-7cc43262-84fa-474b-ae96-39758aba662b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-e00ac811-e5d8-489d-a5c9-9443214622a7 tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-e00ac811-e5d8-489d-a5c9-9443214622a7 tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG nova.compute.manager [req-c3694eef-f66f-4959-91b1-d520a869033d req-cbe54e78-86b2-4099-a045-72dc2a35af8e service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Received event network-vif-plugged-b3afdbc0-4840-47bb-b5f9-71944340f04b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c3694eef-f66f-4959-91b1-d520a869033d req-cbe54e78-86b2-4099-a045-72dc2a35af8e service nova] Acquiring lock "1f3a0b8f-1591-49c8-afb1-88437d65fb75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c3694eef-f66f-4959-91b1-d520a869033d req-cbe54e78-86b2-4099-a045-72dc2a35af8e service nova] Lock "1f3a0b8f-1591-49c8-afb1-88437d65fb75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c3694eef-f66f-4959-91b1-d520a869033d req-cbe54e78-86b2-4099-a045-72dc2a35af8e service nova] Lock "1f3a0b8f-1591-49c8-afb1-88437d65fb75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG nova.compute.manager [req-c3694eef-f66f-4959-91b1-d520a869033d req-cbe54e78-86b2-4099-a045-72dc2a35af8e service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] No waiting events found dispatching network-vif-plugged-b3afdbc0-4840-47bb-b5f9-71944340f04b {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:50:44 user nova-compute[74850]: WARNING nova.compute.manager [req-c3694eef-f66f-4959-91b1-d520a869033d req-cbe54e78-86b2-4099-a045-72dc2a35af8e service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Received unexpected event network-vif-plugged-b3afdbc0-4840-47bb-b5f9-71944340f04b for instance with vm_state building and task_state spawning.
Nov 14 00:50:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e00ac811-e5d8-489d-a5c9-9443214622a7 tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.554s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:50:44 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-e00ac811-e5d8-489d-a5c9-9443214622a7 tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Deleted allocations for instance 415808a8-c17b-49bf-8a4e-ac19553cdb19
Nov 14 00:50:44 user nova-compute[74850]: DEBUG nova.network.neutron [req-9bfbac06-f4aa-4009-9e8d-37ab21ca5753 req-635e724a-66d6-4b9c-aa22-c57e7f9a5c9f service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Updated VIF entry in instance network info cache for port 745756ea-b360-423f-8258-5339a80658b5. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG nova.network.neutron [req-9bfbac06-f4aa-4009-9e8d-37ab21ca5753 req-635e724a-66d6-4b9c-aa22-c57e7f9a5c9f service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Updating instance_info_cache with network_info: [{"id": "745756ea-b360-423f-8258-5339a80658b5", "address": "fa:16:3e:1e:5a:e7", "network": {"id": "0e3f4d71-4998-448f-b706-8ae0f6d0d960", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-245892937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af65f5e7dcc3404292714adcecdd9939", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745756ea-b3", "ovs_interfaceid": "745756ea-b360-423f-8258-5339a80658b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e00ac811-e5d8-489d-a5c9-9443214622a7 tempest-VolumesNegativeTest-1112214089 tempest-VolumesNegativeTest-1112214089-project-member] Lock "415808a8-c17b-49bf-8a4e-ac19553cdb19" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.920s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9bfbac06-f4aa-4009-9e8d-37ab21ca5753 req-635e724a-66d6-4b9c-aa22-c57e7f9a5c9f service nova] Releasing lock "refresh_cache-4f1102c5-f5ef-48d5-b271-6e25bee5cc70" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:45 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:50:45 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:50:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:50:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:50:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:50:45 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 00:50:46 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:50:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 00:50:46 user nova-compute[74850]: DEBUG nova.compute.manager [req-5472104e-86d8-4c38-bbb5-dcaf91bf579e req-531984ac-eb32-48a7-904c-c80698c8fca9 service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Received event network-vif-plugged-b3afdbc0-4840-47bb-b5f9-71944340f04b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:50:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5472104e-86d8-4c38-bbb5-dcaf91bf579e req-531984ac-eb32-48a7-904c-c80698c8fca9 service nova] Acquiring lock "1f3a0b8f-1591-49c8-afb1-88437d65fb75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:50:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5472104e-86d8-4c38-bbb5-dcaf91bf579e req-531984ac-eb32-48a7-904c-c80698c8fca9 service nova] Lock "1f3a0b8f-1591-49c8-afb1-88437d65fb75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:50:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5472104e-86d8-4c38-bbb5-dcaf91bf579e req-531984ac-eb32-48a7-904c-c80698c8fca9 service nova] Lock "1f3a0b8f-1591-49c8-afb1-88437d65fb75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:50:46 user nova-compute[74850]: DEBUG nova.compute.manager [req-5472104e-86d8-4c38-bbb5-dcaf91bf579e req-531984ac-eb32-48a7-904c-c80698c8fca9 service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] No waiting events found dispatching network-vif-plugged-b3afdbc0-4840-47bb-b5f9-71944340f04b {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:50:46 user nova-compute[74850]: WARNING nova.compute.manager [req-5472104e-86d8-4c38-bbb5-dcaf91bf579e req-531984ac-eb32-48a7-904c-c80698c8fca9 service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Received unexpected event network-vif-plugged-b3afdbc0-4840-47bb-b5f9-71944340f04b for instance with vm_state building and task_state spawning.
Nov 14 00:50:46 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Instance spawned successfully.
Nov 14 00:50:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 00:50:47 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:50:47 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:50:47 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:50:47 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:50:47 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:50:47 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:50:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:47 user nova-compute[74850]: INFO nova.compute.manager [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Took 7.08 seconds to spawn the instance on the hypervisor.
Nov 14 00:50:47 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:50:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json" returned: 0 in 0.728s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:50:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:48 user nova-compute[74850]: INFO nova.compute.manager [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Took 13.39 seconds to build instance.
Nov 14 00:50:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4b045ca0-49ff-4ad1-88d3-2522b269e0a6 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lock "1f3a0b8f-1591-49c8-afb1-88437d65fb75" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.744s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:50:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json" returned: 0 in 1.186s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:50:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28212eec-99be-4171-97ed-7748bbb75c88/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28212eec-99be-4171-97ed-7748bbb75c88/disk --force-share --output=json" returned: 0 in 0.527s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:50:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28212eec-99be-4171-97ed-7748bbb75c88/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:50 user nova-compute[74850]: DEBUG nova.compute.manager [req-6b9e3e30-44e7-4fea-aa46-ea4c795b50ba req-7dc2063b-d4f8-40df-acc1-3c140e0715a6 service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Received event network-changed-667273cd-1700-465f-895e-6a1a093f44d8 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:50:50 user nova-compute[74850]: DEBUG nova.compute.manager [req-6b9e3e30-44e7-4fea-aa46-ea4c795b50ba req-7dc2063b-d4f8-40df-acc1-3c140e0715a6 service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Refreshing instance network info cache due to event network-changed-667273cd-1700-465f-895e-6a1a093f44d8. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:50:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6b9e3e30-44e7-4fea-aa46-ea4c795b50ba req-7dc2063b-d4f8-40df-acc1-3c140e0715a6 service nova] Acquiring lock "refresh_cache-7f115ae8-49da-4bf5-ae7c-62696769420c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:50:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6b9e3e30-44e7-4fea-aa46-ea4c795b50ba req-7dc2063b-d4f8-40df-acc1-3c140e0715a6 service nova] Acquired lock "refresh_cache-7f115ae8-49da-4bf5-ae7c-62696769420c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:50:50 user nova-compute[74850]: DEBUG nova.network.neutron [req-6b9e3e30-44e7-4fea-aa46-ea4c795b50ba req-7dc2063b-d4f8-40df-acc1-3c140e0715a6 service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Refreshing network info cache for port 667273cd-1700-465f-895e-6a1a093f44d8 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:50:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28212eec-99be-4171-97ed-7748bbb75c88/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:50:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:50:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:50:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:50:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-cd9400ff-70c8-40d0-86e0-3472421071f5 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Acquiring lock "interface-7f115ae8-49da-4bf5-ae7c-62696769420c-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:50:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-cd9400ff-70c8-40d0-86e0-3472421071f5 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lock "interface-7f115ae8-49da-4bf5-ae7c-62696769420c-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:50:50 user nova-compute[74850]: DEBUG nova.objects.instance [None req-cd9400ff-70c8-40d0-86e0-3472421071f5 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lazy-loading 'flavor' on Instance uuid 7f115ae8-49da-4bf5-ae7c-62696769420c {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:50:50 user nova-compute[74850]: DEBUG nova.network.neutron [req-6b9e3e30-44e7-4fea-aa46-ea4c795b50ba req-7dc2063b-d4f8-40df-acc1-3c140e0715a6 service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Updated VIF entry in instance network info cache for port 667273cd-1700-465f-895e-6a1a093f44d8. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:50:50 user nova-compute[74850]: DEBUG nova.network.neutron [req-6b9e3e30-44e7-4fea-aa46-ea4c795b50ba req-7dc2063b-d4f8-40df-acc1-3c140e0715a6 service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Updating instance_info_cache with network_info: [{"id": "667273cd-1700-465f-895e-6a1a093f44d8", "address": "fa:16:3e:d1:ab:73", "network": {"id": "db78a7e7-17dd-4ef3-940d-96d93df45daa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1114583145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b29bf565027342a8ac084f1fd0a9b3f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap667273cd-17", "ovs_interfaceid": "667273cd-1700-465f-895e-6a1a093f44d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:50:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6b9e3e30-44e7-4fea-aa46-ea4c795b50ba req-7dc2063b-d4f8-40df-acc1-3c140e0715a6 service nova] Releasing lock "refresh_cache-7f115ae8-49da-4bf5-ae7c-62696769420c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:50:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:50:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:51 user nova-compute[74850]: DEBUG nova.objects.instance [None req-cd9400ff-70c8-40d0-86e0-3472421071f5 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lazy-loading 'pci_requests' on Instance uuid 7f115ae8-49da-4bf5-ae7c-62696769420c {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:50:51 user nova-compute[74850]: DEBUG nova.objects.base [None req-cd9400ff-70c8-40d0-86e0-3472421071f5 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Object Instance<7f115ae8-49da-4bf5-ae7c-62696769420c> lazy-loaded attributes: flavor,pci_requests {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 00:50:51 user nova-compute[74850]: DEBUG nova.network.neutron [None req-cd9400ff-70c8-40d0-86e0-3472421071f5 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 00:50:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:50:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:51 user nova-compute[74850]: DEBUG nova.policy [None req-cd9400ff-70c8-40d0-86e0-3472421071f5 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cebab0c5f0c74784a0d09a696a9b62d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29bf565027342a8ac084f1fd0a9b3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 00:50:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:50:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:50:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:50:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:51 user nova-compute[74850]: DEBUG nova.network.neutron [None req-cd9400ff-70c8-40d0-86e0-3472421071f5 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Successfully created port: 8911f309-779d-4df0-a8bd-ead798ceb829 {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:50:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:50:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:52 user nova-compute[74850]: DEBUG nova.compute.manager [req-c7045436-73c2-4200-ab3a-bf485bbd25f7 req-2f3473eb-6968-4d0c-b745-ad74aa49cbcf service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Received event network-changed-06e3d114-d80f-4634-840a-d4e120c77a88 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:50:52 user nova-compute[74850]: DEBUG nova.compute.manager [req-c7045436-73c2-4200-ab3a-bf485bbd25f7 req-2f3473eb-6968-4d0c-b745-ad74aa49cbcf service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Refreshing instance network info cache due to event network-changed-06e3d114-d80f-4634-840a-d4e120c77a88. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:50:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c7045436-73c2-4200-ab3a-bf485bbd25f7 req-2f3473eb-6968-4d0c-b745-ad74aa49cbcf service nova] Acquiring lock "refresh_cache-4b60ac08-e954-46d5-a280-a11146b3ebf4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:50:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c7045436-73c2-4200-ab3a-bf485bbd25f7 req-2f3473eb-6968-4d0c-b745-ad74aa49cbcf service nova] Acquired lock "refresh_cache-4b60ac08-e954-46d5-a280-a11146b3ebf4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:50:52 user nova-compute[74850]: DEBUG nova.network.neutron [req-c7045436-73c2-4200-ab3a-bf485bbd25f7 req-2f3473eb-6968-4d0c-b745-ad74aa49cbcf service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Refreshing network info cache for port 06e3d114-d80f-4634-840a-d4e120c77a88 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:50:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:50:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:50:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:50:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:52 user nova-compute[74850]: DEBUG nova.network.neutron [req-c7045436-73c2-4200-ab3a-bf485bbd25f7 req-2f3473eb-6968-4d0c-b745-ad74aa49cbcf service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Updated VIF entry in instance network info cache for port 06e3d114-d80f-4634-840a-d4e120c77a88. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:50:52 user nova-compute[74850]: DEBUG nova.network.neutron [req-c7045436-73c2-4200-ab3a-bf485bbd25f7 req-2f3473eb-6968-4d0c-b745-ad74aa49cbcf service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Updating instance_info_cache with network_info: [{"id": "06e3d114-d80f-4634-840a-d4e120c77a88", "address": "fa:16:3e:ef:7a:d7", "network": {"id": "a32d38d7-3a21-4c1b-886b-473c5cac50a4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-777089423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ed4742aedf24e90a866dd0a8692635e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e3d114-d8", "ovs_interfaceid": "06e3d114-d80f-4634-840a-d4e120c77a88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:50:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c7045436-73c2-4200-ab3a-bf485bbd25f7 req-2f3473eb-6968-4d0c-b745-ad74aa49cbcf service nova] Releasing lock "refresh_cache-4b60ac08-e954-46d5-a280-a11146b3ebf4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:50:52 user nova-compute[74850]: DEBUG nova.network.neutron [None req-cd9400ff-70c8-40d0-86e0-3472421071f5 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Successfully updated port: 8911f309-779d-4df0-a8bd-ead798ceb829 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:50:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-cd9400ff-70c8-40d0-86e0-3472421071f5 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Acquiring lock "refresh_cache-7f115ae8-49da-4bf5-ae7c-62696769420c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:50:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-cd9400ff-70c8-40d0-86e0-3472421071f5 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Acquired lock "refresh_cache-7f115ae8-49da-4bf5-ae7c-62696769420c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:50:52 user nova-compute[74850]: DEBUG nova.network.neutron [None req-cd9400ff-70c8-40d0-86e0-3472421071f5 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:50:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:50:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:52 user nova-compute[74850]: DEBUG nova.compute.manager [req-fd0e60be-3403-4b59-b675-47dbd25b2c1f req-960d751c-ff84-44cc-a210-ae493153b7ef service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Received event network-changed-8911f309-779d-4df0-a8bd-ead798ceb829 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:50:52 user nova-compute[74850]: DEBUG nova.compute.manager [req-fd0e60be-3403-4b59-b675-47dbd25b2c1f req-960d751c-ff84-44cc-a210-ae493153b7ef service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Refreshing instance network info cache due to event network-changed-8911f309-779d-4df0-a8bd-ead798ceb829. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:50:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fd0e60be-3403-4b59-b675-47dbd25b2c1f req-960d751c-ff84-44cc-a210-ae493153b7ef service nova] Acquiring lock "refresh_cache-7f115ae8-49da-4bf5-ae7c-62696769420c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:50:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:50:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:50:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:50:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:53 user nova-compute[74850]: DEBUG nova.compute.manager [None req-7e37686c-dc09-4f6d-bdbc-8885da185873 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:50:53 user nova-compute[74850]: DEBUG nova.network.neutron [None req-cd9400ff-70c8-40d0-86e0-3472421071f5 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Updating instance_info_cache with network_info: [{"id": "667273cd-1700-465f-895e-6a1a093f44d8", "address": "fa:16:3e:d1:ab:73", "network": {"id": "db78a7e7-17dd-4ef3-940d-96d93df45daa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1114583145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b29bf565027342a8ac084f1fd0a9b3f5", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap667273cd-17", "ovs_interfaceid": "667273cd-1700-465f-895e-6a1a093f44d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8911f309-779d-4df0-a8bd-ead798ceb829", "address": "fa:16:3e:a4:51:b4", "network": {"id": "0f67cb75-70fd-41b7-b210-2a7c909da154", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1304810839", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b29bf565027342a8ac084f1fd0a9b3f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8911f309-77", "ovs_interfaceid": "8911f309-779d-4df0-a8bd-ead798ceb829", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:50:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-cd9400ff-70c8-40d0-86e0-3472421071f5 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Releasing lock "refresh_cache-7f115ae8-49da-4bf5-ae7c-62696769420c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:50:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c97e7df1-6908-4593-a690-0e19b1d1d194 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Acquiring lock "28212eec-99be-4171-97ed-7748bbb75c88" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:50:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c97e7df1-6908-4593-a690-0e19b1d1d194 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "28212eec-99be-4171-97ed-7748bbb75c88" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:50:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c97e7df1-6908-4593-a690-0e19b1d1d194 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Acquiring lock "28212eec-99be-4171-97ed-7748bbb75c88-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:50:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c97e7df1-6908-4593-a690-0e19b1d1d194 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "28212eec-99be-4171-97ed-7748bbb75c88-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:50:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c97e7df1-6908-4593-a690-0e19b1d1d194 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "28212eec-99be-4171-97ed-7748bbb75c88-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:50:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:50:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fd0e60be-3403-4b59-b675-47dbd25b2c1f req-960d751c-ff84-44cc-a210-ae493153b7ef service nova] Acquired lock "refresh_cache-7f115ae8-49da-4bf5-ae7c-62696769420c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:50:53 user nova-compute[74850]: DEBUG nova.network.neutron [req-fd0e60be-3403-4b59-b675-47dbd25b2c1f req-960d751c-ff84-44cc-a210-ae493153b7ef service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Refreshing network info cache for port 8911f309-779d-4df0-a8bd-ead798ceb829 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:50:53 user nova-compute[74850]: INFO nova.compute.manager [None req-c97e7df1-6908-4593-a690-0e19b1d1d194 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Terminating instance
Nov 14 00:50:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-cd9400ff-70c8-40d0-86e0-3472421071f5 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-622477935',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-622477935',id=17,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBGvhns7XWVf/haNp2AKmH5EhvuBpoE+TGi/Wza7qjLEHR4vfwIGfr3qwoxrfGTiid4eBr+1xVTKisgYQUIZxBKIACazg/Q7FT120267dvZKdM6cwjXC2T4hWuncWpIGw==',key_name='tempest-keypair-783468073',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:49:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b29bf565027342a8ac084f1fd0a9b3f5',ramdisk_id='',reservation_id='r-n5valy8w',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1948159451',owner_user_name='tempest-TaggedAttachmentsTest-1948159451-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:49:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cebab0c5f0c74784a0d09a696a9b62d8',uuid=7f115ae8-49da-4bf5-ae7c-62696769420c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8911f309-779d-4df0-a8bd-ead798ceb829", "address": "fa:16:3e:a4:51:b4", "network": {"id": "0f67cb75-70fd-41b7-b210-2a7c909da154", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1304810839", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b29bf565027342a8ac084f1fd0a9b3f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8911f309-77", "ovs_interfaceid": "8911f309-779d-4df0-a8bd-ead798ceb829", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:50:53 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-cd9400ff-70c8-40d0-86e0-3472421071f5 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Converting VIF {"id": "8911f309-779d-4df0-a8bd-ead798ceb829", "address": "fa:16:3e:a4:51:b4", "network": {"id": "0f67cb75-70fd-41b7-b210-2a7c909da154", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1304810839", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b29bf565027342a8ac084f1fd0a9b3f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8911f309-77", "ovs_interfaceid": "8911f309-779d-4df0-a8bd-ead798ceb829", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:50:53 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-cd9400ff-70c8-40d0-86e0-3472421071f5 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:51:b4,bridge_name='br-int',has_traffic_filtering=True,id=8911f309-779d-4df0-a8bd-ead798ceb829,network=Network(0f67cb75-70fd-41b7-b210-2a7c909da154),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8911f309-77') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:50:53 user nova-compute[74850]: DEBUG os_vif [None req-cd9400ff-70c8-40d0-86e0-3472421071f5 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:51:b4,bridge_name='br-int',has_traffic_filtering=True,id=8911f309-779d-4df0-a8bd-ead798ceb829,network=Network(0f67cb75-70fd-41b7-b210-2a7c909da154),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8911f309-77') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:50:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:50:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:50:53 user nova-compute[74850]: DEBUG nova.compute.manager [None req-c97e7df1-6908-4593-a690-0e19b1d1d194 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 00:50:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9911f7f8-175f-580a-9285-e7ee5b3013b2', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:50:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8911f309-77, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:50:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8911f309-77, col_values=(('qos', UUID('9405c322-874a-4a82-8cd8-e4ea576ebf11')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:50:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8911f309-77, col_values=(('external_ids', {'iface-id': '8911f309-779d-4df0-a8bd-ead798ceb829', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:51:b4', 'vm-uuid': '7f115ae8-49da-4bf5-ae7c-62696769420c'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:50:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:53 user nova-compute[74850]: INFO nova.compute.manager [None req-7e37686c-dc09-4f6d-bdbc-8885da185873 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] instance snapshotting
Nov 14 00:50:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:55 user nova-compute[74850]: INFO os_vif [None req-cd9400ff-70c8-40d0-86e0-3472421071f5 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:51:b4,bridge_name='br-int',has_traffic_filtering=True,id=8911f309-779d-4df0-a8bd-ead798ceb829,network=Network(0f67cb75-70fd-41b7-b210-2a7c909da154),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8911f309-77')
Nov 14 00:50:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-cd9400ff-70c8-40d0-86e0-3472421071f5 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-622477935',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-622477935',id=17,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBGvhns7XWVf/haNp2AKmH5EhvuBpoE+TGi/Wza7qjLEHR4vfwIGfr3qwoxrfGTiid4eBr+1xVTKisgYQUIZxBKIACazg/Q7FT120267dvZKdM6cwjXC2T4hWuncWpIGw==',key_name='tempest-keypair-783468073',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:49:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b29bf565027342a8ac084f1fd0a9b3f5',ramdisk_id='',reservation_id='r-n5valy8w',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1948159451',owner_user_name='tempest-TaggedAttachmentsTest-1948159451-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:49:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cebab0c5f0c74784a0d09a696a9b62d8',uuid=7f115ae8-49da-4bf5-ae7c-62696769420c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8911f309-779d-4df0-a8bd-ead798ceb829", "address": "fa:16:3e:a4:51:b4", "network": {"id": "0f67cb75-70fd-41b7-b210-2a7c909da154", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1304810839", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b29bf565027342a8ac084f1fd0a9b3f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8911f309-77", "ovs_interfaceid": "8911f309-779d-4df0-a8bd-ead798ceb829", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-cd9400ff-70c8-40d0-86e0-3472421071f5 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Converting VIF {"id": "8911f309-779d-4df0-a8bd-ead798ceb829", "address": "fa:16:3e:a4:51:b4", "network": {"id": "0f67cb75-70fd-41b7-b210-2a7c909da154", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1304810839", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b29bf565027342a8ac084f1fd0a9b3f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8911f309-77", "ovs_interfaceid": "8911f309-779d-4df0-a8bd-ead798ceb829", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-cd9400ff-70c8-40d0-86e0-3472421071f5 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:51:b4,bridge_name='br-int',has_traffic_filtering=True,id=8911f309-779d-4df0-a8bd-ead798ceb829,network=Network(0f67cb75-70fd-41b7-b210-2a7c909da154),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8911f309-77') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG nova.compute.manager [req-df3968c7-ca6b-4dd7-9b46-cb8883ce3dc8 req-aaa30d68-6a22-4396-ab77-385c7a57e81a service nova] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Received event network-vif-unplugged-9df19d5e-989a-48d6-97ce-03b6a897a611 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-df3968c7-ca6b-4dd7-9b46-cb8883ce3dc8 req-aaa30d68-6a22-4396-ab77-385c7a57e81a service nova] Acquiring lock "28212eec-99be-4171-97ed-7748bbb75c88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-df3968c7-ca6b-4dd7-9b46-cb8883ce3dc8 req-aaa30d68-6a22-4396-ab77-385c7a57e81a service nova] Lock "28212eec-99be-4171-97ed-7748bbb75c88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-df3968c7-ca6b-4dd7-9b46-cb8883ce3dc8 req-aaa30d68-6a22-4396-ab77-385c7a57e81a service nova] Lock "28212eec-99be-4171-97ed-7748bbb75c88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG nova.compute.manager [req-df3968c7-ca6b-4dd7-9b46-cb8883ce3dc8 req-aaa30d68-6a22-4396-ab77-385c7a57e81a service nova] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] No waiting events found dispatching network-vif-unplugged-9df19d5e-989a-48d6-97ce-03b6a897a611 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG nova.compute.manager [req-df3968c7-ca6b-4dd7-9b46-cb8883ce3dc8 req-aaa30d68-6a22-4396-ab77-385c7a57e81a service nova] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Received event network-vif-unplugged-9df19d5e-989a-48d6-97ce-03b6a897a611 for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-cd9400ff-70c8-40d0-86e0-3472421071f5 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] attach device xml: <interface type="ethernet">
Nov 14 00:50:55 user nova-compute[74850]:   <mac address="fa:16:3e:a4:51:b4"/>
Nov 14 00:50:55 user nova-compute[74850]:   <model type="virtio"/>
Nov 14 00:50:55 user nova-compute[74850]:   <mtu size="1442"/>
Nov 14 00:50:55 user nova-compute[74850]:   <target dev="tap8911f309-77"/>
Nov 14 00:50:55 user nova-compute[74850]: </interface>
Nov 14 00:50:55 user nova-compute[74850]:  {{(pid=74850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:55 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Instance destroyed successfully.
Nov 14 00:50:55 user nova-compute[74850]: DEBUG nova.objects.instance [None req-c97e7df1-6908-4593-a690-0e19b1d1d194 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lazy-loading 'resources' on Instance uuid 28212eec-99be-4171-97ed-7748bbb75c88 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:50:55 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:50:55 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:50:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=7619MB free_disk=25.050682067871094GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-c97e7df1-6908-4593-a690-0e19b1d1d194 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:45:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1059306291',display_name='tempest-VolumesAdminNegativeTest-server-1059306291',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1059306291',id=6,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhJUU9eZjl3FrozfyRmoCSTjLzncoBh8dvibr45B8DO68emkQD4LZpTdLfE5f44ABqo/F2Rw84fSCrgYdDTjL7If4ziIYk1Fyhlp1w+H6fY55jpuKryvfrOLxVkpt/UGg==',key_name='tempest-keypair-809168273',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:45:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51c848440ceb46dabf1eb8cca6533f09',ramdisk_id='',reservation_id='r-54kq7tgh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-43619810',owner_user_name='tempest-VolumesAdminNegativeTest-43619810-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:45:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cb1b3c8b5c24f399c674f9dde90aadc',uuid=28212eec-99be-4171-97ed-7748bbb75c88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9df19d5e-989a-48d6-97ce-03b6a897a611", "address": "fa:16:3e:0f:98:91", "network": {"id": "25547f45-3d27-4a3f-b2d2-6f0a0b4ae730", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-464974831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51c848440ceb46dabf1eb8cca6533f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df19d5e-98", "ovs_interfaceid": "9df19d5e-989a-48d6-97ce-03b6a897a611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-c97e7df1-6908-4593-a690-0e19b1d1d194 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Converting VIF {"id": "9df19d5e-989a-48d6-97ce-03b6a897a611", "address": "fa:16:3e:0f:98:91", "network": {"id": "25547f45-3d27-4a3f-b2d2-6f0a0b4ae730", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-464974831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51c848440ceb46dabf1eb8cca6533f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df19d5e-98", "ovs_interfaceid": "9df19d5e-989a-48d6-97ce-03b6a897a611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-c97e7df1-6908-4593-a690-0e19b1d1d194 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:98:91,bridge_name='br-int',has_traffic_filtering=True,id=9df19d5e-989a-48d6-97ce-03b6a897a611,network=Network(25547f45-3d27-4a3f-b2d2-6f0a0b4ae730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df19d5e-98') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG os_vif [None req-c97e7df1-6908-4593-a690-0e19b1d1d194 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:98:91,bridge_name='br-int',has_traffic_filtering=True,id=9df19d5e-989a-48d6-97ce-03b6a897a611,network=Network(25547f45-3d27-4a3f-b2d2-6f0a0b4ae730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df19d5e-98') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9df19d5e-98, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:50:55 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-7e37686c-dc09-4f6d-bdbc-8885da185873 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Beginning live snapshot process
Nov 14 00:50:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6e0601ca-d7e3-4800-ab2a-773312e7991e) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:55 user nova-compute[74850]: INFO os_vif [None req-c97e7df1-6908-4593-a690-0e19b1d1d194 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:98:91,bridge_name='br-int',has_traffic_filtering=True,id=9df19d5e-989a-48d6-97ce-03b6a897a611,network=Network(25547f45-3d27-4a3f-b2d2-6f0a0b4ae730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df19d5e-98')
Nov 14 00:50:55 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-c97e7df1-6908-4593-a690-0e19b1d1d194 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Deleting instance files /opt/stack/data/nova/instances/28212eec-99be-4171-97ed-7748bbb75c88_del
Nov 14 00:50:55 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-c97e7df1-6908-4593-a690-0e19b1d1d194 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Deletion of /opt/stack/data/nova/instances/28212eec-99be-4171-97ed-7748bbb75c88_del complete
Nov 14 00:50:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:55 user nova-compute[74850]: INFO nova.compute.manager [None req-c97e7df1-6908-4593-a690-0e19b1d1d194 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Took 1.78 seconds to destroy the instance on the hypervisor.
Nov 14 00:50:55 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-c97e7df1-6908-4593-a690-0e19b1d1d194 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-7e37686c-dc09-4f6d-bdbc-8885da185873 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk --force-share --output=json -f qcow2 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance a70d0196-f90e-47c4-be67-bf7ef4c3d8c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 1879be4c-9226-4c8c-a56c-f8e37398851b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 28212eec-99be-4171-97ed-7748bbb75c88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 4f1102c5-f5ef-48d5-b271-6e25bee5cc70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 7f115ae8-49da-4bf5-ae7c-62696769420c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 4b60ac08-e954-46d5-a280-a11146b3ebf4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance a62a2eab-2502-4275-948b-3f18c3fcff36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 748d0da7-bbb9-4e86-aae3-e48b1fa04c14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 1f3a0b8f-1591-49c8-afb1-88437d65fb75 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG nova.network.neutron [req-fd0e60be-3403-4b59-b675-47dbd25b2c1f req-960d751c-ff84-44cc-a210-ae493153b7ef service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Updated VIF entry in instance network info cache for port 8911f309-779d-4df0-a8bd-ead798ceb829. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG nova.network.neutron [req-fd0e60be-3403-4b59-b675-47dbd25b2c1f req-960d751c-ff84-44cc-a210-ae493153b7ef service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Updating instance_info_cache with network_info: [{"id": "667273cd-1700-465f-895e-6a1a093f44d8", "address": "fa:16:3e:d1:ab:73", "network": {"id": "db78a7e7-17dd-4ef3-940d-96d93df45daa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1114583145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b29bf565027342a8ac084f1fd0a9b3f5", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap667273cd-17", "ovs_interfaceid": "667273cd-1700-465f-895e-6a1a093f44d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8911f309-779d-4df0-a8bd-ead798ceb829", "address": "fa:16:3e:a4:51:b4", "network": {"id": "0f67cb75-70fd-41b7-b210-2a7c909da154", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1304810839", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b29bf565027342a8ac084f1fd0a9b3f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8911f309-77", "ovs_interfaceid": "8911f309-779d-4df0-a8bd-ead798ceb829", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fd0e60be-3403-4b59-b675-47dbd25b2c1f req-960d751c-ff84-44cc-a210-ae493153b7ef service nova] Releasing lock "refresh_cache-7f115ae8-49da-4bf5-ae7c-62696769420c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-cd9400ff-70c8-40d0-86e0-3472421071f5 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-cd9400ff-70c8-40d0-86e0-3472421071f5 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] No BDM found with device name hda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:50:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-cd9400ff-70c8-40d0-86e0-3472421071f5 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] No VIF found with MAC fa:16:3e:d1:ab:73, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:50:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-7e37686c-dc09-4f6d-bdbc-8885da185873 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk --force-share --output=json -f qcow2" returned: 0 in 0.329s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:50:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-7e37686c-dc09-4f6d-bdbc-8885da185873 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk --force-share --output=json -f qcow2 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-7e37686c-dc09-4f6d-bdbc-8885da185873 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk --force-share --output=json -f qcow2" returned: 0 in 0.195s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:50:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-7e37686c-dc09-4f6d-bdbc-8885da185873 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:56 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-cd9400ff-70c8-40d0-86e0-3472421071f5 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:50:56 user nova-compute[74850]:   <nova:package version="0.0.0"/>
Nov 14 00:50:56 user nova-compute[74850]:   <nova:name>tempest-device-tagging-server-622477935</nova:name>
Nov 14 00:50:56 user nova-compute[74850]:   <nova:creationTime>2023-11-14 00:50:56</nova:creationTime>
Nov 14 00:50:56 user nova-compute[74850]:   <nova:flavor name="m1.tiny">
Nov 14 00:50:56 user nova-compute[74850]:     <nova:memory>512</nova:memory>
Nov 14 00:50:56 user nova-compute[74850]:     <nova:disk>1</nova:disk>
Nov 14 00:50:56 user nova-compute[74850]:     <nova:swap>0</nova:swap>
Nov 14 00:50:56 user nova-compute[74850]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:50:56 user nova-compute[74850]:     <nova:vcpus>1</nova:vcpus>
Nov 14 00:50:56 user nova-compute[74850]:   </nova:flavor>
Nov 14 00:50:56 user nova-compute[74850]:   <nova:owner>
Nov 14 00:50:56 user nova-compute[74850]:     <nova:user uuid="cebab0c5f0c74784a0d09a696a9b62d8">tempest-TaggedAttachmentsTest-1948159451-project-member</nova:user>
Nov 14 00:50:56 user nova-compute[74850]:     <nova:project uuid="b29bf565027342a8ac084f1fd0a9b3f5">tempest-TaggedAttachmentsTest-1948159451</nova:project>
Nov 14 00:50:56 user nova-compute[74850]:   </nova:owner>
Nov 14 00:50:56 user nova-compute[74850]:   <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:50:56 user nova-compute[74850]:   <nova:ports>
Nov 14 00:50:56 user nova-compute[74850]:     <nova:port uuid="667273cd-1700-465f-895e-6a1a093f44d8">
Nov 14 00:50:56 user nova-compute[74850]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 00:50:56 user nova-compute[74850]:     </nova:port>
Nov 14 00:50:56 user nova-compute[74850]:     <nova:port uuid="8911f309-779d-4df0-a8bd-ead798ceb829">
Nov 14 00:50:56 user nova-compute[74850]:       <nova:ip type="fixed" address="10.10.10.165" ipVersion="4"/>
Nov 14 00:50:56 user nova-compute[74850]:     </nova:port>
Nov 14 00:50:56 user nova-compute[74850]:   </nova:ports>
Nov 14 00:50:56 user nova-compute[74850]: </nova:instance>
Nov 14 00:50:56 user nova-compute[74850]:  {{(pid=74850) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 00:50:56 user nova-compute[74850]: DEBUG nova.compute.manager [req-41d1666d-2592-47ec-95ad-c2af75d8d63d req-40539dc0-e711-420a-a50a-ebd195bf2776 service nova] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Received event network-vif-plugged-9df19d5e-989a-48d6-97ce-03b6a897a611 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:50:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-41d1666d-2592-47ec-95ad-c2af75d8d63d req-40539dc0-e711-420a-a50a-ebd195bf2776 service nova] Acquiring lock "28212eec-99be-4171-97ed-7748bbb75c88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:50:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-41d1666d-2592-47ec-95ad-c2af75d8d63d req-40539dc0-e711-420a-a50a-ebd195bf2776 service nova] Lock "28212eec-99be-4171-97ed-7748bbb75c88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:50:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-41d1666d-2592-47ec-95ad-c2af75d8d63d req-40539dc0-e711-420a-a50a-ebd195bf2776 service nova] Lock "28212eec-99be-4171-97ed-7748bbb75c88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:50:56 user nova-compute[74850]: DEBUG nova.compute.manager [req-41d1666d-2592-47ec-95ad-c2af75d8d63d req-40539dc0-e711-420a-a50a-ebd195bf2776 service nova] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] No waiting events found dispatching network-vif-plugged-9df19d5e-989a-48d6-97ce-03b6a897a611 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:50:56 user nova-compute[74850]: WARNING nova.compute.manager [req-41d1666d-2592-47ec-95ad-c2af75d8d63d req-40539dc0-e711-420a-a50a-ebd195bf2776 service nova] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Received unexpected event network-vif-plugged-9df19d5e-989a-48d6-97ce-03b6a897a611 for instance with vm_state active and task_state deleting.
Nov 14 00:50:56 user nova-compute[74850]: DEBUG nova.compute.manager [req-41d1666d-2592-47ec-95ad-c2af75d8d63d req-40539dc0-e711-420a-a50a-ebd195bf2776 service nova] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Received event network-vif-plugged-9df19d5e-989a-48d6-97ce-03b6a897a611 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:50:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-41d1666d-2592-47ec-95ad-c2af75d8d63d req-40539dc0-e711-420a-a50a-ebd195bf2776 service nova] Acquiring lock "28212eec-99be-4171-97ed-7748bbb75c88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:50:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-41d1666d-2592-47ec-95ad-c2af75d8d63d req-40539dc0-e711-420a-a50a-ebd195bf2776 service nova] Lock "28212eec-99be-4171-97ed-7748bbb75c88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:50:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-41d1666d-2592-47ec-95ad-c2af75d8d63d req-40539dc0-e711-420a-a50a-ebd195bf2776 service nova] Lock "28212eec-99be-4171-97ed-7748bbb75c88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:50:56 user nova-compute[74850]: DEBUG nova.compute.manager [req-41d1666d-2592-47ec-95ad-c2af75d8d63d req-40539dc0-e711-420a-a50a-ebd195bf2776 service nova] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] No waiting events found dispatching network-vif-plugged-9df19d5e-989a-48d6-97ce-03b6a897a611 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:50:56 user nova-compute[74850]: WARNING nova.compute.manager [req-41d1666d-2592-47ec-95ad-c2af75d8d63d req-40539dc0-e711-420a-a50a-ebd195bf2776 service nova] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Received unexpected event network-vif-plugged-9df19d5e-989a-48d6-97ce-03b6a897a611 for instance with vm_state active and task_state deleting.
Nov 14 00:50:56 user nova-compute[74850]: DEBUG nova.compute.manager [req-41d1666d-2592-47ec-95ad-c2af75d8d63d req-40539dc0-e711-420a-a50a-ebd195bf2776 service nova] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Received event network-vif-plugged-9df19d5e-989a-48d6-97ce-03b6a897a611 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:50:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-41d1666d-2592-47ec-95ad-c2af75d8d63d req-40539dc0-e711-420a-a50a-ebd195bf2776 service nova] Acquiring lock "28212eec-99be-4171-97ed-7748bbb75c88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:50:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-41d1666d-2592-47ec-95ad-c2af75d8d63d req-40539dc0-e711-420a-a50a-ebd195bf2776 service nova] Lock "28212eec-99be-4171-97ed-7748bbb75c88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:50:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-41d1666d-2592-47ec-95ad-c2af75d8d63d req-40539dc0-e711-420a-a50a-ebd195bf2776 service nova] Lock "28212eec-99be-4171-97ed-7748bbb75c88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:50:56 user nova-compute[74850]: DEBUG nova.compute.manager [req-41d1666d-2592-47ec-95ad-c2af75d8d63d req-40539dc0-e711-420a-a50a-ebd195bf2776 service nova] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] No waiting events found dispatching network-vif-plugged-9df19d5e-989a-48d6-97ce-03b6a897a611 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:50:56 user nova-compute[74850]: WARNING nova.compute.manager [req-41d1666d-2592-47ec-95ad-c2af75d8d63d req-40539dc0-e711-420a-a50a-ebd195bf2776 service nova] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Received unexpected event network-vif-plugged-9df19d5e-989a-48d6-97ce-03b6a897a611 for instance with vm_state active and task_state deleting.
Nov 14 00:50:56 user nova-compute[74850]: DEBUG nova.compute.manager [req-41d1666d-2592-47ec-95ad-c2af75d8d63d req-40539dc0-e711-420a-a50a-ebd195bf2776 service nova] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Received event network-vif-unplugged-9df19d5e-989a-48d6-97ce-03b6a897a611 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:50:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-41d1666d-2592-47ec-95ad-c2af75d8d63d req-40539dc0-e711-420a-a50a-ebd195bf2776 service nova] Acquiring lock "28212eec-99be-4171-97ed-7748bbb75c88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:50:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-41d1666d-2592-47ec-95ad-c2af75d8d63d req-40539dc0-e711-420a-a50a-ebd195bf2776 service nova] Lock "28212eec-99be-4171-97ed-7748bbb75c88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:50:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-41d1666d-2592-47ec-95ad-c2af75d8d63d req-40539dc0-e711-420a-a50a-ebd195bf2776 service nova] Lock "28212eec-99be-4171-97ed-7748bbb75c88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:50:56 user nova-compute[74850]: DEBUG nova.compute.manager [req-41d1666d-2592-47ec-95ad-c2af75d8d63d req-40539dc0-e711-420a-a50a-ebd195bf2776 service nova] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] No waiting events found dispatching network-vif-unplugged-9df19d5e-989a-48d6-97ce-03b6a897a611 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:50:56 user nova-compute[74850]: DEBUG nova.compute.manager [req-41d1666d-2592-47ec-95ad-c2af75d8d63d req-40539dc0-e711-420a-a50a-ebd195bf2776 service nova] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Received event network-vif-unplugged-9df19d5e-989a-48d6-97ce-03b6a897a611 for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 00:50:56 user nova-compute[74850]: DEBUG nova.compute.manager [req-41d1666d-2592-47ec-95ad-c2af75d8d63d req-40539dc0-e711-420a-a50a-ebd195bf2776 service nova] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Received event network-vif-plugged-9df19d5e-989a-48d6-97ce-03b6a897a611 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:50:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-41d1666d-2592-47ec-95ad-c2af75d8d63d req-40539dc0-e711-420a-a50a-ebd195bf2776 service nova] Acquiring lock "28212eec-99be-4171-97ed-7748bbb75c88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:50:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-41d1666d-2592-47ec-95ad-c2af75d8d63d req-40539dc0-e711-420a-a50a-ebd195bf2776 service nova] Lock "28212eec-99be-4171-97ed-7748bbb75c88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:50:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-41d1666d-2592-47ec-95ad-c2af75d8d63d req-40539dc0-e711-420a-a50a-ebd195bf2776 service nova] Lock "28212eec-99be-4171-97ed-7748bbb75c88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:50:56 user nova-compute[74850]: DEBUG nova.compute.manager [req-41d1666d-2592-47ec-95ad-c2af75d8d63d req-40539dc0-e711-420a-a50a-ebd195bf2776 service nova] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] No waiting events found dispatching network-vif-plugged-9df19d5e-989a-48d6-97ce-03b6a897a611 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:50:56 user nova-compute[74850]: WARNING nova.compute.manager [req-41d1666d-2592-47ec-95ad-c2af75d8d63d req-40539dc0-e711-420a-a50a-ebd195bf2776 service nova] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Received unexpected event network-vif-plugged-9df19d5e-989a-48d6-97ce-03b6a897a611 for instance with vm_state active and task_state deleting.
Nov 14 00:50:56 user nova-compute[74850]: DEBUG nova.compute.manager [req-41d1666d-2592-47ec-95ad-c2af75d8d63d req-40539dc0-e711-420a-a50a-ebd195bf2776 service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Received event network-vif-plugged-8911f309-779d-4df0-a8bd-ead798ceb829 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:50:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-41d1666d-2592-47ec-95ad-c2af75d8d63d req-40539dc0-e711-420a-a50a-ebd195bf2776 service nova] Acquiring lock "7f115ae8-49da-4bf5-ae7c-62696769420c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:50:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-41d1666d-2592-47ec-95ad-c2af75d8d63d req-40539dc0-e711-420a-a50a-ebd195bf2776 service nova] Lock "7f115ae8-49da-4bf5-ae7c-62696769420c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:50:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-41d1666d-2592-47ec-95ad-c2af75d8d63d req-40539dc0-e711-420a-a50a-ebd195bf2776 service nova] Lock "7f115ae8-49da-4bf5-ae7c-62696769420c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:50:56 user nova-compute[74850]: DEBUG nova.compute.manager [req-41d1666d-2592-47ec-95ad-c2af75d8d63d req-40539dc0-e711-420a-a50a-ebd195bf2776 service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] No waiting events found dispatching network-vif-plugged-8911f309-779d-4df0-a8bd-ead798ceb829 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:50:56 user nova-compute[74850]: WARNING nova.compute.manager [req-41d1666d-2592-47ec-95ad-c2af75d8d63d req-40539dc0-e711-420a-a50a-ebd195bf2776 service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Received unexpected event network-vif-plugged-8911f309-779d-4df0-a8bd-ead798ceb829 for instance with vm_state active and task_state None.
Nov 14 00:50:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-7e37686c-dc09-4f6d-bdbc-8885da185873 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.253s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:50:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-7e37686c-dc09-4f6d-bdbc-8885da185873 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpru635my1/fcc5ba124b3141e4a938ea6b9db9bc0f.delta 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:50:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-cd9400ff-70c8-40d0-86e0-3472421071f5 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lock "interface-7f115ae8-49da-4bf5-ae7c-62696769420c-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 5.769s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:50:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-7e37686c-dc09-4f6d-bdbc-8885da185873 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpru635my1/fcc5ba124b3141e4a938ea6b9db9bc0f.delta 1073741824" returned: 0 in 0.337s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:50:56 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-7e37686c-dc09-4f6d-bdbc-8885da185873 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 00:50:56 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:50:57 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:50:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:50:57 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 00:50:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.401s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:50:57 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:50:57 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Cleaning up deleted instances {{(pid=74850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 00:50:57 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] There are 0 instances to clean {{(pid=74850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 00:50:57 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:50:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Acquiring lock "7f115ae8-49da-4bf5-ae7c-62696769420c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:50:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lock "7f115ae8-49da-4bf5-ae7c-62696769420c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:50:58 user nova-compute[74850]: DEBUG nova.objects.instance [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lazy-loading 'flavor' on Instance uuid 7f115ae8-49da-4bf5-ae7c-62696769420c {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:50:58 user nova-compute[74850]: DEBUG nova.compute.manager [req-f12b91f2-1cf6-4aab-80f4-12aec96556f6 req-edab1ae6-09f6-42ff-90b4-e5e254d38fb4 service nova] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Received event network-vif-deleted-9df19d5e-989a-48d6-97ce-03b6a897a611 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:50:58 user nova-compute[74850]: INFO nova.compute.manager [req-f12b91f2-1cf6-4aab-80f4-12aec96556f6 req-edab1ae6-09f6-42ff-90b4-e5e254d38fb4 service nova] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Neutron deleted interface 9df19d5e-989a-48d6-97ce-03b6a897a611; detaching it from the instance and deleting it from the info cache
Nov 14 00:50:58 user nova-compute[74850]: DEBUG nova.network.neutron [req-f12b91f2-1cf6-4aab-80f4-12aec96556f6 req-edab1ae6-09f6-42ff-90b4-e5e254d38fb4 service nova] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:50:58 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:50:58 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:50:58 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:50:58 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 00:50:58 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Rebuilding the list of instances to heal {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 00:50:58 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-7e37686c-dc09-4f6d-bdbc-8885da185873 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 00:50:58 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Skipping network cache update for instance because it is being deleted. {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 14 00:50:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lock "7f115ae8-49da-4bf5-ae7c-62696769420c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.356s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:50:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "refresh_cache-a70d0196-f90e-47c4-be67-bf7ef4c3d8c4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:50:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquired lock "refresh_cache-a70d0196-f90e-47c4-be67-bf7ef4c3d8c4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:50:58 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Forcefully refreshing network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 00:50:58 user nova-compute[74850]: DEBUG nova.objects.instance [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lazy-loading 'info_cache' on Instance uuid a70d0196-f90e-47c4-be67-bf7ef4c3d8c4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:50:58 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:50:59 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Took 3.41 seconds to deallocate network for instance.
Nov 14 00:50:59 user nova-compute[74850]: DEBUG nova.compute.manager [req-f12b91f2-1cf6-4aab-80f4-12aec96556f6 req-edab1ae6-09f6-42ff-90b4-e5e254d38fb4 service nova] [instance: 28212eec-99be-4171-97ed-7748bbb75c88] Detach interface failed, port_id=9df19d5e-989a-48d6-97ce-03b6a897a611, reason: Instance 28212eec-99be-4171-97ed-7748bbb75c88 could not be found. {{(pid=74850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 00:50:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-7e37686c-dc09-4f6d-bdbc-8885da185873 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] COPY block job progress, current cursor: 1179648 final cursor: 75563008 {{(pid=74850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 00:50:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c97e7df1-6908-4593-a690-0e19b1d1d194 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:50:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c97e7df1-6908-4593-a690-0e19b1d1d194 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:50:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-7e37686c-dc09-4f6d-bdbc-8885da185873 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] COPY block job progress, current cursor: 5177344 final cursor: 75563008 {{(pid=74850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Updating instance_info_cache with network_info: [{"id": "f0de03a3-fd19-4cd1-a408-5168dcf267d7", "address": "fa:16:3e:44:d7:64", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0de03a3-fd", "ovs_interfaceid": "f0de03a3-fd19-4cd1-a408-5168dcf267d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Releasing lock "refresh_cache-a70d0196-f90e-47c4-be67-bf7ef4c3d8c4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Updated the network info_cache for instance {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-c97e7df1-6908-4593-a690-0e19b1d1d194 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-7e37686c-dc09-4f6d-bdbc-8885da185873 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] COPY block job progress, current cursor: 7536640 final cursor: 75563008 {{(pid=74850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-c97e7df1-6908-4593-a690-0e19b1d1d194 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:00 user nova-compute[74850]: WARNING nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] While synchronizing instance power states, found 9 instances in the database and 8 instances on the hypervisor.
Nov 14 00:51:00 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Triggering sync for uuid a70d0196-f90e-47c4-be67-bf7ef4c3d8c4 {{(pid=74850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Triggering sync for uuid 1879be4c-9226-4c8c-a56c-f8e37398851b {{(pid=74850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Triggering sync for uuid 4f1102c5-f5ef-48d5-b271-6e25bee5cc70 {{(pid=74850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Triggering sync for uuid 7f115ae8-49da-4bf5-ae7c-62696769420c {{(pid=74850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Triggering sync for uuid 4b60ac08-e954-46d5-a280-a11146b3ebf4 {{(pid=74850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Triggering sync for uuid a62a2eab-2502-4275-948b-3f18c3fcff36 {{(pid=74850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Triggering sync for uuid 748d0da7-bbb9-4e86-aae3-e48b1fa04c14 {{(pid=74850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Triggering sync for uuid 1f3a0b8f-1591-49c8-afb1-88437d65fb75 {{(pid=74850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Triggering sync for uuid 28212eec-99be-4171-97ed-7748bbb75c88 {{(pid=74850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "1879be4c-9226-4c8c-a56c-f8e37398851b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "1879be4c-9226-4c8c-a56c-f8e37398851b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "7f115ae8-49da-4bf5-ae7c-62696769420c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "7f115ae8-49da-4bf5-ae7c-62696769420c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "4b60ac08-e954-46d5-a280-a11146b3ebf4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "4b60ac08-e954-46d5-a280-a11146b3ebf4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:51:00 user nova-compute[74850]: INFO nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] During sync_power_state the instance has a pending task (image_pending_upload). Skip.
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "4b60ac08-e954-46d5-a280-a11146b3ebf4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "a62a2eab-2502-4275-948b-3f18c3fcff36" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "a62a2eab-2502-4275-948b-3f18c3fcff36" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "748d0da7-bbb9-4e86-aae3-e48b1fa04c14" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "748d0da7-bbb9-4e86-aae3-e48b1fa04c14" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "1f3a0b8f-1591-49c8-afb1-88437d65fb75" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "1f3a0b8f-1591-49c8-afb1-88437d65fb75" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "28212eec-99be-4171-97ed-7748bbb75c88" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.206s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "7f115ae8-49da-4bf5-ae7c-62696769420c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.207s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c97e7df1-6908-4593-a690-0e19b1d1d194 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.955s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "1879be4c-9226-4c8c-a56c-f8e37398851b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.222s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Acquiring lock "7f115ae8-49da-4bf5-ae7c-62696769420c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lock "7f115ae8-49da-4bf5-ae7c-62696769420c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:51:00 user nova-compute[74850]: INFO nova.compute.manager [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Attaching volume ac2e17c0-05fb-4acc-91b8-1abf4f115390 to /dev/vdb
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "1f3a0b8f-1591-49c8-afb1-88437d65fb75" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.224s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "a62a2eab-2502-4275-948b-3f18c3fcff36" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.240s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "748d0da7-bbb9-4e86-aae3-e48b1fa04c14" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.240s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.247s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:51:00 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-c97e7df1-6908-4593-a690-0e19b1d1d194 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Deleted allocations for instance 28212eec-99be-4171-97ed-7748bbb75c88
Nov 14 00:51:00 user nova-compute[74850]: DEBUG os_brick.utils [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG nova.compute.manager [req-d7b60bb1-2d31-4eea-b2ea-b4cfd18718b7 req-36de77f2-2f1a-4677-82f5-40bd29b8cbb9 service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Received event network-vif-plugged-8911f309-779d-4df0-a8bd-ead798ceb829 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d7b60bb1-2d31-4eea-b2ea-b4cfd18718b7 req-36de77f2-2f1a-4677-82f5-40bd29b8cbb9 service nova] Acquiring lock "7f115ae8-49da-4bf5-ae7c-62696769420c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d7b60bb1-2d31-4eea-b2ea-b4cfd18718b7 req-36de77f2-2f1a-4677-82f5-40bd29b8cbb9 service nova] Lock "7f115ae8-49da-4bf5-ae7c-62696769420c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d7b60bb1-2d31-4eea-b2ea-b4cfd18718b7 req-36de77f2-2f1a-4677-82f5-40bd29b8cbb9 service nova] Lock "7f115ae8-49da-4bf5-ae7c-62696769420c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG nova.compute.manager [req-d7b60bb1-2d31-4eea-b2ea-b4cfd18718b7 req-36de77f2-2f1a-4677-82f5-40bd29b8cbb9 service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] No waiting events found dispatching network-vif-plugged-8911f309-779d-4df0-a8bd-ead798ceb829 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:51:00 user nova-compute[74850]: WARNING nova.compute.manager [req-d7b60bb1-2d31-4eea-b2ea-b4cfd18718b7 req-36de77f2-2f1a-4677-82f5-40bd29b8cbb9 service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Received unexpected event network-vif-plugged-8911f309-779d-4df0-a8bd-ead798ceb829 for instance with vm_state active and task_state None.
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2dc8432-f8af-40cd-ac98-a029fdc762d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[639ffd8f-4ad6-43dc-8522-a9b8326dae27]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[91463cfd-b04e-4443-aba2-3d53ba2e2c60]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44a16f9-7d95-4053-928a-6a663e75ab2e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-7e37686c-dc09-4f6d-bdbc-8885da185873 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c97e7df1-6908-4593-a690-0e19b1d1d194 tempest-VolumesAdminNegativeTest-43619810 tempest-VolumesAdminNegativeTest-43619810-project-member] Lock "28212eec-99be-4171-97ed-7748bbb75c88" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.222s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "28212eec-99be-4171-97ed-7748bbb75c88" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.487s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:51:00 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 00:51:00 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d4b724-b32d-484c-bf71-d7b30c3f18de]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:51:00 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-7e37686c-dc09-4f6d-bdbc-8885da185873 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 00:51:01 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 00:51:01 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 00:51:01 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 00:51:01 user nova-compute[74850]: DEBUG os_brick.utils [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:51:01 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Updating existing volume attachment record: 10e85d29-e24e-44e6-b4a5-6c33572b4c6c {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 00:51:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "28212eec-99be-4171-97ed-7748bbb75c88" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:51:01 user nova-compute[74850]: DEBUG nova.privsep.utils [None req-7e37686c-dc09-4f6d-bdbc-8885da185873 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74850) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 00:51:01 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-7e37686c-dc09-4f6d-bdbc-8885da185873 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpru635my1/fcc5ba124b3141e4a938ea6b9db9bc0f.delta /opt/stack/data/nova/instances/snapshots/tmpru635my1/fcc5ba124b3141e4a938ea6b9db9bc0f {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:01 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-7e37686c-dc09-4f6d-bdbc-8885da185873 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpru635my1/fcc5ba124b3141e4a938ea6b9db9bc0f.delta /opt/stack/data/nova/instances/snapshots/tmpru635my1/fcc5ba124b3141e4a938ea6b9db9bc0f" returned: 0 in 0.614s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:01 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-7e37686c-dc09-4f6d-bdbc-8885da185873 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Snapshot extracted, beginning image upload
Nov 14 00:51:04 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-7e37686c-dc09-4f6d-bdbc-8885da185873 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Snapshot image upload complete
Nov 14 00:51:04 user nova-compute[74850]: INFO nova.compute.manager [None req-7e37686c-dc09-4f6d-bdbc-8885da185873 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Took 8.99 seconds to snapshot the instance on the hypervisor.
Nov 14 00:51:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJZdmosI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:51:05 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:51:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:51:05 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:51:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:51:05 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 00:51:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390 -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2325fc3-4181-4be4-b1db-c32fca381150]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 00:51:05 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390 -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[880d05d5-fbf9-48a4-a1ca-228cd00ac839]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390] added
Nov 14 00:51:05 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[82576773-b97f-4710-9c2e-d84d40a6c96e]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e32ce36-240d-4f21-85ef-02e5aeef5834]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QJZdmosI {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QJZdmosI" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9374b6-a851-4af3-b80c-f883056cf181]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QJZdmosI'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae5c4eb-1b7a-40c0-b565-4a318f0f2b46]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8a184f-8638-4cf5-a31d-3b6574f7819e]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:51:05 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:51:05 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390 -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bd3962-e922-407f-a489-9c1d5c1cdbe0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390, portal: 172.16.0.220,3260]
Nov 14 00:51:05 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390, portal: 172.16.0.220,3260] successful.
Nov 14 00:51:05 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09a2e6c-fbd6-44f7-b60b-05eea71acd88]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed545cb-7d19-419e-a475-a741f2a69f01]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:51:05 user nova-compute[74850]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390 (non-flash)
Nov 14 00:51:05 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:51:05 user nova-compute[74850]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390 (non-flash)
Nov 14 00:51:05 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a006bd3-4e74-4ae8-bb30-1f7bab67a413]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:51:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJZdmosI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 00:51:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:51:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23637353936663234', 'path': '/dev/sdb'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:51:06 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637353936663234', 'path': '/dev/sdb'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 00:51:06 user nova-compute[74850]: DEBUG nova.objects.instance [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lazy-loading 'flavor' on Instance uuid 7f115ae8-49da-4bf5-ae7c-62696769420c {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:51:06 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 00:51:06 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:51:06 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 00:51:06 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:51:06 user nova-compute[74850]:   <serial>ac2e17c0-05fb-4acc-91b8-1abf4f115390</serial>
Nov 14 00:51:06 user nova-compute[74850]: </disk>
Nov 14 00:51:06 user nova-compute[74850]:  {{(pid=74850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 00:51:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:51:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] No BDM found with device name hda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:51:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] No VIF found with MAC fa:16:3e:d1:ab:73, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:51:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e505aa32-faa4-4c46-9148-7ac08a8e3654 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lock "7f115ae8-49da-4bf5-ae7c-62696769420c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.772s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:51:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dc49ff6e-80cd-41cd-983b-827630cc44c9 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Acquiring lock "7f115ae8-49da-4bf5-ae7c-62696769420c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:51:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dc49ff6e-80cd-41cd-983b-827630cc44c9 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lock "7f115ae8-49da-4bf5-ae7c-62696769420c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:51:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:09 user nova-compute[74850]: INFO nova.compute.manager [None req-dc49ff6e-80cd-41cd-983b-827630cc44c9 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Detaching volume ac2e17c0-05fb-4acc-91b8-1abf4f115390
Nov 14 00:51:09 user nova-compute[74850]: INFO nova.virt.block_device [None req-dc49ff6e-80cd-41cd-983b-827630cc44c9 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Attempting to driver detach volume ac2e17c0-05fb-4acc-91b8-1abf4f115390 from mountpoint /dev/vdb
Nov 14 00:51:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-dc49ff6e-80cd-41cd-983b-827630cc44c9 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Attempting to detach device vdb from instance 7f115ae8-49da-4bf5-ae7c-62696769420c from the persistent domain config. {{(pid=74850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 00:51:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-dc49ff6e-80cd-41cd-983b-827630cc44c9 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 00:51:09 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:51:09 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 00:51:09 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:51:09 user nova-compute[74850]:   <serial>ac2e17c0-05fb-4acc-91b8-1abf4f115390</serial>
Nov 14 00:51:09 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 00:51:09 user nova-compute[74850]: </disk>
Nov 14 00:51:09 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 00:51:09 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-dc49ff6e-80cd-41cd-983b-827630cc44c9 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Successfully detached device vdb from instance 7f115ae8-49da-4bf5-ae7c-62696769420c from the persistent domain config.
Nov 14 00:51:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-dc49ff6e-80cd-41cd-983b-827630cc44c9 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7f115ae8-49da-4bf5-ae7c-62696769420c from the live domain config. {{(pid=74850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 00:51:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-dc49ff6e-80cd-41cd-983b-827630cc44c9 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 00:51:09 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:51:09 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 00:51:09 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:51:09 user nova-compute[74850]:   <serial>ac2e17c0-05fb-4acc-91b8-1abf4f115390</serial>
Nov 14 00:51:09 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 00:51:09 user nova-compute[74850]: </disk>
Nov 14 00:51:09 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 00:51:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-dc49ff6e-80cd-41cd-983b-827630cc44c9 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7f115ae8-49da-4bf5-ae7c-62696769420c {{(pid=74850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 00:51:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:15 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:15 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Acquiring lock "e2f305e1-7092-4e8a-bb47-a15c89388eb2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:51:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Lock "e2f305e1-7092-4e8a-bb47-a15c89388eb2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:51:18 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 00:51:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:51:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:51:18 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 00:51:18 user nova-compute[74850]: INFO nova.compute.claims [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Claim successful on node user
Nov 14 00:51:18 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:51:18 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:51:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:51:18 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 00:51:18 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 00:51:18 user nova-compute[74850]: DEBUG nova.network.neutron [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 00:51:18 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 00:51:18 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 00:51:19 user nova-compute[74850]: DEBUG nova.policy [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1fb1ab671fa64b55ac3d30df3d41cb3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf004672a7b54f718937d1a0db6cec04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 00:51:19 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 00:51:19 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 00:51:19 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Creating image(s)
Nov 14 00:51:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Acquiring lock "/opt/stack/data/nova/instances/e2f305e1-7092-4e8a-bb47-a15c89388eb2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:51:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Lock "/opt/stack/data/nova/instances/e2f305e1-7092-4e8a-bb47-a15c89388eb2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:51:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Lock "/opt/stack/data/nova/instances/e2f305e1-7092-4e8a-bb47-a15c89388eb2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:51:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.190s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:51:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:51:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.198s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/e2f305e1-7092-4e8a-bb47-a15c89388eb2/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/e2f305e1-7092-4e8a-bb47-a15c89388eb2/disk 1073741824" returned: 0 in 0.254s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.461s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:51:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.176s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:19 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e2f305e1-7092-4e8a-bb47-a15c89388eb2/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 00:51:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2f305e1-7092-4e8a-bb47-a15c89388eb2/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:19 user nova-compute[74850]: DEBUG nova.network.neutron [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Successfully created port: 494f4389-78fe-41c4-aa06-c1b2666915cb {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:51:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:20 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2f305e1-7092-4e8a-bb47-a15c89388eb2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:20 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Cannot resize image /opt/stack/data/nova/instances/e2f305e1-7092-4e8a-bb47-a15c89388eb2/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 00:51:20 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 00:51:20 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Ensure instance console log exists: /opt/stack/data/nova/instances/e2f305e1-7092-4e8a-bb47-a15c89388eb2/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 00:51:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:51:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:51:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:51:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:20 user nova-compute[74850]: DEBUG nova.network.neutron [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Successfully updated port: 494f4389-78fe-41c4-aa06-c1b2666915cb {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:51:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Acquiring lock "refresh_cache-e2f305e1-7092-4e8a-bb47-a15c89388eb2" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:51:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Acquired lock "refresh_cache-e2f305e1-7092-4e8a-bb47-a15c89388eb2" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:51:20 user nova-compute[74850]: DEBUG nova.network.neutron [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:51:20 user nova-compute[74850]: DEBUG nova.compute.manager [req-cca01fe9-3b08-4c15-9e7d-0be68ab79ec9 req-afeb9752-6cfa-4d2b-9730-4454f9264a57 service nova] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Received event network-changed-494f4389-78fe-41c4-aa06-c1b2666915cb {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:51:20 user nova-compute[74850]: DEBUG nova.compute.manager [req-cca01fe9-3b08-4c15-9e7d-0be68ab79ec9 req-afeb9752-6cfa-4d2b-9730-4454f9264a57 service nova] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Refreshing instance network info cache due to event network-changed-494f4389-78fe-41c4-aa06-c1b2666915cb. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:51:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-cca01fe9-3b08-4c15-9e7d-0be68ab79ec9 req-afeb9752-6cfa-4d2b-9730-4454f9264a57 service nova] Acquiring lock "refresh_cache-e2f305e1-7092-4e8a-bb47-a15c89388eb2" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:51:20 user nova-compute[74850]: DEBUG nova.network.neutron [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:51:20 user nova-compute[74850]: DEBUG nova.network.neutron [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Updating instance_info_cache with network_info: [{"id": "494f4389-78fe-41c4-aa06-c1b2666915cb", "address": "fa:16:3e:f7:89:24", "network": {"id": "70b59622-f2a8-4dfc-9f03-828f4824be1e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1478695014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf004672a7b54f718937d1a0db6cec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494f4389-78", "ovs_interfaceid": "494f4389-78fe-41c4-aa06-c1b2666915cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:51:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Releasing lock "refresh_cache-e2f305e1-7092-4e8a-bb47-a15c89388eb2" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:51:20 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Instance network_info: |[{"id": "494f4389-78fe-41c4-aa06-c1b2666915cb", "address": "fa:16:3e:f7:89:24", "network": {"id": "70b59622-f2a8-4dfc-9f03-828f4824be1e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1478695014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf004672a7b54f718937d1a0db6cec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494f4389-78", "ovs_interfaceid": "494f4389-78fe-41c4-aa06-c1b2666915cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 00:51:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-cca01fe9-3b08-4c15-9e7d-0be68ab79ec9 req-afeb9752-6cfa-4d2b-9730-4454f9264a57 service nova] Acquired lock "refresh_cache-e2f305e1-7092-4e8a-bb47-a15c89388eb2" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:51:20 user nova-compute[74850]: DEBUG nova.network.neutron [req-cca01fe9-3b08-4c15-9e7d-0be68ab79ec9 req-afeb9752-6cfa-4d2b-9730-4454f9264a57 service nova] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Refreshing network info cache for port 494f4389-78fe-41c4-aa06-c1b2666915cb {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:51:20 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Start _get_guest_xml network_info=[{"id": "494f4389-78fe-41c4-aa06-c1b2666915cb", "address": "fa:16:3e:f7:89:24", "network": {"id": "70b59622-f2a8-4dfc-9f03-828f4824be1e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1478695014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf004672a7b54f718937d1a0db6cec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494f4389-78", "ovs_interfaceid": "494f4389-78fe-41c4-aa06-c1b2666915cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:51:21 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:51:21 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:51:21 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:51:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1518541907',display_name='tempest-ServersNegativeTestJSON-server-1518541907',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1518541907',id=22,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf004672a7b54f718937d1a0db6cec04',ramdisk_id='',reservation_id='r-qyggtxhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1191110421',owner_user_name='tempest-ServersNegativeTestJSON-1191110421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:51:19Z,user_data=None,user_id='1fb1ab671fa64b55ac3d30df3d41cb3b',uuid=e2f305e1-7092-4e8a-bb47-a15c89388eb2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "494f4389-78fe-41c4-aa06-c1b2666915cb", "address": "fa:16:3e:f7:89:24", "network": {"id": "70b59622-f2a8-4dfc-9f03-828f4824be1e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1478695014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf004672a7b54f718937d1a0db6cec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494f4389-78", "ovs_interfaceid": "494f4389-78fe-41c4-aa06-c1b2666915cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Converting VIF {"id": "494f4389-78fe-41c4-aa06-c1b2666915cb", "address": "fa:16:3e:f7:89:24", "network": {"id": "70b59622-f2a8-4dfc-9f03-828f4824be1e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1478695014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf004672a7b54f718937d1a0db6cec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494f4389-78", "ovs_interfaceid": "494f4389-78fe-41c4-aa06-c1b2666915cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:89:24,bridge_name='br-int',has_traffic_filtering=True,id=494f4389-78fe-41c4-aa06-c1b2666915cb,network=Network(70b59622-f2a8-4dfc-9f03-828f4824be1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494f4389-78') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG nova.objects.instance [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Lazy-loading 'pci_devices' on Instance uuid e2f305e1-7092-4e8a-bb47-a15c89388eb2 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:51:21 user nova-compute[74850]:   <uuid>e2f305e1-7092-4e8a-bb47-a15c89388eb2</uuid>
Nov 14 00:51:21 user nova-compute[74850]:   <name>instance-00000016</name>
Nov 14 00:51:21 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:51:21 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:51:21 user nova-compute[74850]:   <metadata>
Nov 14 00:51:21 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:51:21 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:51:21 user nova-compute[74850]:       <nova:name>tempest-ServersNegativeTestJSON-server-1518541907</nova:name>
Nov 14 00:51:21 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:51:21</nova:creationTime>
Nov 14 00:51:21 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:51:21 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:51:21 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:51:21 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:51:21 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:51:21 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:51:21 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:51:21 user nova-compute[74850]:       <nova:owner>
Nov 14 00:51:21 user nova-compute[74850]:         <nova:user uuid="1fb1ab671fa64b55ac3d30df3d41cb3b">tempest-ServersNegativeTestJSON-1191110421-project-member</nova:user>
Nov 14 00:51:21 user nova-compute[74850]:         <nova:project uuid="bf004672a7b54f718937d1a0db6cec04">tempest-ServersNegativeTestJSON-1191110421</nova:project>
Nov 14 00:51:21 user nova-compute[74850]:       </nova:owner>
Nov 14 00:51:21 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:51:21 user nova-compute[74850]:       <nova:ports>
Nov 14 00:51:21 user nova-compute[74850]:         <nova:port uuid="494f4389-78fe-41c4-aa06-c1b2666915cb">
Nov 14 00:51:21 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 00:51:21 user nova-compute[74850]:         </nova:port>
Nov 14 00:51:21 user nova-compute[74850]:       </nova:ports>
Nov 14 00:51:21 user nova-compute[74850]:     </nova:instance>
Nov 14 00:51:21 user nova-compute[74850]:   </metadata>
Nov 14 00:51:21 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:51:21 user nova-compute[74850]:     <system>
Nov 14 00:51:21 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:51:21 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:51:21 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:51:21 user nova-compute[74850]:       <entry name="serial">e2f305e1-7092-4e8a-bb47-a15c89388eb2</entry>
Nov 14 00:51:21 user nova-compute[74850]:       <entry name="uuid">e2f305e1-7092-4e8a-bb47-a15c89388eb2</entry>
Nov 14 00:51:21 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:51:21 user nova-compute[74850]:     </system>
Nov 14 00:51:21 user nova-compute[74850]:   </sysinfo>
Nov 14 00:51:21 user nova-compute[74850]:   <os>
Nov 14 00:51:21 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:51:21 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 00:51:21 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:51:21 user nova-compute[74850]:   </os>
Nov 14 00:51:21 user nova-compute[74850]:   <features>
Nov 14 00:51:21 user nova-compute[74850]:     <acpi/>
Nov 14 00:51:21 user nova-compute[74850]:     <apic/>
Nov 14 00:51:21 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:51:21 user nova-compute[74850]:   </features>
Nov 14 00:51:21 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:51:21 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:51:21 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:51:21 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:51:21 user nova-compute[74850]:   </clock>
Nov 14 00:51:21 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:51:21 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:51:21 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:51:21 user nova-compute[74850]:   </cpu>
Nov 14 00:51:21 user nova-compute[74850]:   <devices>
Nov 14 00:51:21 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 00:51:21 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:51:21 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/e2f305e1-7092-4e8a-bb47-a15c89388eb2/disk"/>
Nov 14 00:51:21 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:51:21 user nova-compute[74850]:     </disk>
Nov 14 00:51:21 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:51:21 user nova-compute[74850]:       <mac address="fa:16:3e:f7:89:24"/>
Nov 14 00:51:21 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:51:21 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:51:21 user nova-compute[74850]:       <target dev="tap494f4389-78"/>
Nov 14 00:51:21 user nova-compute[74850]:     </interface>
Nov 14 00:51:21 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:51:21 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/e2f305e1-7092-4e8a-bb47-a15c89388eb2/console.log" append="off"/>
Nov 14 00:51:21 user nova-compute[74850]:     </serial>
Nov 14 00:51:21 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:51:21 user nova-compute[74850]:     <video>
Nov 14 00:51:21 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:51:21 user nova-compute[74850]:     </video>
Nov 14 00:51:21 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:51:21 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:51:21 user nova-compute[74850]:     </rng>
Nov 14 00:51:21 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:51:21 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:51:21 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:51:21 user nova-compute[74850]:     </memballoon>
Nov 14 00:51:21 user nova-compute[74850]:   </devices>
Nov 14 00:51:21 user nova-compute[74850]: </domain>
Nov 14 00:51:21 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:51:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1518541907',display_name='tempest-ServersNegativeTestJSON-server-1518541907',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1518541907',id=22,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf004672a7b54f718937d1a0db6cec04',ramdisk_id='',reservation_id='r-qyggtxhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1191110421',owner_user_name='tempest-ServersNegativeTestJSON-1191110421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:51:19Z,user_data=None,user_id='1fb1ab671fa64b55ac3d30df3d41cb3b',uuid=e2f305e1-7092-4e8a-bb47-a15c89388eb2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "494f4389-78fe-41c4-aa06-c1b2666915cb", "address": "fa:16:3e:f7:89:24", "network": {"id": "70b59622-f2a8-4dfc-9f03-828f4824be1e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1478695014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf004672a7b54f718937d1a0db6cec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494f4389-78", "ovs_interfaceid": "494f4389-78fe-41c4-aa06-c1b2666915cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Converting VIF {"id": "494f4389-78fe-41c4-aa06-c1b2666915cb", "address": "fa:16:3e:f7:89:24", "network": {"id": "70b59622-f2a8-4dfc-9f03-828f4824be1e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1478695014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf004672a7b54f718937d1a0db6cec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494f4389-78", "ovs_interfaceid": "494f4389-78fe-41c4-aa06-c1b2666915cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:89:24,bridge_name='br-int',has_traffic_filtering=True,id=494f4389-78fe-41c4-aa06-c1b2666915cb,network=Network(70b59622-f2a8-4dfc-9f03-828f4824be1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494f4389-78') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG os_vif [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:89:24,bridge_name='br-int',has_traffic_filtering=True,id=494f4389-78fe-41c4-aa06-c1b2666915cb,network=Network(70b59622-f2a8-4dfc-9f03-828f4824be1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494f4389-78') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fd61cdb1-402a-5cfd-aa0b-b46073b1cfc9', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap494f4389-78, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap494f4389-78, col_values=(('qos', UUID('dbb4ff83-ba41-4caf-b8c9-ae490b3f37f3')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap494f4389-78, col_values=(('external_ids', {'iface-id': '494f4389-78fe-41c4-aa06-c1b2666915cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:89:24', 'vm-uuid': 'e2f305e1-7092-4e8a-bb47-a15c89388eb2'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:21 user nova-compute[74850]: INFO os_vif [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:89:24,bridge_name='br-int',has_traffic_filtering=True,id=494f4389-78fe-41c4-aa06-c1b2666915cb,network=Network(70b59622-f2a8-4dfc-9f03-828f4824be1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494f4389-78')
Nov 14 00:51:21 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] No VIF found with MAC fa:16:3e:f7:89:24, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG nova.network.neutron [req-cca01fe9-3b08-4c15-9e7d-0be68ab79ec9 req-afeb9752-6cfa-4d2b-9730-4454f9264a57 service nova] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Updated VIF entry in instance network info cache for port 494f4389-78fe-41c4-aa06-c1b2666915cb. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG nova.network.neutron [req-cca01fe9-3b08-4c15-9e7d-0be68ab79ec9 req-afeb9752-6cfa-4d2b-9730-4454f9264a57 service nova] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Updating instance_info_cache with network_info: [{"id": "494f4389-78fe-41c4-aa06-c1b2666915cb", "address": "fa:16:3e:f7:89:24", "network": {"id": "70b59622-f2a8-4dfc-9f03-828f4824be1e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1478695014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf004672a7b54f718937d1a0db6cec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494f4389-78", "ovs_interfaceid": "494f4389-78fe-41c4-aa06-c1b2666915cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-cca01fe9-3b08-4c15-9e7d-0be68ab79ec9 req-afeb9752-6cfa-4d2b-9730-4454f9264a57 service nova] Releasing lock "refresh_cache-e2f305e1-7092-4e8a-bb47-a15c89388eb2" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:51:21 user nova-compute[74850]: INFO nova.compute.manager [None req-2ebe169c-74a1-45cb-9170-5c12ac978355 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Unrescuing
Nov 14 00:51:21 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2ebe169c-74a1-45cb-9170-5c12ac978355 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "refresh_cache-a70d0196-f90e-47c4-be67-bf7ef4c3d8c4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2ebe169c-74a1-45cb-9170-5c12ac978355 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquired lock "refresh_cache-a70d0196-f90e-47c4-be67-bf7ef4c3d8c4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:51:21 user nova-compute[74850]: DEBUG nova.network.neutron [None req-2ebe169c-74a1-45cb-9170-5c12ac978355 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:51:22 user nova-compute[74850]: DEBUG nova.network.neutron [None req-2ebe169c-74a1-45cb-9170-5c12ac978355 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Updating instance_info_cache with network_info: [{"id": "f0de03a3-fd19-4cd1-a408-5168dcf267d7", "address": "fa:16:3e:44:d7:64", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0de03a3-fd", "ovs_interfaceid": "f0de03a3-fd19-4cd1-a408-5168dcf267d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:51:22 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2ebe169c-74a1-45cb-9170-5c12ac978355 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Releasing lock "refresh_cache-a70d0196-f90e-47c4-be67-bf7ef4c3d8c4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:51:22 user nova-compute[74850]: DEBUG nova.objects.instance [None req-2ebe169c-74a1-45cb-9170-5c12ac978355 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lazy-loading 'flavor' on Instance uuid a70d0196-f90e-47c4-be67-bf7ef4c3d8c4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:51:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:22 user nova-compute[74850]: DEBUG nova.compute.manager [req-e7a57ccc-de17-47b1-be85-ee5c159f7c2c req-36a71ae8-ccb9-44b3-b21d-9d9ed72130a8 service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Received event network-vif-unplugged-f0de03a3-fd19-4cd1-a408-5168dcf267d7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:51:22 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e7a57ccc-de17-47b1-be85-ee5c159f7c2c req-36a71ae8-ccb9-44b3-b21d-9d9ed72130a8 service nova] Acquiring lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:51:22 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e7a57ccc-de17-47b1-be85-ee5c159f7c2c req-36a71ae8-ccb9-44b3-b21d-9d9ed72130a8 service nova] Lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:51:22 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e7a57ccc-de17-47b1-be85-ee5c159f7c2c req-36a71ae8-ccb9-44b3-b21d-9d9ed72130a8 service nova] Lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:51:22 user nova-compute[74850]: DEBUG nova.compute.manager [req-e7a57ccc-de17-47b1-be85-ee5c159f7c2c req-36a71ae8-ccb9-44b3-b21d-9d9ed72130a8 service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] No waiting events found dispatching network-vif-unplugged-f0de03a3-fd19-4cd1-a408-5168dcf267d7 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:51:22 user nova-compute[74850]: WARNING nova.compute.manager [req-e7a57ccc-de17-47b1-be85-ee5c159f7c2c req-36a71ae8-ccb9-44b3-b21d-9d9ed72130a8 service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Received unexpected event network-vif-unplugged-f0de03a3-fd19-4cd1-a408-5168dcf267d7 for instance with vm_state rescued and task_state unrescuing.
Nov 14 00:51:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:23 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Instance destroyed successfully.
Nov 14 00:51:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:24 user nova-compute[74850]: DEBUG nova.compute.manager [req-c19c6e9e-1dd1-4358-96d8-2dd5dbf44fdd req-c79a7a84-3dfa-4a76-acda-aea9c9df812b service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Received event network-vif-plugged-f0de03a3-fd19-4cd1-a408-5168dcf267d7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:51:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c19c6e9e-1dd1-4358-96d8-2dd5dbf44fdd req-c79a7a84-3dfa-4a76-acda-aea9c9df812b service nova] Acquiring lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:51:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c19c6e9e-1dd1-4358-96d8-2dd5dbf44fdd req-c79a7a84-3dfa-4a76-acda-aea9c9df812b service nova] Lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:51:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c19c6e9e-1dd1-4358-96d8-2dd5dbf44fdd req-c79a7a84-3dfa-4a76-acda-aea9c9df812b service nova] Lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:51:24 user nova-compute[74850]: DEBUG nova.compute.manager [req-c19c6e9e-1dd1-4358-96d8-2dd5dbf44fdd req-c79a7a84-3dfa-4a76-acda-aea9c9df812b service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] No waiting events found dispatching network-vif-plugged-f0de03a3-fd19-4cd1-a408-5168dcf267d7 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:51:24 user nova-compute[74850]: WARNING nova.compute.manager [req-c19c6e9e-1dd1-4358-96d8-2dd5dbf44fdd req-c79a7a84-3dfa-4a76-acda-aea9c9df812b service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Received unexpected event network-vif-plugged-f0de03a3-fd19-4cd1-a408-5168dcf267d7 for instance with vm_state rescued and task_state unrescuing.
Nov 14 00:51:24 user nova-compute[74850]: DEBUG nova.compute.manager [req-c19c6e9e-1dd1-4358-96d8-2dd5dbf44fdd req-c79a7a84-3dfa-4a76-acda-aea9c9df812b service nova] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Received event network-vif-plugged-494f4389-78fe-41c4-aa06-c1b2666915cb {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:51:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c19c6e9e-1dd1-4358-96d8-2dd5dbf44fdd req-c79a7a84-3dfa-4a76-acda-aea9c9df812b service nova] Acquiring lock "e2f305e1-7092-4e8a-bb47-a15c89388eb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:51:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c19c6e9e-1dd1-4358-96d8-2dd5dbf44fdd req-c79a7a84-3dfa-4a76-acda-aea9c9df812b service nova] Lock "e2f305e1-7092-4e8a-bb47-a15c89388eb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:51:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c19c6e9e-1dd1-4358-96d8-2dd5dbf44fdd req-c79a7a84-3dfa-4a76-acda-aea9c9df812b service nova] Lock "e2f305e1-7092-4e8a-bb47-a15c89388eb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:51:24 user nova-compute[74850]: DEBUG nova.compute.manager [req-c19c6e9e-1dd1-4358-96d8-2dd5dbf44fdd req-c79a7a84-3dfa-4a76-acda-aea9c9df812b service nova] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] No waiting events found dispatching network-vif-plugged-494f4389-78fe-41c4-aa06-c1b2666915cb {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:51:24 user nova-compute[74850]: WARNING nova.compute.manager [req-c19c6e9e-1dd1-4358-96d8-2dd5dbf44fdd req-c79a7a84-3dfa-4a76-acda-aea9c9df812b service nova] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Received unexpected event network-vif-plugged-494f4389-78fe-41c4-aa06-c1b2666915cb for instance with vm_state building and task_state spawning.
Nov 14 00:51:24 user nova-compute[74850]: DEBUG nova.compute.manager [req-c19c6e9e-1dd1-4358-96d8-2dd5dbf44fdd req-c79a7a84-3dfa-4a76-acda-aea9c9df812b service nova] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Received event network-vif-plugged-494f4389-78fe-41c4-aa06-c1b2666915cb {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:51:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c19c6e9e-1dd1-4358-96d8-2dd5dbf44fdd req-c79a7a84-3dfa-4a76-acda-aea9c9df812b service nova] Acquiring lock "e2f305e1-7092-4e8a-bb47-a15c89388eb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:51:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c19c6e9e-1dd1-4358-96d8-2dd5dbf44fdd req-c79a7a84-3dfa-4a76-acda-aea9c9df812b service nova] Lock "e2f305e1-7092-4e8a-bb47-a15c89388eb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:51:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c19c6e9e-1dd1-4358-96d8-2dd5dbf44fdd req-c79a7a84-3dfa-4a76-acda-aea9c9df812b service nova] Lock "e2f305e1-7092-4e8a-bb47-a15c89388eb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:51:24 user nova-compute[74850]: DEBUG nova.compute.manager [req-c19c6e9e-1dd1-4358-96d8-2dd5dbf44fdd req-c79a7a84-3dfa-4a76-acda-aea9c9df812b service nova] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] No waiting events found dispatching network-vif-plugged-494f4389-78fe-41c4-aa06-c1b2666915cb {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:51:24 user nova-compute[74850]: WARNING nova.compute.manager [req-c19c6e9e-1dd1-4358-96d8-2dd5dbf44fdd req-c79a7a84-3dfa-4a76-acda-aea9c9df812b service nova] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Received unexpected event network-vif-plugged-494f4389-78fe-41c4-aa06-c1b2666915cb for instance with vm_state building and task_state spawning.
Nov 14 00:51:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:25 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:51:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 00:51:25 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Instance spawned successfully.
Nov 14 00:51:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 00:51:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:51:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:51:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:51:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:51:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:51:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:51:26 user nova-compute[74850]: INFO nova.compute.manager [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Took 6.97 seconds to spawn the instance on the hypervisor.
Nov 14 00:51:26 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:51:26 user nova-compute[74850]: INFO nova.compute.manager [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Took 7.68 seconds to build instance.
Nov 14 00:51:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6454cc2e-b318-4f8a-ae36-3b9f66919bb9 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Lock "e2f305e1-7092-4e8a-bb47-a15c89388eb2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.775s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:51:26 user nova-compute[74850]: DEBUG nova.compute.manager [req-2bf15514-4e73-4769-b796-6a19bf8bfd5a req-bd467048-dcce-49a4-b5fa-d6c1c3cc0304 service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Received event network-vif-plugged-f0de03a3-fd19-4cd1-a408-5168dcf267d7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:51:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-2bf15514-4e73-4769-b796-6a19bf8bfd5a req-bd467048-dcce-49a4-b5fa-d6c1c3cc0304 service nova] Acquiring lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:51:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-2bf15514-4e73-4769-b796-6a19bf8bfd5a req-bd467048-dcce-49a4-b5fa-d6c1c3cc0304 service nova] Lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:51:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-2bf15514-4e73-4769-b796-6a19bf8bfd5a req-bd467048-dcce-49a4-b5fa-d6c1c3cc0304 service nova] Lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:51:26 user nova-compute[74850]: DEBUG nova.compute.manager [req-2bf15514-4e73-4769-b796-6a19bf8bfd5a req-bd467048-dcce-49a4-b5fa-d6c1c3cc0304 service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] No waiting events found dispatching network-vif-plugged-f0de03a3-fd19-4cd1-a408-5168dcf267d7 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:51:26 user nova-compute[74850]: WARNING nova.compute.manager [req-2bf15514-4e73-4769-b796-6a19bf8bfd5a req-bd467048-dcce-49a4-b5fa-d6c1c3cc0304 service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Received unexpected event network-vif-plugged-f0de03a3-fd19-4cd1-a408-5168dcf267d7 for instance with vm_state rescued and task_state unrescuing.
Nov 14 00:51:26 user nova-compute[74850]: DEBUG nova.compute.manager [req-2bf15514-4e73-4769-b796-6a19bf8bfd5a req-bd467048-dcce-49a4-b5fa-d6c1c3cc0304 service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Received event network-vif-plugged-f0de03a3-fd19-4cd1-a408-5168dcf267d7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:51:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-2bf15514-4e73-4769-b796-6a19bf8bfd5a req-bd467048-dcce-49a4-b5fa-d6c1c3cc0304 service nova] Acquiring lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:51:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-2bf15514-4e73-4769-b796-6a19bf8bfd5a req-bd467048-dcce-49a4-b5fa-d6c1c3cc0304 service nova] Lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:51:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-2bf15514-4e73-4769-b796-6a19bf8bfd5a req-bd467048-dcce-49a4-b5fa-d6c1c3cc0304 service nova] Lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:51:26 user nova-compute[74850]: DEBUG nova.compute.manager [req-2bf15514-4e73-4769-b796-6a19bf8bfd5a req-bd467048-dcce-49a4-b5fa-d6c1c3cc0304 service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] No waiting events found dispatching network-vif-plugged-f0de03a3-fd19-4cd1-a408-5168dcf267d7 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:51:26 user nova-compute[74850]: WARNING nova.compute.manager [req-2bf15514-4e73-4769-b796-6a19bf8bfd5a req-bd467048-dcce-49a4-b5fa-d6c1c3cc0304 service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Received unexpected event network-vif-plugged-f0de03a3-fd19-4cd1-a408-5168dcf267d7 for instance with vm_state rescued and task_state unrescuing.
Nov 14 00:51:26 user nova-compute[74850]: DEBUG nova.compute.manager [None req-2ebe169c-74a1-45cb-9170-5c12ac978355 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:51:29 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-dc49ff6e-80cd-41cd-983b-827630cc44c9 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7f115ae8-49da-4bf5-ae7c-62696769420c is timed out.
Nov 14 00:51:29 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-dc49ff6e-80cd-41cd-983b-827630cc44c9 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Successfully detached device vdb from instance 7f115ae8-49da-4bf5-ae7c-62696769420c from the live domain config.
Nov 14 00:51:29 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc49ff6e-80cd-41cd-983b-827630cc44c9 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc49ff6e-80cd-41cd-983b-827630cc44c9 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJZdmosI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:51:29 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-dc49ff6e-80cd-41cd-983b-827630cc44c9 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:51:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-dc49ff6e-80cd-41cd-983b-827630cc44c9 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-dc49ff6e-80cd-41cd-983b-827630cc44c9 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b188bc55-d8f0-4d41-bd7e-75df79321447]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc49ff6e-80cd-41cd-983b-827630cc44c9 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 00:51:29 user nova-compute[74850]: No targets found.
Nov 14 00:51:29 user nova-compute[74850]: iSNS:
Nov 14 00:51:29 user nova-compute[74850]: No targets found.
Nov 14 00:51:29 user nova-compute[74850]: STATIC:
Nov 14 00:51:29 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390
Nov 14 00:51:29 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:51:29 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:51:29 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390
Nov 14 00:51:29 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:51:29 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:51:29 user nova-compute[74850]: FIRMWARE:
Nov 14 00:51:29 user nova-compute[74850]: No targets found.
Nov 14 00:51:29 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc49ff6e-80cd-41cd-983b-827630cc44c9 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 00:51:29 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 00:51:29 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc49ff6e-80cd-41cd-983b-827630cc44c9 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3326ee4d-0053-41fb-a3fa-89272c9af60a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9c99c8-a408-4a08-968e-c0c47c4ccaad]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc49ff6e-80cd-41cd-983b-827630cc44c9 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:51:29 user nova-compute[74850]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390 (non-flash)
Nov 14 00:51:29 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc49ff6e-80cd-41cd-983b-827630cc44c9 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:51:29 user nova-compute[74850]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390 (non-flash)
Nov 14 00:51:29 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc49ff6e-80cd-41cd-983b-827630cc44c9 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a3c38b0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390'): ({'sdb'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-dc49ff6e-80cd-41cd-983b-827630cc44c9 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Removing single pathed devices sdb {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa64b3ad-8baa-413e-bd55-a1196450707d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1120018-b669-49f5-9b03-b8b415060ad7]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-dc49ff6e-80cd-41cd-983b-827630cc44c9 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Flushing IO for device /dev/sdb {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[74281ec5-0ccb-4521-97cf-db7a6b36b2a3]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-dc49ff6e-80cd-41cd-983b-827630cc44c9 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9030f8f7-5a5c-465d-a33c-6bab2058c6c7]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-dc49ff6e-80cd-41cd-983b-827630cc44c9 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-dc49ff6e-80cd-41cd-983b-827630cc44c9 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc49ff6e-80cd-41cd-983b-827630cc44c9 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd65409d-739d-4842-9aea-d03ddc8df4eb]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc49ff6e-80cd-41cd-983b-827630cc44c9 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390 -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc623eb5-7a0d-431d-a8ff-47499646e9ad]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc49ff6e-80cd-41cd-983b-827630cc44c9 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390, portal: 172.16.0.220,3260]
Nov 14 00:51:29 user nova-compute[74850]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390, portal: 172.16.0.220,3260] successful.
Nov 14 00:51:29 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390 -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac2e17c0-05fb-4acc-91b8-1abf4f115390 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bf69aa-1699-4202-a055-a673e5ff8090]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc49ff6e-80cd-41cd-983b-827630cc44c9 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-dc49ff6e-80cd-41cd-983b-827630cc44c9 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc49ff6e-80cd-41cd-983b-827630cc44c9 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] <== disconnect_volume: return (315ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:51:29 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc49ff6e-80cd-41cd-983b-827630cc44c9 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 00:51:30 user nova-compute[74850]: DEBUG nova.objects.instance [None req-dc49ff6e-80cd-41cd-983b-827630cc44c9 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lazy-loading 'flavor' on Instance uuid 7f115ae8-49da-4bf5-ae7c-62696769420c {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:51:30 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dc49ff6e-80cd-41cd-983b-827630cc44c9 tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lock "7f115ae8-49da-4bf5-ae7c-62696769420c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.769s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:51:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-76d05301-5d78-472e-a752-c18395eaa46d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Acquiring lock "interface-7f115ae8-49da-4bf5-ae7c-62696769420c-8911f309-779d-4df0-a8bd-ead798ceb829" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:51:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-76d05301-5d78-472e-a752-c18395eaa46d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lock "interface-7f115ae8-49da-4bf5-ae7c-62696769420c-8911f309-779d-4df0-a8bd-ead798ceb829" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:51:31 user nova-compute[74850]: DEBUG nova.objects.instance [None req-76d05301-5d78-472e-a752-c18395eaa46d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lazy-loading 'flavor' on Instance uuid 7f115ae8-49da-4bf5-ae7c-62696769420c {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:51:31 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-76d05301-5d78-472e-a752-c18395eaa46d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-622477935',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-622477935',id=17,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBGvhns7XWVf/haNp2AKmH5EhvuBpoE+TGi/Wza7qjLEHR4vfwIGfr3qwoxrfGTiid4eBr+1xVTKisgYQUIZxBKIACazg/Q7FT120267dvZKdM6cwjXC2T4hWuncWpIGw==',key_name='tempest-keypair-783468073',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:49:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b29bf565027342a8ac084f1fd0a9b3f5',ramdisk_id='',reservation_id='r-n5valy8w',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1948159451',owner_user_name='tempest-TaggedAttachmentsTest-1948159451-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:49:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cebab0c5f0c74784a0d09a696a9b62d8',uuid=7f115ae8-49da-4bf5-ae7c-62696769420c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8911f309-779d-4df0-a8bd-ead798ceb829", "address": "fa:16:3e:a4:51:b4", "network": {"id": "0f67cb75-70fd-41b7-b210-2a7c909da154", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1304810839", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b29bf565027342a8ac084f1fd0a9b3f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8911f309-77", "ovs_interfaceid": "8911f309-779d-4df0-a8bd-ead798ceb829", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:51:31 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-76d05301-5d78-472e-a752-c18395eaa46d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Converting VIF {"id": "8911f309-779d-4df0-a8bd-ead798ceb829", "address": "fa:16:3e:a4:51:b4", "network": {"id": "0f67cb75-70fd-41b7-b210-2a7c909da154", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1304810839", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b29bf565027342a8ac084f1fd0a9b3f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8911f309-77", "ovs_interfaceid": "8911f309-779d-4df0-a8bd-ead798ceb829", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:51:31 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-76d05301-5d78-472e-a752-c18395eaa46d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:51:b4,bridge_name='br-int',has_traffic_filtering=True,id=8911f309-779d-4df0-a8bd-ead798ceb829,network=Network(0f67cb75-70fd-41b7-b210-2a7c909da154),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8911f309-77') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:51:31 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-76d05301-5d78-472e-a752-c18395eaa46d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:a4:51:b4"/><model type="virtio"/><mtu size="1442"/><target dev="tap8911f309-77"/></interface> {{(pid=74850) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 00:51:31 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-76d05301-5d78-472e-a752-c18395eaa46d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:a4:51:b4"/><model type="virtio"/><mtu size="1442"/><target dev="tap8911f309-77"/></interface> {{(pid=74850) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 00:51:31 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-76d05301-5d78-472e-a752-c18395eaa46d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Attempting to detach device tap8911f309-77 from instance 7f115ae8-49da-4bf5-ae7c-62696769420c from the persistent domain config. {{(pid=74850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 00:51:31 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-76d05301-5d78-472e-a752-c18395eaa46d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] detach device xml: <interface type="ethernet">
Nov 14 00:51:31 user nova-compute[74850]:   <mac address="fa:16:3e:a4:51:b4"/>
Nov 14 00:51:31 user nova-compute[74850]:   <model type="virtio"/>
Nov 14 00:51:31 user nova-compute[74850]:   <mtu size="1442"/>
Nov 14 00:51:31 user nova-compute[74850]:   <target dev="tap8911f309-77"/>
Nov 14 00:51:31 user nova-compute[74850]: </interface>
Nov 14 00:51:31 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 00:51:31 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-76d05301-5d78-472e-a752-c18395eaa46d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:a4:51:b4"/><model type="virtio"/><mtu size="1442"/><target dev="tap8911f309-77"/></interface> {{(pid=74850) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 00:51:31 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-76d05301-5d78-472e-a752-c18395eaa46d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:a4:51:b4"/><model type="virtio"/><mtu size="1442"/><target dev="tap8911f309-77"/></interface>not found in domain: <domain type='kvm' id='19'>
Nov 14 00:51:31 user nova-compute[74850]:   <name>instance-00000011</name>
Nov 14 00:51:31 user nova-compute[74850]:   <uuid>7f115ae8-49da-4bf5-ae7c-62696769420c</uuid>
Nov 14 00:51:31 user nova-compute[74850]:   <metadata>
Nov 14 00:51:31 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:51:31 user nova-compute[74850]:   <nova:package version="0.0.0"/>
Nov 14 00:51:31 user nova-compute[74850]:   <nova:name>tempest-device-tagging-server-622477935</nova:name>
Nov 14 00:51:31 user nova-compute[74850]:   <nova:creationTime>2023-11-14 00:50:56</nova:creationTime>
Nov 14 00:51:31 user nova-compute[74850]:   <nova:flavor name="m1.tiny">
Nov 14 00:51:31 user nova-compute[74850]:     <nova:memory>512</nova:memory>
Nov 14 00:51:31 user nova-compute[74850]:     <nova:disk>1</nova:disk>
Nov 14 00:51:31 user nova-compute[74850]:     <nova:swap>0</nova:swap>
Nov 14 00:51:31 user nova-compute[74850]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:51:31 user nova-compute[74850]:     <nova:vcpus>1</nova:vcpus>
Nov 14 00:51:31 user nova-compute[74850]:   </nova:flavor>
Nov 14 00:51:31 user nova-compute[74850]:   <nova:owner>
Nov 14 00:51:31 user nova-compute[74850]:     <nova:user uuid="cebab0c5f0c74784a0d09a696a9b62d8">tempest-TaggedAttachmentsTest-1948159451-project-member</nova:user>
Nov 14 00:51:31 user nova-compute[74850]:     <nova:project uuid="b29bf565027342a8ac084f1fd0a9b3f5">tempest-TaggedAttachmentsTest-1948159451</nova:project>
Nov 14 00:51:31 user nova-compute[74850]:   </nova:owner>
Nov 14 00:51:31 user nova-compute[74850]:   <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:51:31 user nova-compute[74850]:   <nova:ports>
Nov 14 00:51:31 user nova-compute[74850]:     <nova:port uuid="667273cd-1700-465f-895e-6a1a093f44d8">
Nov 14 00:51:31 user nova-compute[74850]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 00:51:31 user nova-compute[74850]:     </nova:port>
Nov 14 00:51:31 user nova-compute[74850]:     <nova:port uuid="8911f309-779d-4df0-a8bd-ead798ceb829">
Nov 14 00:51:31 user nova-compute[74850]:       <nova:ip type="fixed" address="10.10.10.165" ipVersion="4"/>
Nov 14 00:51:31 user nova-compute[74850]:     </nova:port>
Nov 14 00:51:31 user nova-compute[74850]:   </nova:ports>
Nov 14 00:51:31 user nova-compute[74850]: </nova:instance>
Nov 14 00:51:31 user nova-compute[74850]:   </metadata>
Nov 14 00:51:31 user nova-compute[74850]:   <memory unit='KiB'>524288</memory>
Nov 14 00:51:31 user nova-compute[74850]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 00:51:31 user nova-compute[74850]:   <vcpu placement='static'>1</vcpu>
Nov 14 00:51:31 user nova-compute[74850]:   <resource>
Nov 14 00:51:31 user nova-compute[74850]:     <partition>/machine</partition>
Nov 14 00:51:31 user nova-compute[74850]:   </resource>
Nov 14 00:51:31 user nova-compute[74850]:   <sysinfo type='smbios'>
Nov 14 00:51:31 user nova-compute[74850]:     <system>
Nov 14 00:51:31 user nova-compute[74850]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 00:51:31 user nova-compute[74850]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 00:51:31 user nova-compute[74850]:       <entry name='version'>0.0.0</entry>
Nov 14 00:51:31 user nova-compute[74850]:       <entry name='serial'>7f115ae8-49da-4bf5-ae7c-62696769420c</entry>
Nov 14 00:51:31 user nova-compute[74850]:       <entry name='uuid'>7f115ae8-49da-4bf5-ae7c-62696769420c</entry>
Nov 14 00:51:31 user nova-compute[74850]:       <entry name='family'>Virtual Machine</entry>
Nov 14 00:51:31 user nova-compute[74850]:     </system>
Nov 14 00:51:31 user nova-compute[74850]:   </sysinfo>
Nov 14 00:51:31 user nova-compute[74850]:   <os>
Nov 14 00:51:31 user nova-compute[74850]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 00:51:31 user nova-compute[74850]:     <boot dev='hd'/>
Nov 14 00:51:31 user nova-compute[74850]:     <smbios mode='sysinfo'/>
Nov 14 00:51:31 user nova-compute[74850]:   </os>
Nov 14 00:51:31 user nova-compute[74850]:   <features>
Nov 14 00:51:31 user nova-compute[74850]:     <acpi/>
Nov 14 00:51:31 user nova-compute[74850]:     <apic/>
Nov 14 00:51:31 user nova-compute[74850]:     <vmcoreinfo state='on'/>
Nov 14 00:51:31 user nova-compute[74850]:   </features>
Nov 14 00:51:31 user nova-compute[74850]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 00:51:31 user nova-compute[74850]:     <model fallback='forbid'>Nehalem</model>
Nov 14 00:51:31 user nova-compute[74850]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 00:51:31 user nova-compute[74850]:     <feature policy='require' name='vme'/>
Nov 14 00:51:31 user nova-compute[74850]:     <feature policy='require' name='x2apic'/>
Nov 14 00:51:31 user nova-compute[74850]:     <feature policy='require' name='hypervisor'/>
Nov 14 00:51:31 user nova-compute[74850]:   </cpu>
Nov 14 00:51:31 user nova-compute[74850]:   <clock offset='utc'>
Nov 14 00:51:31 user nova-compute[74850]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 00:51:31 user nova-compute[74850]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 00:51:31 user nova-compute[74850]:     <timer name='hpet' present='no'/>
Nov 14 00:51:31 user nova-compute[74850]:   </clock>
Nov 14 00:51:31 user nova-compute[74850]:   <on_poweroff>destroy</on_poweroff>
Nov 14 00:51:31 user nova-compute[74850]:   <on_reboot>restart</on_reboot>
Nov 14 00:51:31 user nova-compute[74850]:   <on_crash>destroy</on_crash>
Nov 14 00:51:31 user nova-compute[74850]:   <devices>
Nov 14 00:51:31 user nova-compute[74850]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 00:51:31 user nova-compute[74850]:     <disk type='file' device='disk'>
Nov 14 00:51:31 user nova-compute[74850]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 00:51:31 user nova-compute[74850]:       <source file='/opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/disk' index='2'/>
Nov 14 00:51:31 user nova-compute[74850]:       <backingStore type='file' index='3'>
Nov 14 00:51:31 user nova-compute[74850]:         <format type='raw'/>
Nov 14 00:51:31 user nova-compute[74850]:         <source file='/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549'/>
Nov 14 00:51:31 user nova-compute[74850]:         <backingStore/>
Nov 14 00:51:31 user nova-compute[74850]:       </backingStore>
Nov 14 00:51:31 user nova-compute[74850]:       <target dev='vda' bus='virtio'/>
Nov 14 00:51:31 user nova-compute[74850]:       <alias name='virtio-disk0'/>
Nov 14 00:51:31 user nova-compute[74850]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 00:51:31 user nova-compute[74850]:     </disk>
Nov 14 00:51:31 user nova-compute[74850]:     <disk type='file' device='cdrom'>
Nov 14 00:51:31 user nova-compute[74850]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 00:51:31 user nova-compute[74850]:       <source file='/opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/disk.config' index='1'/>
Nov 14 00:51:31 user nova-compute[74850]:       <backingStore/>
Nov 14 00:51:31 user nova-compute[74850]:       <target dev='hda' bus='ide'/>
Nov 14 00:51:31 user nova-compute[74850]:       <readonly/>
Nov 14 00:51:31 user nova-compute[74850]:       <alias name='ide0-0-0'/>
Nov 14 00:51:31 user nova-compute[74850]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 00:51:31 user nova-compute[74850]:     </disk>
Nov 14 00:51:31 user nova-compute[74850]:     <controller type='usb' index='0' model='none'>
Nov 14 00:51:31 user nova-compute[74850]:       <alias name='usb'/>
Nov 14 00:51:31 user nova-compute[74850]:     </controller>
Nov 14 00:51:31 user nova-compute[74850]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 00:51:31 user nova-compute[74850]:       <alias name='pci.0'/>
Nov 14 00:51:31 user nova-compute[74850]:     </controller>
Nov 14 00:51:31 user nova-compute[74850]:     <controller type='ide' index='0'>
Nov 14 00:51:31 user nova-compute[74850]:       <alias name='ide'/>
Nov 14 00:51:31 user nova-compute[74850]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 00:51:31 user nova-compute[74850]:     </controller>
Nov 14 00:51:31 user nova-compute[74850]:     <interface type='ethernet'>
Nov 14 00:51:31 user nova-compute[74850]:       <mac address='fa:16:3e:d1:ab:73'/>
Nov 14 00:51:31 user nova-compute[74850]:       <target dev='tap667273cd-17'/>
Nov 14 00:51:31 user nova-compute[74850]:       <model type='virtio'/>
Nov 14 00:51:31 user nova-compute[74850]:       <mtu size='1442'/>
Nov 14 00:51:31 user nova-compute[74850]:       <alias name='net0'/>
Nov 14 00:51:31 user nova-compute[74850]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 00:51:31 user nova-compute[74850]:     </interface>
Nov 14 00:51:31 user nova-compute[74850]:     <interface type='ethernet'>
Nov 14 00:51:31 user nova-compute[74850]:       <mac address='fa:16:3e:a4:51:b4'/>
Nov 14 00:51:31 user nova-compute[74850]:       <target dev='tap8911f309-77'/>
Nov 14 00:51:31 user nova-compute[74850]:       <model type='virtio'/>
Nov 14 00:51:31 user nova-compute[74850]:       <mtu size='1442'/>
Nov 14 00:51:31 user nova-compute[74850]:       <alias name='net1'/>
Nov 14 00:51:31 user nova-compute[74850]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 14 00:51:31 user nova-compute[74850]:     </interface>
Nov 14 00:51:31 user nova-compute[74850]:     <serial type='pty'>
Nov 14 00:51:31 user nova-compute[74850]:       <source path='/dev/pts/0'/>
Nov 14 00:51:31 user nova-compute[74850]:       <log file='/opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/console.log' append='off'/>
Nov 14 00:51:31 user nova-compute[74850]:       <target type='isa-serial' port='0'>
Nov 14 00:51:31 user nova-compute[74850]:         <model name='isa-serial'/>
Nov 14 00:51:31 user nova-compute[74850]:       </target>
Nov 14 00:51:31 user nova-compute[74850]:       <alias name='serial0'/>
Nov 14 00:51:31 user nova-compute[74850]:     </serial>
Nov 14 00:51:31 user nova-compute[74850]:     <console type='pty' tty='/dev/pts/0'>
Nov 14 00:51:31 user nova-compute[74850]:       <source path='/dev/pts/0'/>
Nov 14 00:51:31 user nova-compute[74850]:       <log file='/opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/console.log' append='off'/>
Nov 14 00:51:31 user nova-compute[74850]:       <target type='serial' port='0'/>
Nov 14 00:51:31 user nova-compute[74850]:       <alias name='serial0'/>
Nov 14 00:51:31 user nova-compute[74850]:     </console>
Nov 14 00:51:31 user nova-compute[74850]:     <input type='mouse' bus='ps2'>
Nov 14 00:51:31 user nova-compute[74850]:       <alias name='input0'/>
Nov 14 00:51:31 user nova-compute[74850]:     </input>
Nov 14 00:51:31 user nova-compute[74850]:     <input type='keyboard' bus='ps2'>
Nov 14 00:51:31 user nova-compute[74850]:       <alias name='input1'/>
Nov 14 00:51:31 user nova-compute[74850]:     </input>
Nov 14 00:51:31 user nova-compute[74850]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 14 00:51:31 user nova-compute[74850]:       <listen type='address' address='0.0.0.0'/>
Nov 14 00:51:31 user nova-compute[74850]:     </graphics>
Nov 14 00:51:31 user nova-compute[74850]:     <audio id='1' type='none'/>
Nov 14 00:51:31 user nova-compute[74850]:     <video>
Nov 14 00:51:31 user nova-compute[74850]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 00:51:31 user nova-compute[74850]:       <alias name='video0'/>
Nov 14 00:51:31 user nova-compute[74850]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 00:51:31 user nova-compute[74850]:     </video>
Nov 14 00:51:31 user nova-compute[74850]:     <memballoon model='virtio'>
Nov 14 00:51:31 user nova-compute[74850]:       <stats period='10'/>
Nov 14 00:51:31 user nova-compute[74850]:       <alias name='balloon0'/>
Nov 14 00:51:31 user nova-compute[74850]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 00:51:31 user nova-compute[74850]:     </memballoon>
Nov 14 00:51:31 user nova-compute[74850]:     <rng model='virtio'>
Nov 14 00:51:31 user nova-compute[74850]:       <backend model='random'>/dev/urandom</backend>
Nov 14 00:51:31 user nova-compute[74850]:       <alias name='rng0'/>
Nov 14 00:51:31 user nova-compute[74850]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 00:51:31 user nova-compute[74850]:     </rng>
Nov 14 00:51:31 user nova-compute[74850]:   </devices>
Nov 14 00:51:31 user nova-compute[74850]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 00:51:31 user nova-compute[74850]:     <label>libvirt-7f115ae8-49da-4bf5-ae7c-62696769420c</label>
Nov 14 00:51:31 user nova-compute[74850]:     <imagelabel>libvirt-7f115ae8-49da-4bf5-ae7c-62696769420c</imagelabel>
Nov 14 00:51:31 user nova-compute[74850]:   </seclabel>
Nov 14 00:51:31 user nova-compute[74850]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 00:51:31 user nova-compute[74850]:     <label>+64055:+108</label>
Nov 14 00:51:31 user nova-compute[74850]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 00:51:31 user nova-compute[74850]:   </seclabel>
Nov 14 00:51:31 user nova-compute[74850]: </domain>
Nov 14 00:51:31 user nova-compute[74850]:  {{(pid=74850) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 00:51:31 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-76d05301-5d78-472e-a752-c18395eaa46d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Successfully detached device tap8911f309-77 from instance 7f115ae8-49da-4bf5-ae7c-62696769420c from the persistent domain config.
Nov 14 00:51:31 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-76d05301-5d78-472e-a752-c18395eaa46d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] (1/8): Attempting to detach device tap8911f309-77 with device alias net1 from instance 7f115ae8-49da-4bf5-ae7c-62696769420c from the live domain config. {{(pid=74850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 00:51:31 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-76d05301-5d78-472e-a752-c18395eaa46d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] detach device xml: <interface type="ethernet">
Nov 14 00:51:31 user nova-compute[74850]:   <mac address="fa:16:3e:a4:51:b4"/>
Nov 14 00:51:31 user nova-compute[74850]:   <model type="virtio"/>
Nov 14 00:51:31 user nova-compute[74850]:   <mtu size="1442"/>
Nov 14 00:51:31 user nova-compute[74850]:   <target dev="tap8911f309-77"/>
Nov 14 00:51:31 user nova-compute[74850]: </interface>
Nov 14 00:51:31 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 00:51:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-76d05301-5d78-472e-a752-c18395eaa46d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Start waiting for the detach event from libvirt for device tap8911f309-77 with device alias net1 for instance 7f115ae8-49da-4bf5-ae7c-62696769420c {{(pid=74850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 00:51:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:38 user nova-compute[74850]: DEBUG nova.compute.manager [req-93c5ec37-db44-4e3d-8e59-0831096515e5 req-523920d4-71de-47c4-8192-d609f440e702 service nova] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Received event network-changed-11d8d21f-e53e-4277-a1d1-36e99c3bcd62 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:51:38 user nova-compute[74850]: DEBUG nova.compute.manager [req-93c5ec37-db44-4e3d-8e59-0831096515e5 req-523920d4-71de-47c4-8192-d609f440e702 service nova] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Refreshing instance network info cache due to event network-changed-11d8d21f-e53e-4277-a1d1-36e99c3bcd62. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:51:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-93c5ec37-db44-4e3d-8e59-0831096515e5 req-523920d4-71de-47c4-8192-d609f440e702 service nova] Acquiring lock "refresh_cache-748d0da7-bbb9-4e86-aae3-e48b1fa04c14" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:51:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-93c5ec37-db44-4e3d-8e59-0831096515e5 req-523920d4-71de-47c4-8192-d609f440e702 service nova] Acquired lock "refresh_cache-748d0da7-bbb9-4e86-aae3-e48b1fa04c14" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:51:38 user nova-compute[74850]: DEBUG nova.network.neutron [req-93c5ec37-db44-4e3d-8e59-0831096515e5 req-523920d4-71de-47c4-8192-d609f440e702 service nova] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Refreshing network info cache for port 11d8d21f-e53e-4277-a1d1-36e99c3bcd62 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:51:39 user nova-compute[74850]: DEBUG nova.compute.manager [req-50ced9ec-305b-4f74-9404-0b73858bf1e9 req-47a68b5b-f890-4ece-b176-c5b04ea668fb service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Received event network-vif-unplugged-8911f309-779d-4df0-a8bd-ead798ceb829 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:51:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-50ced9ec-305b-4f74-9404-0b73858bf1e9 req-47a68b5b-f890-4ece-b176-c5b04ea668fb service nova] Acquiring lock "7f115ae8-49da-4bf5-ae7c-62696769420c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:51:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-50ced9ec-305b-4f74-9404-0b73858bf1e9 req-47a68b5b-f890-4ece-b176-c5b04ea668fb service nova] Lock "7f115ae8-49da-4bf5-ae7c-62696769420c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:51:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-50ced9ec-305b-4f74-9404-0b73858bf1e9 req-47a68b5b-f890-4ece-b176-c5b04ea668fb service nova] Lock "7f115ae8-49da-4bf5-ae7c-62696769420c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:51:39 user nova-compute[74850]: DEBUG nova.compute.manager [req-50ced9ec-305b-4f74-9404-0b73858bf1e9 req-47a68b5b-f890-4ece-b176-c5b04ea668fb service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] No waiting events found dispatching network-vif-unplugged-8911f309-779d-4df0-a8bd-ead798ceb829 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:51:39 user nova-compute[74850]: WARNING nova.compute.manager [req-50ced9ec-305b-4f74-9404-0b73858bf1e9 req-47a68b5b-f890-4ece-b176-c5b04ea668fb service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Received unexpected event network-vif-unplugged-8911f309-779d-4df0-a8bd-ead798ceb829 for instance with vm_state active and task_state None.
Nov 14 00:51:39 user nova-compute[74850]: DEBUG nova.network.neutron [req-93c5ec37-db44-4e3d-8e59-0831096515e5 req-523920d4-71de-47c4-8192-d609f440e702 service nova] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Updated VIF entry in instance network info cache for port 11d8d21f-e53e-4277-a1d1-36e99c3bcd62. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:51:39 user nova-compute[74850]: DEBUG nova.network.neutron [req-93c5ec37-db44-4e3d-8e59-0831096515e5 req-523920d4-71de-47c4-8192-d609f440e702 service nova] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Updating instance_info_cache with network_info: [{"id": "11d8d21f-e53e-4277-a1d1-36e99c3bcd62", "address": "fa:16:3e:f2:d6:a0", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d8d21f-e5", "ovs_interfaceid": "11d8d21f-e53e-4277-a1d1-36e99c3bcd62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:51:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-93c5ec37-db44-4e3d-8e59-0831096515e5 req-523920d4-71de-47c4-8192-d609f440e702 service nova] Releasing lock "refresh_cache-748d0da7-bbb9-4e86-aae3-e48b1fa04c14" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:51:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:41 user nova-compute[74850]: DEBUG nova.compute.manager [req-edd97159-bb7a-4cbd-bd40-2e983836aaba req-12e356fa-daed-42a9-9655-f30fd2b1eaec service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Received event network-vif-plugged-8911f309-779d-4df0-a8bd-ead798ceb829 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:51:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-edd97159-bb7a-4cbd-bd40-2e983836aaba req-12e356fa-daed-42a9-9655-f30fd2b1eaec service nova] Acquiring lock "7f115ae8-49da-4bf5-ae7c-62696769420c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:51:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-edd97159-bb7a-4cbd-bd40-2e983836aaba req-12e356fa-daed-42a9-9655-f30fd2b1eaec service nova] Lock "7f115ae8-49da-4bf5-ae7c-62696769420c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:51:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-edd97159-bb7a-4cbd-bd40-2e983836aaba req-12e356fa-daed-42a9-9655-f30fd2b1eaec service nova] Lock "7f115ae8-49da-4bf5-ae7c-62696769420c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:51:41 user nova-compute[74850]: DEBUG nova.compute.manager [req-edd97159-bb7a-4cbd-bd40-2e983836aaba req-12e356fa-daed-42a9-9655-f30fd2b1eaec service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] No waiting events found dispatching network-vif-plugged-8911f309-779d-4df0-a8bd-ead798ceb829 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:51:41 user nova-compute[74850]: WARNING nova.compute.manager [req-edd97159-bb7a-4cbd-bd40-2e983836aaba req-12e356fa-daed-42a9-9655-f30fd2b1eaec service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Received unexpected event network-vif-plugged-8911f309-779d-4df0-a8bd-ead798ceb829 for instance with vm_state active and task_state None.
Nov 14 00:51:44 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:51:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Acquiring lock "4474ad0e-8eee-4db4-9896-50c049d45d26" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:51:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "4474ad0e-8eee-4db4-9896-50c049d45d26" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:51:44 user nova-compute[74850]: DEBUG nova.compute.manager [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 00:51:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:51:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:51:44 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 00:51:44 user nova-compute[74850]: INFO nova.compute.claims [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Claim successful on node user
Nov 14 00:51:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:45 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:51:45 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:51:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.403s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:51:45 user nova-compute[74850]: DEBUG nova.compute.manager [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 00:51:45 user nova-compute[74850]: DEBUG nova.compute.manager [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 00:51:45 user nova-compute[74850]: DEBUG nova.network.neutron [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 00:51:45 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 00:51:45 user nova-compute[74850]: DEBUG nova.compute.manager [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 00:51:45 user nova-compute[74850]: DEBUG nova.policy [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '208acda449ad436c85bdbebff0560e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e17bbd82f843fdaa3c48d8cb64a2c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 00:51:45 user nova-compute[74850]: DEBUG nova.compute.manager [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 00:51:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 00:51:45 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Creating image(s)
Nov 14 00:51:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Acquiring lock "/opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:51:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "/opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:51:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "/opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:51:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.181s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:51:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:51:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.171s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk 1073741824" returned: 0 in 0.049s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:51:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:45 user nova-compute[74850]: DEBUG nova.network.neutron [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Successfully created port: d5b53759-f1dd-4a6c-83c0-d4fe816d1131 {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:51:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.171s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:45 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 00:51:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:45 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Cannot resize image /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Ensure instance console log exists: /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG nova.network.neutron [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Successfully updated port: d5b53759-f1dd-4a6c-83c0-d4fe816d1131 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Acquiring lock "refresh_cache-4474ad0e-8eee-4db4-9896-50c049d45d26" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Acquired lock "refresh_cache-4474ad0e-8eee-4db4-9896-50c049d45d26" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG nova.network.neutron [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG nova.compute.manager [req-384604ea-9517-4846-b0f6-ae9d5259d839 req-581f2470-0f32-4a36-b92d-64c9632194be service nova] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Received event network-changed-d5b53759-f1dd-4a6c-83c0-d4fe816d1131 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG nova.compute.manager [req-384604ea-9517-4846-b0f6-ae9d5259d839 req-581f2470-0f32-4a36-b92d-64c9632194be service nova] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Refreshing instance network info cache due to event network-changed-d5b53759-f1dd-4a6c-83c0-d4fe816d1131. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-384604ea-9517-4846-b0f6-ae9d5259d839 req-581f2470-0f32-4a36-b92d-64c9632194be service nova] Acquiring lock "refresh_cache-4474ad0e-8eee-4db4-9896-50c049d45d26" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG nova.network.neutron [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG nova.network.neutron [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Updating instance_info_cache with network_info: [{"id": "d5b53759-f1dd-4a6c-83c0-d4fe816d1131", "address": "fa:16:3e:50:2f:7c", "network": {"id": "b096d728-1246-4eaa-9222-ed8eee74870c", "bridge": "br-int", "label": "tempest-TestStampPattern-1207618832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e17bbd82f843fdaa3c48d8cb64a2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b53759-f1", "ovs_interfaceid": "d5b53759-f1dd-4a6c-83c0-d4fe816d1131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Releasing lock "refresh_cache-4474ad0e-8eee-4db4-9896-50c049d45d26" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG nova.compute.manager [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Instance network_info: |[{"id": "d5b53759-f1dd-4a6c-83c0-d4fe816d1131", "address": "fa:16:3e:50:2f:7c", "network": {"id": "b096d728-1246-4eaa-9222-ed8eee74870c", "bridge": "br-int", "label": "tempest-TestStampPattern-1207618832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e17bbd82f843fdaa3c48d8cb64a2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b53759-f1", "ovs_interfaceid": "d5b53759-f1dd-4a6c-83c0-d4fe816d1131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-384604ea-9517-4846-b0f6-ae9d5259d839 req-581f2470-0f32-4a36-b92d-64c9632194be service nova] Acquired lock "refresh_cache-4474ad0e-8eee-4db4-9896-50c049d45d26" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG nova.network.neutron [req-384604ea-9517-4846-b0f6-ae9d5259d839 req-581f2470-0f32-4a36-b92d-64c9632194be service nova] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Refreshing network info cache for port d5b53759-f1dd-4a6c-83c0-d4fe816d1131 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Start _get_guest_xml network_info=[{"id": "d5b53759-f1dd-4a6c-83c0-d4fe816d1131", "address": "fa:16:3e:50:2f:7c", "network": {"id": "b096d728-1246-4eaa-9222-ed8eee74870c", "bridge": "br-int", "label": "tempest-TestStampPattern-1207618832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e17bbd82f843fdaa3c48d8cb64a2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b53759-f1", "ovs_interfaceid": "d5b53759-f1dd-4a6c-83c0-d4fe816d1131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:51:46 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:51:46 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:51:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:51:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1019310177',display_name='tempest-TestStampPattern-server-1019310177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1019310177',id=23,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrZlgeE9/Eb/dSvSLuh1rHNCQMOaoa95CjuZ377Ld81ZeZuC/2z69Zf0ms8CG6YuI4ZXEqqItRYp52TjDRYLlQoYwNXCNYDhSdvz3DpnModEihmBQQVehRcSLXR08S+jQ==',key_name='tempest-TestStampPattern-158458074',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82e17bbd82f843fdaa3c48d8cb64a2c9',ramdisk_id='',reservation_id='r-01bnjg4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1231523385',owner_user_name='tempest-TestStampPattern-1231523385-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:51:45Z,user_data=None,user_id='208acda449ad436c85bdbebff0560e63',uuid=4474ad0e-8eee-4db4-9896-50c049d45d26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5b53759-f1dd-4a6c-83c0-d4fe816d1131", "address": "fa:16:3e:50:2f:7c", "network": {"id": "b096d728-1246-4eaa-9222-ed8eee74870c", "bridge": "br-int", "label": "tempest-TestStampPattern-1207618832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e17bbd82f843fdaa3c48d8cb64a2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b53759-f1", "ovs_interfaceid": "d5b53759-f1dd-4a6c-83c0-d4fe816d1131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Converting VIF {"id": "d5b53759-f1dd-4a6c-83c0-d4fe816d1131", "address": "fa:16:3e:50:2f:7c", "network": {"id": "b096d728-1246-4eaa-9222-ed8eee74870c", "bridge": "br-int", "label": "tempest-TestStampPattern-1207618832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e17bbd82f843fdaa3c48d8cb64a2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b53759-f1", "ovs_interfaceid": "d5b53759-f1dd-4a6c-83c0-d4fe816d1131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:2f:7c,bridge_name='br-int',has_traffic_filtering=True,id=d5b53759-f1dd-4a6c-83c0-d4fe816d1131,network=Network(b096d728-1246-4eaa-9222-ed8eee74870c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5b53759-f1') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG nova.objects.instance [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lazy-loading 'pci_devices' on Instance uuid 4474ad0e-8eee-4db4-9896-50c049d45d26 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:51:46 user nova-compute[74850]:   <uuid>4474ad0e-8eee-4db4-9896-50c049d45d26</uuid>
Nov 14 00:51:46 user nova-compute[74850]:   <name>instance-00000017</name>
Nov 14 00:51:46 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:51:46 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:51:46 user nova-compute[74850]:   <metadata>
Nov 14 00:51:46 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:51:46 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:51:46 user nova-compute[74850]:       <nova:name>tempest-TestStampPattern-server-1019310177</nova:name>
Nov 14 00:51:46 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:51:46</nova:creationTime>
Nov 14 00:51:46 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:51:46 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:51:46 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:51:46 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:51:46 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:51:46 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:51:46 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:51:46 user nova-compute[74850]:       <nova:owner>
Nov 14 00:51:46 user nova-compute[74850]:         <nova:user uuid="208acda449ad436c85bdbebff0560e63">tempest-TestStampPattern-1231523385-project-member</nova:user>
Nov 14 00:51:46 user nova-compute[74850]:         <nova:project uuid="82e17bbd82f843fdaa3c48d8cb64a2c9">tempest-TestStampPattern-1231523385</nova:project>
Nov 14 00:51:46 user nova-compute[74850]:       </nova:owner>
Nov 14 00:51:46 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:51:46 user nova-compute[74850]:       <nova:ports>
Nov 14 00:51:46 user nova-compute[74850]:         <nova:port uuid="d5b53759-f1dd-4a6c-83c0-d4fe816d1131">
Nov 14 00:51:46 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 00:51:46 user nova-compute[74850]:         </nova:port>
Nov 14 00:51:46 user nova-compute[74850]:       </nova:ports>
Nov 14 00:51:46 user nova-compute[74850]:     </nova:instance>
Nov 14 00:51:46 user nova-compute[74850]:   </metadata>
Nov 14 00:51:46 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:51:46 user nova-compute[74850]:     <system>
Nov 14 00:51:46 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:51:46 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:51:46 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:51:46 user nova-compute[74850]:       <entry name="serial">4474ad0e-8eee-4db4-9896-50c049d45d26</entry>
Nov 14 00:51:46 user nova-compute[74850]:       <entry name="uuid">4474ad0e-8eee-4db4-9896-50c049d45d26</entry>
Nov 14 00:51:46 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:51:46 user nova-compute[74850]:     </system>
Nov 14 00:51:46 user nova-compute[74850]:   </sysinfo>
Nov 14 00:51:46 user nova-compute[74850]:   <os>
Nov 14 00:51:46 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:51:46 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 00:51:46 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:51:46 user nova-compute[74850]:   </os>
Nov 14 00:51:46 user nova-compute[74850]:   <features>
Nov 14 00:51:46 user nova-compute[74850]:     <acpi/>
Nov 14 00:51:46 user nova-compute[74850]:     <apic/>
Nov 14 00:51:46 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:51:46 user nova-compute[74850]:   </features>
Nov 14 00:51:46 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:51:46 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:51:46 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:51:46 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:51:46 user nova-compute[74850]:   </clock>
Nov 14 00:51:46 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:51:46 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:51:46 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:51:46 user nova-compute[74850]:   </cpu>
Nov 14 00:51:46 user nova-compute[74850]:   <devices>
Nov 14 00:51:46 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 00:51:46 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:51:46 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk"/>
Nov 14 00:51:46 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:51:46 user nova-compute[74850]:     </disk>
Nov 14 00:51:46 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:51:46 user nova-compute[74850]:       <mac address="fa:16:3e:50:2f:7c"/>
Nov 14 00:51:46 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:51:46 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:51:46 user nova-compute[74850]:       <target dev="tapd5b53759-f1"/>
Nov 14 00:51:46 user nova-compute[74850]:     </interface>
Nov 14 00:51:46 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:51:46 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/console.log" append="off"/>
Nov 14 00:51:46 user nova-compute[74850]:     </serial>
Nov 14 00:51:46 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:51:46 user nova-compute[74850]:     <video>
Nov 14 00:51:46 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:51:46 user nova-compute[74850]:     </video>
Nov 14 00:51:46 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:51:46 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:51:46 user nova-compute[74850]:     </rng>
Nov 14 00:51:46 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:51:46 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:51:46 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:51:46 user nova-compute[74850]:     </memballoon>
Nov 14 00:51:46 user nova-compute[74850]:   </devices>
Nov 14 00:51:46 user nova-compute[74850]: </domain>
Nov 14 00:51:46 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:51:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1019310177',display_name='tempest-TestStampPattern-server-1019310177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1019310177',id=23,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrZlgeE9/Eb/dSvSLuh1rHNCQMOaoa95CjuZ377Ld81ZeZuC/2z69Zf0ms8CG6YuI4ZXEqqItRYp52TjDRYLlQoYwNXCNYDhSdvz3DpnModEihmBQQVehRcSLXR08S+jQ==',key_name='tempest-TestStampPattern-158458074',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82e17bbd82f843fdaa3c48d8cb64a2c9',ramdisk_id='',reservation_id='r-01bnjg4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1231523385',owner_user_name='tempest-TestStampPattern-1231523385-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:51:45Z,user_data=None,user_id='208acda449ad436c85bdbebff0560e63',uuid=4474ad0e-8eee-4db4-9896-50c049d45d26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5b53759-f1dd-4a6c-83c0-d4fe816d1131", "address": "fa:16:3e:50:2f:7c", "network": {"id": "b096d728-1246-4eaa-9222-ed8eee74870c", "bridge": "br-int", "label": "tempest-TestStampPattern-1207618832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e17bbd82f843fdaa3c48d8cb64a2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b53759-f1", "ovs_interfaceid": "d5b53759-f1dd-4a6c-83c0-d4fe816d1131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Converting VIF {"id": "d5b53759-f1dd-4a6c-83c0-d4fe816d1131", "address": "fa:16:3e:50:2f:7c", "network": {"id": "b096d728-1246-4eaa-9222-ed8eee74870c", "bridge": "br-int", "label": "tempest-TestStampPattern-1207618832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e17bbd82f843fdaa3c48d8cb64a2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b53759-f1", "ovs_interfaceid": "d5b53759-f1dd-4a6c-83c0-d4fe816d1131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:2f:7c,bridge_name='br-int',has_traffic_filtering=True,id=d5b53759-f1dd-4a6c-83c0-d4fe816d1131,network=Network(b096d728-1246-4eaa-9222-ed8eee74870c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5b53759-f1') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG os_vif [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:2f:7c,bridge_name='br-int',has_traffic_filtering=True,id=d5b53759-f1dd-4a6c-83c0-d4fe816d1131,network=Network(b096d728-1246-4eaa-9222-ed8eee74870c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5b53759-f1') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fec380eb-cec5-504a-bbba-5c1fbb253b71', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5b53759-f1, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd5b53759-f1, col_values=(('qos', UUID('05a260db-94b2-4c23-95c9-6c9e69e371c5')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd5b53759-f1, col_values=(('external_ids', {'iface-id': 'd5b53759-f1dd-4a6c-83c0-d4fe816d1131', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:2f:7c', 'vm-uuid': '4474ad0e-8eee-4db4-9896-50c049d45d26'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:51:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:46 user nova-compute[74850]: INFO os_vif [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:2f:7c,bridge_name='br-int',has_traffic_filtering=True,id=d5b53759-f1dd-4a6c-83c0-d4fe816d1131,network=Network(b096d728-1246-4eaa-9222-ed8eee74870c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5b53759-f1')
Nov 14 00:51:47 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:51:47 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] No VIF found with MAC fa:16:3e:50:2f:7c, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:51:47 user nova-compute[74850]: DEBUG nova.network.neutron [req-384604ea-9517-4846-b0f6-ae9d5259d839 req-581f2470-0f32-4a36-b92d-64c9632194be service nova] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Updated VIF entry in instance network info cache for port d5b53759-f1dd-4a6c-83c0-d4fe816d1131. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:51:47 user nova-compute[74850]: DEBUG nova.network.neutron [req-384604ea-9517-4846-b0f6-ae9d5259d839 req-581f2470-0f32-4a36-b92d-64c9632194be service nova] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Updating instance_info_cache with network_info: [{"id": "d5b53759-f1dd-4a6c-83c0-d4fe816d1131", "address": "fa:16:3e:50:2f:7c", "network": {"id": "b096d728-1246-4eaa-9222-ed8eee74870c", "bridge": "br-int", "label": "tempest-TestStampPattern-1207618832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e17bbd82f843fdaa3c48d8cb64a2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b53759-f1", "ovs_interfaceid": "d5b53759-f1dd-4a6c-83c0-d4fe816d1131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:51:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-384604ea-9517-4846-b0f6-ae9d5259d839 req-581f2470-0f32-4a36-b92d-64c9632194be service nova] Releasing lock "refresh_cache-4474ad0e-8eee-4db4-9896-50c049d45d26" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:51:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:47 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:51:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:51:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:51:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:51:47 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 00:51:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:48 user nova-compute[74850]: DEBUG nova.compute.manager [req-f426a6fd-2657-4c44-bc2e-88acf00f2f2b req-14102ae0-1b15-4c6a-9a34-a6267476b9d9 service nova] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Received event network-vif-plugged-d5b53759-f1dd-4a6c-83c0-d4fe816d1131 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:51:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f426a6fd-2657-4c44-bc2e-88acf00f2f2b req-14102ae0-1b15-4c6a-9a34-a6267476b9d9 service nova] Acquiring lock "4474ad0e-8eee-4db4-9896-50c049d45d26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:51:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f426a6fd-2657-4c44-bc2e-88acf00f2f2b req-14102ae0-1b15-4c6a-9a34-a6267476b9d9 service nova] Lock "4474ad0e-8eee-4db4-9896-50c049d45d26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:51:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f426a6fd-2657-4c44-bc2e-88acf00f2f2b req-14102ae0-1b15-4c6a-9a34-a6267476b9d9 service nova] Lock "4474ad0e-8eee-4db4-9896-50c049d45d26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:51:48 user nova-compute[74850]: DEBUG nova.compute.manager [req-f426a6fd-2657-4c44-bc2e-88acf00f2f2b req-14102ae0-1b15-4c6a-9a34-a6267476b9d9 service nova] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] No waiting events found dispatching network-vif-plugged-d5b53759-f1dd-4a6c-83c0-d4fe816d1131 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:51:48 user nova-compute[74850]: WARNING nova.compute.manager [req-f426a6fd-2657-4c44-bc2e-88acf00f2f2b req-14102ae0-1b15-4c6a-9a34-a6267476b9d9 service nova] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Received unexpected event network-vif-plugged-d5b53759-f1dd-4a6c-83c0-d4fe816d1131 for instance with vm_state building and task_state spawning.
Nov 14 00:51:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:51:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:50 user nova-compute[74850]: DEBUG nova.compute.manager [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:51:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 00:51:50 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Instance spawned successfully.
Nov 14 00:51:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 00:51:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:51:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:51:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:51:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:51:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:51:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:51:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:50 user nova-compute[74850]: INFO nova.compute.manager [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Took 5.47 seconds to spawn the instance on the hypervisor.
Nov 14 00:51:50 user nova-compute[74850]: DEBUG nova.compute.manager [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:51:50 user nova-compute[74850]: DEBUG nova.compute.manager [req-86c788f5-74fe-4d88-8c99-d37e503ed89b req-cde8eeb1-9689-4002-8d14-71d4746b7436 service nova] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Received event network-vif-plugged-d5b53759-f1dd-4a6c-83c0-d4fe816d1131 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:51:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-86c788f5-74fe-4d88-8c99-d37e503ed89b req-cde8eeb1-9689-4002-8d14-71d4746b7436 service nova] Acquiring lock "4474ad0e-8eee-4db4-9896-50c049d45d26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:51:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-86c788f5-74fe-4d88-8c99-d37e503ed89b req-cde8eeb1-9689-4002-8d14-71d4746b7436 service nova] Lock "4474ad0e-8eee-4db4-9896-50c049d45d26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:51:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-86c788f5-74fe-4d88-8c99-d37e503ed89b req-cde8eeb1-9689-4002-8d14-71d4746b7436 service nova] Lock "4474ad0e-8eee-4db4-9896-50c049d45d26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:51:50 user nova-compute[74850]: DEBUG nova.compute.manager [req-86c788f5-74fe-4d88-8c99-d37e503ed89b req-cde8eeb1-9689-4002-8d14-71d4746b7436 service nova] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] No waiting events found dispatching network-vif-plugged-d5b53759-f1dd-4a6c-83c0-d4fe816d1131 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:51:50 user nova-compute[74850]: WARNING nova.compute.manager [req-86c788f5-74fe-4d88-8c99-d37e503ed89b req-cde8eeb1-9689-4002-8d14-71d4746b7436 service nova] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Received unexpected event network-vif-plugged-d5b53759-f1dd-4a6c-83c0-d4fe816d1131 for instance with vm_state building and task_state spawning.
Nov 14 00:51:50 user nova-compute[74850]: INFO nova.compute.manager [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Took 6.22 seconds to build instance.
Nov 14 00:51:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-7681c183-3a4e-4830-b25a-1ce26696b0b8 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "4474ad0e-8eee-4db4-9896-50c049d45d26" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.326s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:51:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2f305e1-7092-4e8a-bb47-a15c89388eb2/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2f305e1-7092-4e8a-bb47-a15c89388eb2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2f305e1-7092-4e8a-bb47-a15c89388eb2/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2f305e1-7092-4e8a-bb47-a15c89388eb2/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:52 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-76d05301-5d78-472e-a752-c18395eaa46d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Waiting for libvirt event about the detach of device tap8911f309-77 with device alias net1 from instance 7f115ae8-49da-4bf5-ae7c-62696769420c is timed out.
Nov 14 00:51:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-76d05301-5d78-472e-a752-c18395eaa46d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:a4:51:b4"/><model type="virtio"/><mtu size="1442"/><target dev="tap8911f309-77"/></interface> {{(pid=74850) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 00:51:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-76d05301-5d78-472e-a752-c18395eaa46d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:a4:51:b4"/><model type="virtio"/><mtu size="1442"/><target dev="tap8911f309-77"/></interface>not found in domain: <domain type='kvm' id='19'>
Nov 14 00:51:52 user nova-compute[74850]:   <name>instance-00000011</name>
Nov 14 00:51:52 user nova-compute[74850]:   <uuid>7f115ae8-49da-4bf5-ae7c-62696769420c</uuid>
Nov 14 00:51:52 user nova-compute[74850]:   <metadata>
Nov 14 00:51:52 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:51:52 user nova-compute[74850]:   <nova:package version="0.0.0"/>
Nov 14 00:51:52 user nova-compute[74850]:   <nova:name>tempest-device-tagging-server-622477935</nova:name>
Nov 14 00:51:52 user nova-compute[74850]:   <nova:creationTime>2023-11-14 00:50:56</nova:creationTime>
Nov 14 00:51:52 user nova-compute[74850]:   <nova:flavor name="m1.tiny">
Nov 14 00:51:52 user nova-compute[74850]:     <nova:memory>512</nova:memory>
Nov 14 00:51:52 user nova-compute[74850]:     <nova:disk>1</nova:disk>
Nov 14 00:51:52 user nova-compute[74850]:     <nova:swap>0</nova:swap>
Nov 14 00:51:52 user nova-compute[74850]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:51:52 user nova-compute[74850]:     <nova:vcpus>1</nova:vcpus>
Nov 14 00:51:52 user nova-compute[74850]:   </nova:flavor>
Nov 14 00:51:52 user nova-compute[74850]:   <nova:owner>
Nov 14 00:51:52 user nova-compute[74850]:     <nova:user uuid="cebab0c5f0c74784a0d09a696a9b62d8">tempest-TaggedAttachmentsTest-1948159451-project-member</nova:user>
Nov 14 00:51:52 user nova-compute[74850]:     <nova:project uuid="b29bf565027342a8ac084f1fd0a9b3f5">tempest-TaggedAttachmentsTest-1948159451</nova:project>
Nov 14 00:51:52 user nova-compute[74850]:   </nova:owner>
Nov 14 00:51:52 user nova-compute[74850]:   <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:51:52 user nova-compute[74850]:   <nova:ports>
Nov 14 00:51:52 user nova-compute[74850]:     <nova:port uuid="667273cd-1700-465f-895e-6a1a093f44d8">
Nov 14 00:51:52 user nova-compute[74850]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 00:51:52 user nova-compute[74850]:     </nova:port>
Nov 14 00:51:52 user nova-compute[74850]:     <nova:port uuid="8911f309-779d-4df0-a8bd-ead798ceb829">
Nov 14 00:51:52 user nova-compute[74850]:       <nova:ip type="fixed" address="10.10.10.165" ipVersion="4"/>
Nov 14 00:51:52 user nova-compute[74850]:     </nova:port>
Nov 14 00:51:52 user nova-compute[74850]:   </nova:ports>
Nov 14 00:51:52 user nova-compute[74850]: </nova:instance>
Nov 14 00:51:52 user nova-compute[74850]:   </metadata>
Nov 14 00:51:52 user nova-compute[74850]:   <memory unit='KiB'>524288</memory>
Nov 14 00:51:52 user nova-compute[74850]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 00:51:52 user nova-compute[74850]:   <vcpu placement='static'>1</vcpu>
Nov 14 00:51:52 user nova-compute[74850]:   <resource>
Nov 14 00:51:52 user nova-compute[74850]:     <partition>/machine</partition>
Nov 14 00:51:52 user nova-compute[74850]:   </resource>
Nov 14 00:51:52 user nova-compute[74850]:   <sysinfo type='smbios'>
Nov 14 00:51:52 user nova-compute[74850]:     <system>
Nov 14 00:51:52 user nova-compute[74850]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 00:51:52 user nova-compute[74850]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 00:51:52 user nova-compute[74850]:       <entry name='version'>0.0.0</entry>
Nov 14 00:51:52 user nova-compute[74850]:       <entry name='serial'>7f115ae8-49da-4bf5-ae7c-62696769420c</entry>
Nov 14 00:51:52 user nova-compute[74850]:       <entry name='uuid'>7f115ae8-49da-4bf5-ae7c-62696769420c</entry>
Nov 14 00:51:52 user nova-compute[74850]:       <entry name='family'>Virtual Machine</entry>
Nov 14 00:51:52 user nova-compute[74850]:     </system>
Nov 14 00:51:52 user nova-compute[74850]:   </sysinfo>
Nov 14 00:51:52 user nova-compute[74850]:   <os>
Nov 14 00:51:52 user nova-compute[74850]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 00:51:52 user nova-compute[74850]:     <boot dev='hd'/>
Nov 14 00:51:52 user nova-compute[74850]:     <smbios mode='sysinfo'/>
Nov 14 00:51:52 user nova-compute[74850]:   </os>
Nov 14 00:51:52 user nova-compute[74850]:   <features>
Nov 14 00:51:52 user nova-compute[74850]:     <acpi/>
Nov 14 00:51:52 user nova-compute[74850]:     <apic/>
Nov 14 00:51:52 user nova-compute[74850]:     <vmcoreinfo state='on'/>
Nov 14 00:51:52 user nova-compute[74850]:   </features>
Nov 14 00:51:52 user nova-compute[74850]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 00:51:52 user nova-compute[74850]:     <model fallback='forbid'>Nehalem</model>
Nov 14 00:51:52 user nova-compute[74850]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 00:51:52 user nova-compute[74850]:     <feature policy='require' name='vme'/>
Nov 14 00:51:52 user nova-compute[74850]:     <feature policy='require' name='x2apic'/>
Nov 14 00:51:52 user nova-compute[74850]:     <feature policy='require' name='hypervisor'/>
Nov 14 00:51:52 user nova-compute[74850]:   </cpu>
Nov 14 00:51:52 user nova-compute[74850]:   <clock offset='utc'>
Nov 14 00:51:52 user nova-compute[74850]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 00:51:52 user nova-compute[74850]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 00:51:52 user nova-compute[74850]:     <timer name='hpet' present='no'/>
Nov 14 00:51:52 user nova-compute[74850]:   </clock>
Nov 14 00:51:52 user nova-compute[74850]:   <on_poweroff>destroy</on_poweroff>
Nov 14 00:51:52 user nova-compute[74850]:   <on_reboot>restart</on_reboot>
Nov 14 00:51:52 user nova-compute[74850]:   <on_crash>destroy</on_crash>
Nov 14 00:51:52 user nova-compute[74850]:   <devices>
Nov 14 00:51:52 user nova-compute[74850]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 00:51:52 user nova-compute[74850]:     <disk type='file' device='disk'>
Nov 14 00:51:52 user nova-compute[74850]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 00:51:52 user nova-compute[74850]:       <source file='/opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/disk' index='2'/>
Nov 14 00:51:52 user nova-compute[74850]:       <backingStore type='file' index='3'>
Nov 14 00:51:52 user nova-compute[74850]:         <format type='raw'/>
Nov 14 00:51:52 user nova-compute[74850]:         <source file='/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549'/>
Nov 14 00:51:52 user nova-compute[74850]:         <backingStore/>
Nov 14 00:51:52 user nova-compute[74850]:       </backingStore>
Nov 14 00:51:52 user nova-compute[74850]:       <target dev='vda' bus='virtio'/>
Nov 14 00:51:52 user nova-compute[74850]:       <alias name='virtio-disk0'/>
Nov 14 00:51:52 user nova-compute[74850]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 00:51:52 user nova-compute[74850]:     </disk>
Nov 14 00:51:52 user nova-compute[74850]:     <disk type='file' device='cdrom'>
Nov 14 00:51:52 user nova-compute[74850]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 00:51:52 user nova-compute[74850]:       <source file='/opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/disk.config' index='1'/>
Nov 14 00:51:52 user nova-compute[74850]:       <backingStore/>
Nov 14 00:51:52 user nova-compute[74850]:       <target dev='hda' bus='ide'/>
Nov 14 00:51:52 user nova-compute[74850]:       <readonly/>
Nov 14 00:51:52 user nova-compute[74850]:       <alias name='ide0-0-0'/>
Nov 14 00:51:52 user nova-compute[74850]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 00:51:52 user nova-compute[74850]:     </disk>
Nov 14 00:51:52 user nova-compute[74850]:     <controller type='usb' index='0' model='none'>
Nov 14 00:51:52 user nova-compute[74850]:       <alias name='usb'/>
Nov 14 00:51:52 user nova-compute[74850]:     </controller>
Nov 14 00:51:52 user nova-compute[74850]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 00:51:52 user nova-compute[74850]:       <alias name='pci.0'/>
Nov 14 00:51:52 user nova-compute[74850]:     </controller>
Nov 14 00:51:52 user nova-compute[74850]:     <controller type='ide' index='0'>
Nov 14 00:51:52 user nova-compute[74850]:       <alias name='ide'/>
Nov 14 00:51:52 user nova-compute[74850]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 00:51:52 user nova-compute[74850]:     </controller>
Nov 14 00:51:52 user nova-compute[74850]:     <interface type='ethernet'>
Nov 14 00:51:52 user nova-compute[74850]:       <mac address='fa:16:3e:d1:ab:73'/>
Nov 14 00:51:52 user nova-compute[74850]:       <target dev='tap667273cd-17'/>
Nov 14 00:51:52 user nova-compute[74850]:       <model type='virtio'/>
Nov 14 00:51:52 user nova-compute[74850]:       <mtu size='1442'/>
Nov 14 00:51:52 user nova-compute[74850]:       <alias name='net0'/>
Nov 14 00:51:52 user nova-compute[74850]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 00:51:52 user nova-compute[74850]:     </interface>
Nov 14 00:51:52 user nova-compute[74850]:     <serial type='pty'>
Nov 14 00:51:52 user nova-compute[74850]:       <source path='/dev/pts/0'/>
Nov 14 00:51:52 user nova-compute[74850]:       <log file='/opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/console.log' append='off'/>
Nov 14 00:51:52 user nova-compute[74850]:       <target type='isa-serial' port='0'>
Nov 14 00:51:52 user nova-compute[74850]:         <model name='isa-serial'/>
Nov 14 00:51:52 user nova-compute[74850]:       </target>
Nov 14 00:51:52 user nova-compute[74850]:       <alias name='serial0'/>
Nov 14 00:51:52 user nova-compute[74850]:     </serial>
Nov 14 00:51:52 user nova-compute[74850]:     <console type='pty' tty='/dev/pts/0'>
Nov 14 00:51:52 user nova-compute[74850]:       <source path='/dev/pts/0'/>
Nov 14 00:51:52 user nova-compute[74850]:       <log file='/opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/console.log' append='off'/>
Nov 14 00:51:52 user nova-compute[74850]:       <target type='serial' port='0'/>
Nov 14 00:51:52 user nova-compute[74850]:       <alias name='serial0'/>
Nov 14 00:51:52 user nova-compute[74850]:     </console>
Nov 14 00:51:52 user nova-compute[74850]:     <input type='mouse' bus='ps2'>
Nov 14 00:51:52 user nova-compute[74850]:       <alias name='input0'/>
Nov 14 00:51:52 user nova-compute[74850]:     </input>
Nov 14 00:51:52 user nova-compute[74850]:     <input type='keyboard' bus='ps2'>
Nov 14 00:51:52 user nova-compute[74850]:       <alias name='input1'/>
Nov 14 00:51:52 user nova-compute[74850]:     </input>
Nov 14 00:51:52 user nova-compute[74850]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 14 00:51:52 user nova-compute[74850]:       <listen type='address' address='0.0.0.0'/>
Nov 14 00:51:52 user nova-compute[74850]:     </graphics>
Nov 14 00:51:52 user nova-compute[74850]:     <audio id='1' type='none'/>
Nov 14 00:51:52 user nova-compute[74850]:     <video>
Nov 14 00:51:52 user nova-compute[74850]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 00:51:52 user nova-compute[74850]:       <alias name='video0'/>
Nov 14 00:51:52 user nova-compute[74850]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 00:51:52 user nova-compute[74850]:     </video>
Nov 14 00:51:52 user nova-compute[74850]:     <memballoon model='virtio'>
Nov 14 00:51:52 user nova-compute[74850]:       <stats period='10'/>
Nov 14 00:51:52 user nova-compute[74850]:       <alias name='balloon0'/>
Nov 14 00:51:52 user nova-compute[74850]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 00:51:52 user nova-compute[74850]:     </memballoon>
Nov 14 00:51:52 user nova-compute[74850]:     <rng model='virtio'>
Nov 14 00:51:52 user nova-compute[74850]:       <backend model='random'>/dev/urandom</backend>
Nov 14 00:51:52 user nova-compute[74850]:       <alias name='rng0'/>
Nov 14 00:51:52 user nova-compute[74850]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 00:51:52 user nova-compute[74850]:     </rng>
Nov 14 00:51:52 user nova-compute[74850]:   </devices>
Nov 14 00:51:52 user nova-compute[74850]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 00:51:52 user nova-compute[74850]:     <label>libvirt-7f115ae8-49da-4bf5-ae7c-62696769420c</label>
Nov 14 00:51:52 user nova-compute[74850]:     <imagelabel>libvirt-7f115ae8-49da-4bf5-ae7c-62696769420c</imagelabel>
Nov 14 00:51:52 user nova-compute[74850]:   </seclabel>
Nov 14 00:51:52 user nova-compute[74850]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 00:51:52 user nova-compute[74850]:     <label>+64055:+108</label>
Nov 14 00:51:52 user nova-compute[74850]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 00:51:52 user nova-compute[74850]:   </seclabel>
Nov 14 00:51:52 user nova-compute[74850]: </domain>
Nov 14 00:51:52 user nova-compute[74850]:  {{(pid=74850) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 00:51:52 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-76d05301-5d78-472e-a752-c18395eaa46d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Successfully detached device tap8911f309-77 from instance 7f115ae8-49da-4bf5-ae7c-62696769420c from the live domain config.
Nov 14 00:51:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-76d05301-5d78-472e-a752-c18395eaa46d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-622477935',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-622477935',id=17,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBGvhns7XWVf/haNp2AKmH5EhvuBpoE+TGi/Wza7qjLEHR4vfwIGfr3qwoxrfGTiid4eBr+1xVTKisgYQUIZxBKIACazg/Q7FT120267dvZKdM6cwjXC2T4hWuncWpIGw==',key_name='tempest-keypair-783468073',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:49:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b29bf565027342a8ac084f1fd0a9b3f5',ramdisk_id='',reservation_id='r-n5valy8w',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1948159451',owner_user_name='tempest-TaggedAttachmentsTest-1948159451-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:49:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cebab0c5f0c74784a0d09a696a9b62d8',uuid=7f115ae8-49da-4bf5-ae7c-62696769420c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8911f309-779d-4df0-a8bd-ead798ceb829", "address": "fa:16:3e:a4:51:b4", "network": {"id": "0f67cb75-70fd-41b7-b210-2a7c909da154", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1304810839", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b29bf565027342a8ac084f1fd0a9b3f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8911f309-77", "ovs_interfaceid": "8911f309-779d-4df0-a8bd-ead798ceb829", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:51:52 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-76d05301-5d78-472e-a752-c18395eaa46d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Converting VIF {"id": "8911f309-779d-4df0-a8bd-ead798ceb829", "address": "fa:16:3e:a4:51:b4", "network": {"id": "0f67cb75-70fd-41b7-b210-2a7c909da154", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1304810839", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b29bf565027342a8ac084f1fd0a9b3f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8911f309-77", "ovs_interfaceid": "8911f309-779d-4df0-a8bd-ead798ceb829", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:51:52 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-76d05301-5d78-472e-a752-c18395eaa46d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:51:b4,bridge_name='br-int',has_traffic_filtering=True,id=8911f309-779d-4df0-a8bd-ead798ceb829,network=Network(0f67cb75-70fd-41b7-b210-2a7c909da154),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8911f309-77') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:51:52 user nova-compute[74850]: DEBUG os_vif [None req-76d05301-5d78-472e-a752-c18395eaa46d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:51:b4,bridge_name='br-int',has_traffic_filtering=True,id=8911f309-779d-4df0-a8bd-ead798ceb829,network=Network(0f67cb75-70fd-41b7-b210-2a7c909da154),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8911f309-77') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:51:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8911f309-77, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:51:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:51:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9405c322-874a-4a82-8cd8-e4ea576ebf11) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:51:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:52 user nova-compute[74850]: INFO os_vif [None req-76d05301-5d78-472e-a752-c18395eaa46d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:51:b4,bridge_name='br-int',has_traffic_filtering=True,id=8911f309-779d-4df0-a8bd-ead798ceb829,network=Network(0f67cb75-70fd-41b7-b210-2a7c909da154),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8911f309-77')
Nov 14 00:51:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-76d05301-5d78-472e-a752-c18395eaa46d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:51:52 user nova-compute[74850]:   <nova:package version="0.0.0"/>
Nov 14 00:51:52 user nova-compute[74850]:   <nova:name>tempest-device-tagging-server-622477935</nova:name>
Nov 14 00:51:52 user nova-compute[74850]:   <nova:creationTime>2023-11-14 00:51:52</nova:creationTime>
Nov 14 00:51:52 user nova-compute[74850]:   <nova:flavor name="m1.tiny">
Nov 14 00:51:52 user nova-compute[74850]:     <nova:memory>512</nova:memory>
Nov 14 00:51:52 user nova-compute[74850]:     <nova:disk>1</nova:disk>
Nov 14 00:51:52 user nova-compute[74850]:     <nova:swap>0</nova:swap>
Nov 14 00:51:52 user nova-compute[74850]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:51:52 user nova-compute[74850]:     <nova:vcpus>1</nova:vcpus>
Nov 14 00:51:52 user nova-compute[74850]:   </nova:flavor>
Nov 14 00:51:52 user nova-compute[74850]:   <nova:owner>
Nov 14 00:51:52 user nova-compute[74850]:     <nova:user uuid="cebab0c5f0c74784a0d09a696a9b62d8">tempest-TaggedAttachmentsTest-1948159451-project-member</nova:user>
Nov 14 00:51:52 user nova-compute[74850]:     <nova:project uuid="b29bf565027342a8ac084f1fd0a9b3f5">tempest-TaggedAttachmentsTest-1948159451</nova:project>
Nov 14 00:51:52 user nova-compute[74850]:   </nova:owner>
Nov 14 00:51:52 user nova-compute[74850]:   <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:51:52 user nova-compute[74850]:   <nova:ports>
Nov 14 00:51:52 user nova-compute[74850]:     <nova:port uuid="667273cd-1700-465f-895e-6a1a093f44d8">
Nov 14 00:51:52 user nova-compute[74850]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 00:51:52 user nova-compute[74850]:     </nova:port>
Nov 14 00:51:52 user nova-compute[74850]:   </nova:ports>
Nov 14 00:51:52 user nova-compute[74850]: </nova:instance>
Nov 14 00:51:52 user nova-compute[74850]:  {{(pid=74850) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 00:51:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:51:52 user nova-compute[74850]: DEBUG nova.compute.manager [req-3f0b904f-930e-447f-ba85-ecc70cc8937d req-88608817-cb33-43b8-81be-3cf830c2ce49 service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Received event network-vif-deleted-8911f309-779d-4df0-a8bd-ead798ceb829 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:51:52 user nova-compute[74850]: INFO nova.compute.manager [req-3f0b904f-930e-447f-ba85-ecc70cc8937d req-88608817-cb33-43b8-81be-3cf830c2ce49 service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Neutron deleted interface 8911f309-779d-4df0-a8bd-ead798ceb829; detaching it from the instance and deleting it from the info cache
Nov 14 00:51:52 user nova-compute[74850]: DEBUG nova.network.neutron [req-3f0b904f-930e-447f-ba85-ecc70cc8937d req-88608817-cb33-43b8-81be-3cf830c2ce49 service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Updating instance_info_cache with network_info: [{"id": "667273cd-1700-465f-895e-6a1a093f44d8", "address": "fa:16:3e:d1:ab:73", "network": {"id": "db78a7e7-17dd-4ef3-940d-96d93df45daa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1114583145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b29bf565027342a8ac084f1fd0a9b3f5", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap667273cd-17", "ovs_interfaceid": "667273cd-1700-465f-895e-6a1a093f44d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:51:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-76d05301-5d78-472e-a752-c18395eaa46d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Acquiring lock "refresh_cache-7f115ae8-49da-4bf5-ae7c-62696769420c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:51:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-76d05301-5d78-472e-a752-c18395eaa46d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Acquired lock "refresh_cache-7f115ae8-49da-4bf5-ae7c-62696769420c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:51:52 user nova-compute[74850]: DEBUG nova.network.neutron [None req-76d05301-5d78-472e-a752-c18395eaa46d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:51:52 user nova-compute[74850]: DEBUG nova.objects.instance [req-3f0b904f-930e-447f-ba85-ecc70cc8937d req-88608817-cb33-43b8-81be-3cf830c2ce49 service nova] Lazy-loading 'system_metadata' on Instance uuid 7f115ae8-49da-4bf5-ae7c-62696769420c {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:51:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:51:52 user nova-compute[74850]: DEBUG nova.objects.instance [req-3f0b904f-930e-447f-ba85-ecc70cc8937d req-88608817-cb33-43b8-81be-3cf830c2ce49 service nova] Lazy-loading 'flavor' on Instance uuid 7f115ae8-49da-4bf5-ae7c-62696769420c {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:51:53 user nova-compute[74850]: DEBUG nova.objects.base [req-3f0b904f-930e-447f-ba85-ecc70cc8937d req-88608817-cb33-43b8-81be-3cf830c2ce49 service nova] Object Instance<7f115ae8-49da-4bf5-ae7c-62696769420c> lazy-loaded attributes: system_metadata,flavor {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 00:51:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [req-3f0b904f-930e-447f-ba85-ecc70cc8937d req-88608817-cb33-43b8-81be-3cf830c2ce49 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-622477935',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-622477935',id=17,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBGvhns7XWVf/haNp2AKmH5EhvuBpoE+TGi/Wza7qjLEHR4vfwIGfr3qwoxrfGTiid4eBr+1xVTKisgYQUIZxBKIACazg/Q7FT120267dvZKdM6cwjXC2T4hWuncWpIGw==',key_name='tempest-keypair-783468073',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:49:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b29bf565027342a8ac084f1fd0a9b3f5',ramdisk_id='',reservation_id='r-n5valy8w',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1948159451',owner_user_name='tempest-TaggedAttachmentsTest-1948159451-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:49:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cebab0c5f0c74784a0d09a696a9b62d8',uuid=7f115ae8-49da-4bf5-ae7c-62696769420c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8911f309-779d-4df0-a8bd-ead798ceb829", "address": "fa:16:3e:a4:51:b4", "network": {"id": "0f67cb75-70fd-41b7-b210-2a7c909da154", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1304810839", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b29bf565027342a8ac084f1fd0a9b3f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8911f309-77", "ovs_interfaceid": "8911f309-779d-4df0-a8bd-ead798ceb829", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:51:53 user nova-compute[74850]: DEBUG nova.network.os_vif_util [req-3f0b904f-930e-447f-ba85-ecc70cc8937d req-88608817-cb33-43b8-81be-3cf830c2ce49 service nova] Converting VIF {"id": "8911f309-779d-4df0-a8bd-ead798ceb829", "address": "fa:16:3e:a4:51:b4", "network": {"id": "0f67cb75-70fd-41b7-b210-2a7c909da154", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1304810839", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b29bf565027342a8ac084f1fd0a9b3f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8911f309-77", "ovs_interfaceid": "8911f309-779d-4df0-a8bd-ead798ceb829", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:51:53 user nova-compute[74850]: DEBUG nova.network.os_vif_util [req-3f0b904f-930e-447f-ba85-ecc70cc8937d req-88608817-cb33-43b8-81be-3cf830c2ce49 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:51:b4,bridge_name='br-int',has_traffic_filtering=True,id=8911f309-779d-4df0-a8bd-ead798ceb829,network=Network(0f67cb75-70fd-41b7-b210-2a7c909da154),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8911f309-77') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:51:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [req-3f0b904f-930e-447f-ba85-ecc70cc8937d req-88608817-cb33-43b8-81be-3cf830c2ce49 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:a4:51:b4"/><model type="virtio"/><mtu size="1442"/><target dev="tap8911f309-77"/></interface> {{(pid=74850) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 00:51:53 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:51:53 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:51:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=7598MB free_disk=25.352130889892578GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 00:51:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:51:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:51:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [req-3f0b904f-930e-447f-ba85-ecc70cc8937d req-88608817-cb33-43b8-81be-3cf830c2ce49 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:a4:51:b4"/><model type="virtio"/><mtu size="1442"/><target dev="tap8911f309-77"/></interface>not found in domain: <domain type='kvm' id='19'>
Nov 14 00:51:53 user nova-compute[74850]:   <name>instance-00000011</name>
Nov 14 00:51:53 user nova-compute[74850]:   <uuid>7f115ae8-49da-4bf5-ae7c-62696769420c</uuid>
Nov 14 00:51:53 user nova-compute[74850]:   <metadata>
Nov 14 00:51:53 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:51:53 user nova-compute[74850]:   <nova:package version="0.0.0"/>
Nov 14 00:51:53 user nova-compute[74850]:   <nova:name>tempest-device-tagging-server-622477935</nova:name>
Nov 14 00:51:53 user nova-compute[74850]:   <nova:creationTime>2023-11-14 00:51:52</nova:creationTime>
Nov 14 00:51:53 user nova-compute[74850]:   <nova:flavor name="m1.tiny">
Nov 14 00:51:53 user nova-compute[74850]:     <nova:memory>512</nova:memory>
Nov 14 00:51:53 user nova-compute[74850]:     <nova:disk>1</nova:disk>
Nov 14 00:51:53 user nova-compute[74850]:     <nova:swap>0</nova:swap>
Nov 14 00:51:53 user nova-compute[74850]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:51:53 user nova-compute[74850]:     <nova:vcpus>1</nova:vcpus>
Nov 14 00:51:53 user nova-compute[74850]:   </nova:flavor>
Nov 14 00:51:53 user nova-compute[74850]:   <nova:owner>
Nov 14 00:51:53 user nova-compute[74850]:     <nova:user uuid="cebab0c5f0c74784a0d09a696a9b62d8">tempest-TaggedAttachmentsTest-1948159451-project-member</nova:user>
Nov 14 00:51:53 user nova-compute[74850]:     <nova:project uuid="b29bf565027342a8ac084f1fd0a9b3f5">tempest-TaggedAttachmentsTest-1948159451</nova:project>
Nov 14 00:51:53 user nova-compute[74850]:   </nova:owner>
Nov 14 00:51:53 user nova-compute[74850]:   <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:51:53 user nova-compute[74850]:   <nova:ports>
Nov 14 00:51:53 user nova-compute[74850]:     <nova:port uuid="667273cd-1700-465f-895e-6a1a093f44d8">
Nov 14 00:51:53 user nova-compute[74850]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 00:51:53 user nova-compute[74850]:     </nova:port>
Nov 14 00:51:53 user nova-compute[74850]:   </nova:ports>
Nov 14 00:51:53 user nova-compute[74850]: </nova:instance>
Nov 14 00:51:53 user nova-compute[74850]:   </metadata>
Nov 14 00:51:53 user nova-compute[74850]:   <memory unit='KiB'>524288</memory>
Nov 14 00:51:53 user nova-compute[74850]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 00:51:53 user nova-compute[74850]:   <vcpu placement='static'>1</vcpu>
Nov 14 00:51:53 user nova-compute[74850]:   <resource>
Nov 14 00:51:53 user nova-compute[74850]:     <partition>/machine</partition>
Nov 14 00:51:53 user nova-compute[74850]:   </resource>
Nov 14 00:51:53 user nova-compute[74850]:   <sysinfo type='smbios'>
Nov 14 00:51:53 user nova-compute[74850]:     <system>
Nov 14 00:51:53 user nova-compute[74850]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 00:51:53 user nova-compute[74850]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 00:51:53 user nova-compute[74850]:       <entry name='version'>0.0.0</entry>
Nov 14 00:51:53 user nova-compute[74850]:       <entry name='serial'>7f115ae8-49da-4bf5-ae7c-62696769420c</entry>
Nov 14 00:51:53 user nova-compute[74850]:       <entry name='uuid'>7f115ae8-49da-4bf5-ae7c-62696769420c</entry>
Nov 14 00:51:53 user nova-compute[74850]:       <entry name='family'>Virtual Machine</entry>
Nov 14 00:51:53 user nova-compute[74850]:     </system>
Nov 14 00:51:53 user nova-compute[74850]:   </sysinfo>
Nov 14 00:51:53 user nova-compute[74850]:   <os>
Nov 14 00:51:53 user nova-compute[74850]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 00:51:53 user nova-compute[74850]:     <boot dev='hd'/>
Nov 14 00:51:53 user nova-compute[74850]:     <smbios mode='sysinfo'/>
Nov 14 00:51:53 user nova-compute[74850]:   </os>
Nov 14 00:51:53 user nova-compute[74850]:   <features>
Nov 14 00:51:53 user nova-compute[74850]:     <acpi/>
Nov 14 00:51:53 user nova-compute[74850]:     <apic/>
Nov 14 00:51:53 user nova-compute[74850]:     <vmcoreinfo state='on'/>
Nov 14 00:51:53 user nova-compute[74850]:   </features>
Nov 14 00:51:53 user nova-compute[74850]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 00:51:53 user nova-compute[74850]:     <model fallback='forbid'>Nehalem</model>
Nov 14 00:51:53 user nova-compute[74850]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 00:51:53 user nova-compute[74850]:     <feature policy='require' name='vme'/>
Nov 14 00:51:53 user nova-compute[74850]:     <feature policy='require' name='x2apic'/>
Nov 14 00:51:53 user nova-compute[74850]:     <feature policy='require' name='hypervisor'/>
Nov 14 00:51:53 user nova-compute[74850]:   </cpu>
Nov 14 00:51:53 user nova-compute[74850]:   <clock offset='utc'>
Nov 14 00:51:53 user nova-compute[74850]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 00:51:53 user nova-compute[74850]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 00:51:53 user nova-compute[74850]:     <timer name='hpet' present='no'/>
Nov 14 00:51:53 user nova-compute[74850]:   </clock>
Nov 14 00:51:53 user nova-compute[74850]:   <on_poweroff>destroy</on_poweroff>
Nov 14 00:51:53 user nova-compute[74850]:   <on_reboot>restart</on_reboot>
Nov 14 00:51:53 user nova-compute[74850]:   <on_crash>destroy</on_crash>
Nov 14 00:51:53 user nova-compute[74850]:   <devices>
Nov 14 00:51:53 user nova-compute[74850]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 00:51:53 user nova-compute[74850]:     <disk type='file' device='disk'>
Nov 14 00:51:53 user nova-compute[74850]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 00:51:53 user nova-compute[74850]:       <source file='/opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/disk' index='2'/>
Nov 14 00:51:53 user nova-compute[74850]:       <backingStore type='file' index='3'>
Nov 14 00:51:53 user nova-compute[74850]:         <format type='raw'/>
Nov 14 00:51:53 user nova-compute[74850]:         <source file='/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549'/>
Nov 14 00:51:53 user nova-compute[74850]:         <backingStore/>
Nov 14 00:51:53 user nova-compute[74850]:       </backingStore>
Nov 14 00:51:53 user nova-compute[74850]:       <target dev='vda' bus='virtio'/>
Nov 14 00:51:53 user nova-compute[74850]:       <alias name='virtio-disk0'/>
Nov 14 00:51:53 user nova-compute[74850]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 00:51:53 user nova-compute[74850]:     </disk>
Nov 14 00:51:53 user nova-compute[74850]:     <disk type='file' device='cdrom'>
Nov 14 00:51:53 user nova-compute[74850]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 00:51:53 user nova-compute[74850]:       <source file='/opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/disk.config' index='1'/>
Nov 14 00:51:53 user nova-compute[74850]:       <backingStore/>
Nov 14 00:51:53 user nova-compute[74850]:       <target dev='hda' bus='ide'/>
Nov 14 00:51:53 user nova-compute[74850]:       <readonly/>
Nov 14 00:51:53 user nova-compute[74850]:       <alias name='ide0-0-0'/>
Nov 14 00:51:53 user nova-compute[74850]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 00:51:53 user nova-compute[74850]:     </disk>
Nov 14 00:51:53 user nova-compute[74850]:     <controller type='usb' index='0' model='none'>
Nov 14 00:51:53 user nova-compute[74850]:       <alias name='usb'/>
Nov 14 00:51:53 user nova-compute[74850]:     </controller>
Nov 14 00:51:53 user nova-compute[74850]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 00:51:53 user nova-compute[74850]:       <alias name='pci.0'/>
Nov 14 00:51:53 user nova-compute[74850]:     </controller>
Nov 14 00:51:53 user nova-compute[74850]:     <controller type='ide' index='0'>
Nov 14 00:51:53 user nova-compute[74850]:       <alias name='ide'/>
Nov 14 00:51:53 user nova-compute[74850]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 00:51:53 user nova-compute[74850]:     </controller>
Nov 14 00:51:53 user nova-compute[74850]:     <interface type='ethernet'>
Nov 14 00:51:53 user nova-compute[74850]:       <mac address='fa:16:3e:d1:ab:73'/>
Nov 14 00:51:53 user nova-compute[74850]:       <target dev='tap667273cd-17'/>
Nov 14 00:51:53 user nova-compute[74850]:       <model type='virtio'/>
Nov 14 00:51:53 user nova-compute[74850]:       <mtu size='1442'/>
Nov 14 00:51:53 user nova-compute[74850]:       <alias name='net0'/>
Nov 14 00:51:53 user nova-compute[74850]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 00:51:53 user nova-compute[74850]:     </interface>
Nov 14 00:51:53 user nova-compute[74850]:     <serial type='pty'>
Nov 14 00:51:53 user nova-compute[74850]:       <source path='/dev/pts/0'/>
Nov 14 00:51:53 user nova-compute[74850]:       <log file='/opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/console.log' append='off'/>
Nov 14 00:51:53 user nova-compute[74850]:       <target type='isa-serial' port='0'>
Nov 14 00:51:53 user nova-compute[74850]:         <model name='isa-serial'/>
Nov 14 00:51:53 user nova-compute[74850]:       </target>
Nov 14 00:51:53 user nova-compute[74850]:       <alias name='serial0'/>
Nov 14 00:51:53 user nova-compute[74850]:     </serial>
Nov 14 00:51:53 user nova-compute[74850]:     <console type='pty' tty='/dev/pts/0'>
Nov 14 00:51:53 user nova-compute[74850]:       <source path='/dev/pts/0'/>
Nov 14 00:51:53 user nova-compute[74850]:       <log file='/opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/console.log' append='off'/>
Nov 14 00:51:53 user nova-compute[74850]:       <target type='serial' port='0'/>
Nov 14 00:51:53 user nova-compute[74850]:       <alias name='serial0'/>
Nov 14 00:51:53 user nova-compute[74850]:     </console>
Nov 14 00:51:53 user nova-compute[74850]:     <input type='mouse' bus='ps2'>
Nov 14 00:51:53 user nova-compute[74850]:       <alias name='input0'/>
Nov 14 00:51:53 user nova-compute[74850]:     </input>
Nov 14 00:51:53 user nova-compute[74850]:     <input type='keyboard' bus='ps2'>
Nov 14 00:51:53 user nova-compute[74850]:       <alias name='input1'/>
Nov 14 00:51:53 user nova-compute[74850]:     </input>
Nov 14 00:51:53 user nova-compute[74850]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 14 00:51:53 user nova-compute[74850]:       <listen type='address' address='0.0.0.0'/>
Nov 14 00:51:53 user nova-compute[74850]:     </graphics>
Nov 14 00:51:53 user nova-compute[74850]:     <audio id='1' type='none'/>
Nov 14 00:51:53 user nova-compute[74850]:     <video>
Nov 14 00:51:53 user nova-compute[74850]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 00:51:53 user nova-compute[74850]:       <alias name='video0'/>
Nov 14 00:51:53 user nova-compute[74850]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 00:51:53 user nova-compute[74850]:     </video>
Nov 14 00:51:53 user nova-compute[74850]:     <memballoon model='virtio'>
Nov 14 00:51:53 user nova-compute[74850]:       <stats period='10'/>
Nov 14 00:51:53 user nova-compute[74850]:       <alias name='balloon0'/>
Nov 14 00:51:53 user nova-compute[74850]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 00:51:53 user nova-compute[74850]:     </memballoon>
Nov 14 00:51:53 user nova-compute[74850]:     <rng model='virtio'>
Nov 14 00:51:53 user nova-compute[74850]:       <backend model='random'>/dev/urandom</backend>
Nov 14 00:51:53 user nova-compute[74850]:       <alias name='rng0'/>
Nov 14 00:51:53 user nova-compute[74850]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 00:51:53 user nova-compute[74850]:     </rng>
Nov 14 00:51:53 user nova-compute[74850]:   </devices>
Nov 14 00:51:53 user nova-compute[74850]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 00:51:53 user nova-compute[74850]:     <label>libvirt-7f115ae8-49da-4bf5-ae7c-62696769420c</label>
Nov 14 00:51:53 user nova-compute[74850]:     <imagelabel>libvirt-7f115ae8-49da-4bf5-ae7c-62696769420c</imagelabel>
Nov 14 00:51:53 user nova-compute[74850]:   </seclabel>
Nov 14 00:51:53 user nova-compute[74850]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 00:51:53 user nova-compute[74850]:     <label>+64055:+108</label>
Nov 14 00:51:53 user nova-compute[74850]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 00:51:53 user nova-compute[74850]:   </seclabel>
Nov 14 00:51:53 user nova-compute[74850]: </domain>
Nov 14 00:51:53 user nova-compute[74850]:  {{(pid=74850) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 00:51:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [req-3f0b904f-930e-447f-ba85-ecc70cc8937d req-88608817-cb33-43b8-81be-3cf830c2ce49 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:a4:51:b4"/><model type="virtio"/><mtu size="1442"/><target dev="tap8911f309-77"/></interface> {{(pid=74850) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 00:51:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [req-3f0b904f-930e-447f-ba85-ecc70cc8937d req-88608817-cb33-43b8-81be-3cf830c2ce49 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:a4:51:b4"/><model type="virtio"/><mtu size="1442"/><target dev="tap8911f309-77"/></interface>not found in domain: <domain type='kvm' id='19'>
Nov 14 00:51:53 user nova-compute[74850]:   <name>instance-00000011</name>
Nov 14 00:51:53 user nova-compute[74850]:   <uuid>7f115ae8-49da-4bf5-ae7c-62696769420c</uuid>
Nov 14 00:51:53 user nova-compute[74850]:   <metadata>
Nov 14 00:51:53 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:51:53 user nova-compute[74850]:   <nova:package version="0.0.0"/>
Nov 14 00:51:53 user nova-compute[74850]:   <nova:name>tempest-device-tagging-server-622477935</nova:name>
Nov 14 00:51:53 user nova-compute[74850]:   <nova:creationTime>2023-11-14 00:51:52</nova:creationTime>
Nov 14 00:51:53 user nova-compute[74850]:   <nova:flavor name="m1.tiny">
Nov 14 00:51:53 user nova-compute[74850]:     <nova:memory>512</nova:memory>
Nov 14 00:51:53 user nova-compute[74850]:     <nova:disk>1</nova:disk>
Nov 14 00:51:53 user nova-compute[74850]:     <nova:swap>0</nova:swap>
Nov 14 00:51:53 user nova-compute[74850]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:51:53 user nova-compute[74850]:     <nova:vcpus>1</nova:vcpus>
Nov 14 00:51:53 user nova-compute[74850]:   </nova:flavor>
Nov 14 00:51:53 user nova-compute[74850]:   <nova:owner>
Nov 14 00:51:53 user nova-compute[74850]:     <nova:user uuid="cebab0c5f0c74784a0d09a696a9b62d8">tempest-TaggedAttachmentsTest-1948159451-project-member</nova:user>
Nov 14 00:51:53 user nova-compute[74850]:     <nova:project uuid="b29bf565027342a8ac084f1fd0a9b3f5">tempest-TaggedAttachmentsTest-1948159451</nova:project>
Nov 14 00:51:53 user nova-compute[74850]:   </nova:owner>
Nov 14 00:51:53 user nova-compute[74850]:   <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:51:53 user nova-compute[74850]:   <nova:ports>
Nov 14 00:51:53 user nova-compute[74850]:     <nova:port uuid="667273cd-1700-465f-895e-6a1a093f44d8">
Nov 14 00:51:53 user nova-compute[74850]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 00:51:53 user nova-compute[74850]:     </nova:port>
Nov 14 00:51:53 user nova-compute[74850]:   </nova:ports>
Nov 14 00:51:53 user nova-compute[74850]: </nova:instance>
Nov 14 00:51:53 user nova-compute[74850]:   </metadata>
Nov 14 00:51:53 user nova-compute[74850]:   <memory unit='KiB'>524288</memory>
Nov 14 00:51:53 user nova-compute[74850]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 00:51:53 user nova-compute[74850]:   <vcpu placement='static'>1</vcpu>
Nov 14 00:51:53 user nova-compute[74850]:   <resource>
Nov 14 00:51:53 user nova-compute[74850]:     <partition>/machine</partition>
Nov 14 00:51:53 user nova-compute[74850]:   </resource>
Nov 14 00:51:53 user nova-compute[74850]:   <sysinfo type='smbios'>
Nov 14 00:51:53 user nova-compute[74850]:     <system>
Nov 14 00:51:53 user nova-compute[74850]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 00:51:53 user nova-compute[74850]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 00:51:53 user nova-compute[74850]:       <entry name='version'>0.0.0</entry>
Nov 14 00:51:53 user nova-compute[74850]:       <entry name='serial'>7f115ae8-49da-4bf5-ae7c-62696769420c</entry>
Nov 14 00:51:53 user nova-compute[74850]:       <entry name='uuid'>7f115ae8-49da-4bf5-ae7c-62696769420c</entry>
Nov 14 00:51:53 user nova-compute[74850]:       <entry name='family'>Virtual Machine</entry>
Nov 14 00:51:53 user nova-compute[74850]:     </system>
Nov 14 00:51:53 user nova-compute[74850]:   </sysinfo>
Nov 14 00:51:53 user nova-compute[74850]:   <os>
Nov 14 00:51:53 user nova-compute[74850]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 00:51:53 user nova-compute[74850]:     <boot dev='hd'/>
Nov 14 00:51:53 user nova-compute[74850]:     <smbios mode='sysinfo'/>
Nov 14 00:51:53 user nova-compute[74850]:   </os>
Nov 14 00:51:53 user nova-compute[74850]:   <features>
Nov 14 00:51:53 user nova-compute[74850]:     <acpi/>
Nov 14 00:51:53 user nova-compute[74850]:     <apic/>
Nov 14 00:51:53 user nova-compute[74850]:     <vmcoreinfo state='on'/>
Nov 14 00:51:53 user nova-compute[74850]:   </features>
Nov 14 00:51:53 user nova-compute[74850]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 00:51:53 user nova-compute[74850]:     <model fallback='forbid'>Nehalem</model>
Nov 14 00:51:53 user nova-compute[74850]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 00:51:53 user nova-compute[74850]:     <feature policy='require' name='vme'/>
Nov 14 00:51:53 user nova-compute[74850]:     <feature policy='require' name='x2apic'/>
Nov 14 00:51:53 user nova-compute[74850]:     <feature policy='require' name='hypervisor'/>
Nov 14 00:51:53 user nova-compute[74850]:   </cpu>
Nov 14 00:51:53 user nova-compute[74850]:   <clock offset='utc'>
Nov 14 00:51:53 user nova-compute[74850]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 00:51:53 user nova-compute[74850]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 00:51:53 user nova-compute[74850]:     <timer name='hpet' present='no'/>
Nov 14 00:51:53 user nova-compute[74850]:   </clock>
Nov 14 00:51:53 user nova-compute[74850]:   <on_poweroff>destroy</on_poweroff>
Nov 14 00:51:53 user nova-compute[74850]:   <on_reboot>restart</on_reboot>
Nov 14 00:51:53 user nova-compute[74850]:   <on_crash>destroy</on_crash>
Nov 14 00:51:53 user nova-compute[74850]:   <devices>
Nov 14 00:51:53 user nova-compute[74850]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 00:51:53 user nova-compute[74850]:     <disk type='file' device='disk'>
Nov 14 00:51:53 user nova-compute[74850]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 00:51:53 user nova-compute[74850]:       <source file='/opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/disk' index='2'/>
Nov 14 00:51:53 user nova-compute[74850]:       <backingStore type='file' index='3'>
Nov 14 00:51:53 user nova-compute[74850]:         <format type='raw'/>
Nov 14 00:51:53 user nova-compute[74850]:         <source file='/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549'/>
Nov 14 00:51:53 user nova-compute[74850]:         <backingStore/>
Nov 14 00:51:53 user nova-compute[74850]:       </backingStore>
Nov 14 00:51:53 user nova-compute[74850]:       <target dev='vda' bus='virtio'/>
Nov 14 00:51:53 user nova-compute[74850]:       <alias name='virtio-disk0'/>
Nov 14 00:51:53 user nova-compute[74850]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 00:51:53 user nova-compute[74850]:     </disk>
Nov 14 00:51:53 user nova-compute[74850]:     <disk type='file' device='cdrom'>
Nov 14 00:51:53 user nova-compute[74850]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 00:51:53 user nova-compute[74850]:       <source file='/opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/disk.config' index='1'/>
Nov 14 00:51:53 user nova-compute[74850]:       <backingStore/>
Nov 14 00:51:53 user nova-compute[74850]:       <target dev='hda' bus='ide'/>
Nov 14 00:51:53 user nova-compute[74850]:       <readonly/>
Nov 14 00:51:53 user nova-compute[74850]:       <alias name='ide0-0-0'/>
Nov 14 00:51:53 user nova-compute[74850]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 00:51:53 user nova-compute[74850]:     </disk>
Nov 14 00:51:53 user nova-compute[74850]:     <controller type='usb' index='0' model='none'>
Nov 14 00:51:53 user nova-compute[74850]:       <alias name='usb'/>
Nov 14 00:51:53 user nova-compute[74850]:     </controller>
Nov 14 00:51:53 user nova-compute[74850]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 00:51:53 user nova-compute[74850]:       <alias name='pci.0'/>
Nov 14 00:51:53 user nova-compute[74850]:     </controller>
Nov 14 00:51:53 user nova-compute[74850]:     <controller type='ide' index='0'>
Nov 14 00:51:53 user nova-compute[74850]:       <alias name='ide'/>
Nov 14 00:51:53 user nova-compute[74850]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 00:51:53 user nova-compute[74850]:     </controller>
Nov 14 00:51:53 user nova-compute[74850]:     <interface type='ethernet'>
Nov 14 00:51:53 user nova-compute[74850]:       <mac address='fa:16:3e:d1:ab:73'/>
Nov 14 00:51:53 user nova-compute[74850]:       <target dev='tap667273cd-17'/>
Nov 14 00:51:53 user nova-compute[74850]:       <model type='virtio'/>
Nov 14 00:51:53 user nova-compute[74850]:       <mtu size='1442'/>
Nov 14 00:51:53 user nova-compute[74850]:       <alias name='net0'/>
Nov 14 00:51:53 user nova-compute[74850]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 00:51:53 user nova-compute[74850]:     </interface>
Nov 14 00:51:53 user nova-compute[74850]:     <serial type='pty'>
Nov 14 00:51:53 user nova-compute[74850]:       <source path='/dev/pts/0'/>
Nov 14 00:51:53 user nova-compute[74850]:       <log file='/opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/console.log' append='off'/>
Nov 14 00:51:53 user nova-compute[74850]:       <target type='isa-serial' port='0'>
Nov 14 00:51:53 user nova-compute[74850]:         <model name='isa-serial'/>
Nov 14 00:51:53 user nova-compute[74850]:       </target>
Nov 14 00:51:53 user nova-compute[74850]:       <alias name='serial0'/>
Nov 14 00:51:53 user nova-compute[74850]:     </serial>
Nov 14 00:51:53 user nova-compute[74850]:     <console type='pty' tty='/dev/pts/0'>
Nov 14 00:51:53 user nova-compute[74850]:       <source path='/dev/pts/0'/>
Nov 14 00:51:53 user nova-compute[74850]:       <log file='/opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c/console.log' append='off'/>
Nov 14 00:51:53 user nova-compute[74850]:       <target type='serial' port='0'/>
Nov 14 00:51:53 user nova-compute[74850]:       <alias name='serial0'/>
Nov 14 00:51:53 user nova-compute[74850]:     </console>
Nov 14 00:51:53 user nova-compute[74850]:     <input type='mouse' bus='ps2'>
Nov 14 00:51:53 user nova-compute[74850]:       <alias name='input0'/>
Nov 14 00:51:53 user nova-compute[74850]:     </input>
Nov 14 00:51:53 user nova-compute[74850]:     <input type='keyboard' bus='ps2'>
Nov 14 00:51:53 user nova-compute[74850]:       <alias name='input1'/>
Nov 14 00:51:53 user nova-compute[74850]:     </input>
Nov 14 00:51:53 user nova-compute[74850]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 14 00:51:53 user nova-compute[74850]:       <listen type='address' address='0.0.0.0'/>
Nov 14 00:51:53 user nova-compute[74850]:     </graphics>
Nov 14 00:51:53 user nova-compute[74850]:     <audio id='1' type='none'/>
Nov 14 00:51:53 user nova-compute[74850]:     <video>
Nov 14 00:51:53 user nova-compute[74850]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 00:51:53 user nova-compute[74850]:       <alias name='video0'/>
Nov 14 00:51:53 user nova-compute[74850]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 00:51:53 user nova-compute[74850]:     </video>
Nov 14 00:51:53 user nova-compute[74850]:     <memballoon model='virtio'>
Nov 14 00:51:53 user nova-compute[74850]:       <stats period='10'/>
Nov 14 00:51:53 user nova-compute[74850]:       <alias name='balloon0'/>
Nov 14 00:51:53 user nova-compute[74850]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 00:51:53 user nova-compute[74850]:     </memballoon>
Nov 14 00:51:53 user nova-compute[74850]:     <rng model='virtio'>
Nov 14 00:51:53 user nova-compute[74850]:       <backend model='random'>/dev/urandom</backend>
Nov 14 00:51:53 user nova-compute[74850]:       <alias name='rng0'/>
Nov 14 00:51:53 user nova-compute[74850]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 00:51:53 user nova-compute[74850]:     </rng>
Nov 14 00:51:53 user nova-compute[74850]:   </devices>
Nov 14 00:51:53 user nova-compute[74850]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 00:51:53 user nova-compute[74850]:     <label>libvirt-7f115ae8-49da-4bf5-ae7c-62696769420c</label>
Nov 14 00:51:53 user nova-compute[74850]:     <imagelabel>libvirt-7f115ae8-49da-4bf5-ae7c-62696769420c</imagelabel>
Nov 14 00:51:53 user nova-compute[74850]:   </seclabel>
Nov 14 00:51:53 user nova-compute[74850]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 00:51:53 user nova-compute[74850]:     <label>+64055:+108</label>
Nov 14 00:51:53 user nova-compute[74850]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 00:51:53 user nova-compute[74850]:   </seclabel>
Nov 14 00:51:53 user nova-compute[74850]: </domain>
Nov 14 00:51:53 user nova-compute[74850]:  {{(pid=74850) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 00:51:53 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [req-3f0b904f-930e-447f-ba85-ecc70cc8937d req-88608817-cb33-43b8-81be-3cf830c2ce49 service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Detaching interface fa:16:3e:a4:51:b4 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap8911f309-77' not found.
Nov 14 00:51:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [req-3f0b904f-930e-447f-ba85-ecc70cc8937d req-88608817-cb33-43b8-81be-3cf830c2ce49 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-622477935',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-622477935',id=17,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBGvhns7XWVf/haNp2AKmH5EhvuBpoE+TGi/Wza7qjLEHR4vfwIGfr3qwoxrfGTiid4eBr+1xVTKisgYQUIZxBKIACazg/Q7FT120267dvZKdM6cwjXC2T4hWuncWpIGw==',key_name='tempest-keypair-783468073',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:49:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b29bf565027342a8ac084f1fd0a9b3f5',ramdisk_id='',reservation_id='r-n5valy8w',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1948159451',owner_user_name='tempest-TaggedAttachmentsTest-1948159451-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:49:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cebab0c5f0c74784a0d09a696a9b62d8',uuid=7f115ae8-49da-4bf5-ae7c-62696769420c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8911f309-779d-4df0-a8bd-ead798ceb829", "address": "fa:16:3e:a4:51:b4", "network": {"id": "0f67cb75-70fd-41b7-b210-2a7c909da154", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1304810839", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b29bf565027342a8ac084f1fd0a9b3f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8911f309-77", "ovs_interfaceid": "8911f309-779d-4df0-a8bd-ead798ceb829", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:51:53 user nova-compute[74850]: DEBUG nova.network.os_vif_util [req-3f0b904f-930e-447f-ba85-ecc70cc8937d req-88608817-cb33-43b8-81be-3cf830c2ce49 service nova] Converting VIF {"id": "8911f309-779d-4df0-a8bd-ead798ceb829", "address": "fa:16:3e:a4:51:b4", "network": {"id": "0f67cb75-70fd-41b7-b210-2a7c909da154", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1304810839", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b29bf565027342a8ac084f1fd0a9b3f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8911f309-77", "ovs_interfaceid": "8911f309-779d-4df0-a8bd-ead798ceb829", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:51:53 user nova-compute[74850]: DEBUG nova.network.os_vif_util [req-3f0b904f-930e-447f-ba85-ecc70cc8937d req-88608817-cb33-43b8-81be-3cf830c2ce49 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:51:b4,bridge_name='br-int',has_traffic_filtering=True,id=8911f309-779d-4df0-a8bd-ead798ceb829,network=Network(0f67cb75-70fd-41b7-b210-2a7c909da154),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8911f309-77') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:51:53 user nova-compute[74850]: DEBUG os_vif [req-3f0b904f-930e-447f-ba85-ecc70cc8937d req-88608817-cb33-43b8-81be-3cf830c2ce49 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:51:b4,bridge_name='br-int',has_traffic_filtering=True,id=8911f309-779d-4df0-a8bd-ead798ceb829,network=Network(0f67cb75-70fd-41b7-b210-2a7c909da154),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8911f309-77') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:51:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8911f309-77, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:51:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:51:53 user nova-compute[74850]: INFO os_vif [req-3f0b904f-930e-447f-ba85-ecc70cc8937d req-88608817-cb33-43b8-81be-3cf830c2ce49 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:51:b4,bridge_name='br-int',has_traffic_filtering=True,id=8911f309-779d-4df0-a8bd-ead798ceb829,network=Network(0f67cb75-70fd-41b7-b210-2a7c909da154),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8911f309-77')
Nov 14 00:51:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [req-3f0b904f-930e-447f-ba85-ecc70cc8937d req-88608817-cb33-43b8-81be-3cf830c2ce49 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:51:53 user nova-compute[74850]:   <nova:package version="0.0.0"/>
Nov 14 00:51:53 user nova-compute[74850]:   <nova:name>tempest-device-tagging-server-622477935</nova:name>
Nov 14 00:51:53 user nova-compute[74850]:   <nova:creationTime>2023-11-14 00:51:53</nova:creationTime>
Nov 14 00:51:53 user nova-compute[74850]:   <nova:flavor name="m1.tiny">
Nov 14 00:51:53 user nova-compute[74850]:     <nova:memory>512</nova:memory>
Nov 14 00:51:53 user nova-compute[74850]:     <nova:disk>1</nova:disk>
Nov 14 00:51:53 user nova-compute[74850]:     <nova:swap>0</nova:swap>
Nov 14 00:51:53 user nova-compute[74850]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:51:53 user nova-compute[74850]:     <nova:vcpus>1</nova:vcpus>
Nov 14 00:51:53 user nova-compute[74850]:   </nova:flavor>
Nov 14 00:51:53 user nova-compute[74850]:   <nova:owner>
Nov 14 00:51:53 user nova-compute[74850]:     <nova:user uuid="cebab0c5f0c74784a0d09a696a9b62d8">tempest-TaggedAttachmentsTest-1948159451-project-member</nova:user>
Nov 14 00:51:53 user nova-compute[74850]:     <nova:project uuid="b29bf565027342a8ac084f1fd0a9b3f5">tempest-TaggedAttachmentsTest-1948159451</nova:project>
Nov 14 00:51:53 user nova-compute[74850]:   </nova:owner>
Nov 14 00:51:53 user nova-compute[74850]:   <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:51:53 user nova-compute[74850]:   <nova:ports>
Nov 14 00:51:53 user nova-compute[74850]:     <nova:port uuid="667273cd-1700-465f-895e-6a1a093f44d8">
Nov 14 00:51:53 user nova-compute[74850]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 00:51:53 user nova-compute[74850]:     </nova:port>
Nov 14 00:51:53 user nova-compute[74850]:   </nova:ports>
Nov 14 00:51:53 user nova-compute[74850]: </nova:instance>
Nov 14 00:51:53 user nova-compute[74850]:  {{(pid=74850) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 00:51:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance a70d0196-f90e-47c4-be67-bf7ef4c3d8c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:51:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 1879be4c-9226-4c8c-a56c-f8e37398851b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:51:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 4f1102c5-f5ef-48d5-b271-6e25bee5cc70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:51:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 7f115ae8-49da-4bf5-ae7c-62696769420c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:51:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 4b60ac08-e954-46d5-a280-a11146b3ebf4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:51:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance a62a2eab-2502-4275-948b-3f18c3fcff36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:51:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 748d0da7-bbb9-4e86-aae3-e48b1fa04c14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:51:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 1f3a0b8f-1591-49c8-afb1-88437d65fb75 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:51:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance e2f305e1-7092-4e8a-bb47-a15c89388eb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:51:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 4474ad0e-8eee-4db4-9896-50c049d45d26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:51:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 00:51:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 00:51:53 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Refreshing inventories for resource provider fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 00:51:53 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Updating ProviderTree inventory for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 00:51:53 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Updating inventory in ProviderTree for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 00:51:53 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Refreshing aggregate associations for resource provider fe703abb-f68c-420d-a7f0-bf5240e23c54, aggregates: None {{(pid=74850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 00:51:53 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Refreshing trait associations for resource provider fe703abb-f68c-420d-a7f0-bf5240e23c54, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 00:51:53 user nova-compute[74850]: DEBUG nova.network.neutron [None req-76d05301-5d78-472e-a752-c18395eaa46d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Updating instance_info_cache with network_info: [{"id": "667273cd-1700-465f-895e-6a1a093f44d8", "address": "fa:16:3e:d1:ab:73", "network": {"id": "db78a7e7-17dd-4ef3-940d-96d93df45daa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1114583145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b29bf565027342a8ac084f1fd0a9b3f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap667273cd-17", "ovs_interfaceid": "667273cd-1700-465f-895e-6a1a093f44d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:51:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-76d05301-5d78-472e-a752-c18395eaa46d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Releasing lock "refresh_cache-7f115ae8-49da-4bf5-ae7c-62696769420c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:51:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-76d05301-5d78-472e-a752-c18395eaa46d tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lock "interface-7f115ae8-49da-4bf5-ae7c-62696769420c-8911f309-779d-4df0-a8bd-ead798ceb829" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.073s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:51:54 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:51:54 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:51:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 00:51:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.761s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:51:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:51:55 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:51:55 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:51:55 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 00:51:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "refresh_cache-1879be4c-9226-4c8c-a56c-f8e37398851b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:51:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquired lock "refresh_cache-1879be4c-9226-4c8c-a56c-f8e37398851b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:51:55 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Forcefully refreshing network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 00:51:55 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Updating instance_info_cache with network_info: [{"id": "ff543781-9ab0-418a-ab62-1a74ee0ed1a9", "address": "fa:16:3e:04:e7:ab", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff543781-9a", "ovs_interfaceid": "ff543781-9ab0-418a-ab62-1a74ee0ed1a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:51:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Releasing lock "refresh_cache-1879be4c-9226-4c8c-a56c-f8e37398851b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:51:55 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Updated the network info_cache for instance {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 00:51:55 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:51:55 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:51:55 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:51:55 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 00:51:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:15 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:22 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-8d4c977b-4995-4dad-bc27-c228f32a5e8f tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Acquiring lock "7f115ae8-49da-4bf5-ae7c-62696769420c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:52:22 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-8d4c977b-4995-4dad-bc27-c228f32a5e8f tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lock "7f115ae8-49da-4bf5-ae7c-62696769420c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:52:22 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-8d4c977b-4995-4dad-bc27-c228f32a5e8f tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Acquiring lock "7f115ae8-49da-4bf5-ae7c-62696769420c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:52:22 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-8d4c977b-4995-4dad-bc27-c228f32a5e8f tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lock "7f115ae8-49da-4bf5-ae7c-62696769420c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:52:22 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-8d4c977b-4995-4dad-bc27-c228f32a5e8f tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lock "7f115ae8-49da-4bf5-ae7c-62696769420c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:52:22 user nova-compute[74850]: INFO nova.compute.manager [None req-8d4c977b-4995-4dad-bc27-c228f32a5e8f tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Terminating instance
Nov 14 00:52:22 user nova-compute[74850]: DEBUG nova.compute.manager [None req-8d4c977b-4995-4dad-bc27-c228f32a5e8f tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 00:52:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:23 user nova-compute[74850]: DEBUG nova.compute.manager [req-5232e774-1d67-4454-9b34-7fe9ac68a45d req-438b759c-a02d-4122-8c50-f44caac3b489 service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Received event network-vif-unplugged-667273cd-1700-465f-895e-6a1a093f44d8 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:52:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5232e774-1d67-4454-9b34-7fe9ac68a45d req-438b759c-a02d-4122-8c50-f44caac3b489 service nova] Acquiring lock "7f115ae8-49da-4bf5-ae7c-62696769420c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:52:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5232e774-1d67-4454-9b34-7fe9ac68a45d req-438b759c-a02d-4122-8c50-f44caac3b489 service nova] Lock "7f115ae8-49da-4bf5-ae7c-62696769420c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:52:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5232e774-1d67-4454-9b34-7fe9ac68a45d req-438b759c-a02d-4122-8c50-f44caac3b489 service nova] Lock "7f115ae8-49da-4bf5-ae7c-62696769420c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:52:23 user nova-compute[74850]: DEBUG nova.compute.manager [req-5232e774-1d67-4454-9b34-7fe9ac68a45d req-438b759c-a02d-4122-8c50-f44caac3b489 service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] No waiting events found dispatching network-vif-unplugged-667273cd-1700-465f-895e-6a1a093f44d8 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:52:23 user nova-compute[74850]: DEBUG nova.compute.manager [req-5232e774-1d67-4454-9b34-7fe9ac68a45d req-438b759c-a02d-4122-8c50-f44caac3b489 service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Received event network-vif-unplugged-667273cd-1700-465f-895e-6a1a093f44d8 for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 00:52:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:23 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Instance destroyed successfully.
Nov 14 00:52:23 user nova-compute[74850]: DEBUG nova.objects.instance [None req-8d4c977b-4995-4dad-bc27-c228f32a5e8f tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lazy-loading 'resources' on Instance uuid 7f115ae8-49da-4bf5-ae7c-62696769420c {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:52:23 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-8d4c977b-4995-4dad-bc27-c228f32a5e8f tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T00:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-622477935',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-622477935',id=17,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBGvhns7XWVf/haNp2AKmH5EhvuBpoE+TGi/Wza7qjLEHR4vfwIGfr3qwoxrfGTiid4eBr+1xVTKisgYQUIZxBKIACazg/Q7FT120267dvZKdM6cwjXC2T4hWuncWpIGw==',key_name='tempest-keypair-783468073',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:49:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b29bf565027342a8ac084f1fd0a9b3f5',ramdisk_id='',reservation_id='r-n5valy8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1948159451',owner_user_name='tempest-TaggedAttachmentsTest-1948159451-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:49:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cebab0c5f0c74784a0d09a696a9b62d8',uuid=7f115ae8-49da-4bf5-ae7c-62696769420c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "667273cd-1700-465f-895e-6a1a093f44d8", "address": "fa:16:3e:d1:ab:73", "network": {"id": "db78a7e7-17dd-4ef3-940d-96d93df45daa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1114583145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b29bf565027342a8ac084f1fd0a9b3f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap667273cd-17", "ovs_interfaceid": "667273cd-1700-465f-895e-6a1a093f44d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:52:23 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-8d4c977b-4995-4dad-bc27-c228f32a5e8f tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Converting VIF {"id": "667273cd-1700-465f-895e-6a1a093f44d8", "address": "fa:16:3e:d1:ab:73", "network": {"id": "db78a7e7-17dd-4ef3-940d-96d93df45daa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1114583145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b29bf565027342a8ac084f1fd0a9b3f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap667273cd-17", "ovs_interfaceid": "667273cd-1700-465f-895e-6a1a093f44d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:52:23 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-8d4c977b-4995-4dad-bc27-c228f32a5e8f tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:ab:73,bridge_name='br-int',has_traffic_filtering=True,id=667273cd-1700-465f-895e-6a1a093f44d8,network=Network(db78a7e7-17dd-4ef3-940d-96d93df45daa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap667273cd-17') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:52:23 user nova-compute[74850]: DEBUG os_vif [None req-8d4c977b-4995-4dad-bc27-c228f32a5e8f tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:ab:73,bridge_name='br-int',has_traffic_filtering=True,id=667273cd-1700-465f-895e-6a1a093f44d8,network=Network(db78a7e7-17dd-4ef3-940d-96d93df45daa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap667273cd-17') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:52:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap667273cd-17, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:52:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:52:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7585c258-497a-4ebd-9c89-6538157d85b9) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:52:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:52:23 user nova-compute[74850]: INFO os_vif [None req-8d4c977b-4995-4dad-bc27-c228f32a5e8f tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:ab:73,bridge_name='br-int',has_traffic_filtering=True,id=667273cd-1700-465f-895e-6a1a093f44d8,network=Network(db78a7e7-17dd-4ef3-940d-96d93df45daa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap667273cd-17')
Nov 14 00:52:23 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-8d4c977b-4995-4dad-bc27-c228f32a5e8f tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Deleting instance files /opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c_del
Nov 14 00:52:23 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-8d4c977b-4995-4dad-bc27-c228f32a5e8f tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Deletion of /opt/stack/data/nova/instances/7f115ae8-49da-4bf5-ae7c-62696769420c_del complete
Nov 14 00:52:23 user nova-compute[74850]: INFO nova.compute.manager [None req-8d4c977b-4995-4dad-bc27-c228f32a5e8f tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 14 00:52:23 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-8d4c977b-4995-4dad-bc27-c228f32a5e8f tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 00:52:23 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 00:52:23 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 00:52:24 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:52:24 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Took 0.66 seconds to deallocate network for instance.
Nov 14 00:52:24 user nova-compute[74850]: DEBUG nova.compute.manager [req-7dfc937b-3c51-4a6f-8bd5-a73a93ee3d13 req-f40314af-bda1-4efc-b7b6-e02cf9598085 service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Received event network-vif-deleted-667273cd-1700-465f-895e-6a1a093f44d8 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:52:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-8d4c977b-4995-4dad-bc27-c228f32a5e8f tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:52:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-8d4c977b-4995-4dad-bc27-c228f32a5e8f tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:52:24 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-8d4c977b-4995-4dad-bc27-c228f32a5e8f tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:52:24 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-8d4c977b-4995-4dad-bc27-c228f32a5e8f tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:52:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-8d4c977b-4995-4dad-bc27-c228f32a5e8f tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:52:24 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-8d4c977b-4995-4dad-bc27-c228f32a5e8f tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Deleted allocations for instance 7f115ae8-49da-4bf5-ae7c-62696769420c
Nov 14 00:52:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-8d4c977b-4995-4dad-bc27-c228f32a5e8f tempest-TaggedAttachmentsTest-1948159451 tempest-TaggedAttachmentsTest-1948159451-project-member] Lock "7f115ae8-49da-4bf5-ae7c-62696769420c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.087s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:52:25 user nova-compute[74850]: DEBUG nova.compute.manager [req-ca7d8c65-4b94-4a53-a8e5-87d990899ca2 req-d17c7304-764f-4305-bae5-a7681094d349 service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Received event network-vif-plugged-667273cd-1700-465f-895e-6a1a093f44d8 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:52:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ca7d8c65-4b94-4a53-a8e5-87d990899ca2 req-d17c7304-764f-4305-bae5-a7681094d349 service nova] Acquiring lock "7f115ae8-49da-4bf5-ae7c-62696769420c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:52:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ca7d8c65-4b94-4a53-a8e5-87d990899ca2 req-d17c7304-764f-4305-bae5-a7681094d349 service nova] Lock "7f115ae8-49da-4bf5-ae7c-62696769420c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:52:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ca7d8c65-4b94-4a53-a8e5-87d990899ca2 req-d17c7304-764f-4305-bae5-a7681094d349 service nova] Lock "7f115ae8-49da-4bf5-ae7c-62696769420c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:52:25 user nova-compute[74850]: DEBUG nova.compute.manager [req-ca7d8c65-4b94-4a53-a8e5-87d990899ca2 req-d17c7304-764f-4305-bae5-a7681094d349 service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] No waiting events found dispatching network-vif-plugged-667273cd-1700-465f-895e-6a1a093f44d8 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:52:25 user nova-compute[74850]: WARNING nova.compute.manager [req-ca7d8c65-4b94-4a53-a8e5-87d990899ca2 req-d17c7304-764f-4305-bae5-a7681094d349 service nova] [instance: 7f115ae8-49da-4bf5-ae7c-62696769420c] Received unexpected event network-vif-plugged-667273cd-1700-465f-895e-6a1a093f44d8 for instance with vm_state deleted and task_state None.
Nov 14 00:52:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:27 user nova-compute[74850]: DEBUG nova.compute.manager [req-56a4c4c3-fb12-4cc9-877c-a9a958528830 req-623823ca-1ec0-4413-9f28-5de2577000bf service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Received event network-changed-b3afdbc0-4840-47bb-b5f9-71944340f04b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:52:27 user nova-compute[74850]: DEBUG nova.compute.manager [req-56a4c4c3-fb12-4cc9-877c-a9a958528830 req-623823ca-1ec0-4413-9f28-5de2577000bf service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Refreshing instance network info cache due to event network-changed-b3afdbc0-4840-47bb-b5f9-71944340f04b. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:52:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-56a4c4c3-fb12-4cc9-877c-a9a958528830 req-623823ca-1ec0-4413-9f28-5de2577000bf service nova] Acquiring lock "refresh_cache-1f3a0b8f-1591-49c8-afb1-88437d65fb75" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:52:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-56a4c4c3-fb12-4cc9-877c-a9a958528830 req-623823ca-1ec0-4413-9f28-5de2577000bf service nova] Acquired lock "refresh_cache-1f3a0b8f-1591-49c8-afb1-88437d65fb75" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:52:27 user nova-compute[74850]: DEBUG nova.network.neutron [req-56a4c4c3-fb12-4cc9-877c-a9a958528830 req-623823ca-1ec0-4413-9f28-5de2577000bf service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Refreshing network info cache for port b3afdbc0-4840-47bb-b5f9-71944340f04b {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:52:27 user nova-compute[74850]: DEBUG nova.network.neutron [req-56a4c4c3-fb12-4cc9-877c-a9a958528830 req-623823ca-1ec0-4413-9f28-5de2577000bf service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Updated VIF entry in instance network info cache for port b3afdbc0-4840-47bb-b5f9-71944340f04b. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:52:27 user nova-compute[74850]: DEBUG nova.network.neutron [req-56a4c4c3-fb12-4cc9-877c-a9a958528830 req-623823ca-1ec0-4413-9f28-5de2577000bf service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Updating instance_info_cache with network_info: [{"id": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "address": "fa:16:3e:a9:ef:9b", "network": {"id": "d7fe6bb8-ec3e-4bc8-9afe-161897a805b0", "bridge": "br-int", "label": "tempest-TestShelveInstance-236791102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d04a48df2b1c42f4a0a8826c66357f28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3afdbc0-48", "ovs_interfaceid": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:52:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-56a4c4c3-fb12-4cc9-877c-a9a958528830 req-623823ca-1ec0-4413-9f28-5de2577000bf service nova] Releasing lock "refresh_cache-1f3a0b8f-1591-49c8-afb1-88437d65fb75" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:52:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Acquiring lock "1f3a0b8f-1591-49c8-afb1-88437d65fb75" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:52:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lock "1f3a0b8f-1591-49c8-afb1-88437d65fb75" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:52:27 user nova-compute[74850]: INFO nova.compute.manager [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Shelve offloading
Nov 14 00:52:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:28 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Instance destroyed successfully.
Nov 14 00:52:28 user nova-compute[74850]: DEBUG nova.compute.manager [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:52:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Acquiring lock "refresh_cache-1f3a0b8f-1591-49c8-afb1-88437d65fb75" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:52:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Acquired lock "refresh_cache-1f3a0b8f-1591-49c8-afb1-88437d65fb75" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:52:28 user nova-compute[74850]: DEBUG nova.network.neutron [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:52:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:28 user nova-compute[74850]: DEBUG nova.network.neutron [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Updating instance_info_cache with network_info: [{"id": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "address": "fa:16:3e:a9:ef:9b", "network": {"id": "d7fe6bb8-ec3e-4bc8-9afe-161897a805b0", "bridge": "br-int", "label": "tempest-TestShelveInstance-236791102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d04a48df2b1c42f4a0a8826c66357f28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3afdbc0-48", "ovs_interfaceid": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:52:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Releasing lock "refresh_cache-1f3a0b8f-1591-49c8-afb1-88437d65fb75" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG nova.compute.manager [req-4c153347-68b2-4a26-82a2-3e5051b84a6b req-ce1ea082-fba1-425d-83a1-64b6b1a7dcd4 service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Received event network-vif-unplugged-b3afdbc0-4840-47bb-b5f9-71944340f04b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-4c153347-68b2-4a26-82a2-3e5051b84a6b req-ce1ea082-fba1-425d-83a1-64b6b1a7dcd4 service nova] Acquiring lock "1f3a0b8f-1591-49c8-afb1-88437d65fb75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-4c153347-68b2-4a26-82a2-3e5051b84a6b req-ce1ea082-fba1-425d-83a1-64b6b1a7dcd4 service nova] Lock "1f3a0b8f-1591-49c8-afb1-88437d65fb75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-4c153347-68b2-4a26-82a2-3e5051b84a6b req-ce1ea082-fba1-425d-83a1-64b6b1a7dcd4 service nova] Lock "1f3a0b8f-1591-49c8-afb1-88437d65fb75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG nova.compute.manager [req-4c153347-68b2-4a26-82a2-3e5051b84a6b req-ce1ea082-fba1-425d-83a1-64b6b1a7dcd4 service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] No waiting events found dispatching network-vif-unplugged-b3afdbc0-4840-47bb-b5f9-71944340f04b {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:52:29 user nova-compute[74850]: WARNING nova.compute.manager [req-4c153347-68b2-4a26-82a2-3e5051b84a6b req-ce1ea082-fba1-425d-83a1-64b6b1a7dcd4 service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Received unexpected event network-vif-unplugged-b3afdbc0-4840-47bb-b5f9-71944340f04b for instance with vm_state active and task_state shelving.
Nov 14 00:52:29 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Instance destroyed successfully.
Nov 14 00:52:29 user nova-compute[74850]: DEBUG nova.objects.instance [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lazy-loading 'resources' on Instance uuid 1f3a0b8f-1591-49c8-afb1-88437d65fb75 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:50:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-999057832',display_name='tempest-TestShelveInstance-server-999057832',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-999057832',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPe2MCunpaIWCOf138MPN4AN0ndS8NEmSmQgzRt5Y5fsb9WbIXubhh1yAaf/vbnkIZksktAFNFaWcv6Px9mLlE23DucapJ22iB3KR+pjspwx/iLSs3EpKTn1M7OrESAuKg==',key_name='tempest-TestShelveInstance-2033278270',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:50:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d04a48df2b1c42f4a0a8826c66357f28',ramdisk_id='',reservation_id='r-cuownc8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1921981995',owner_user_name='tempest-TestShelveInstance-1921981995-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:50:48Z,user_data=None,user_id='5a8ca83acba64f15bd10d275fd053475',uuid=1f3a0b8f-1591-49c8-afb1-88437d65fb75,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "address": "fa:16:3e:a9:ef:9b", "network": {"id": "d7fe6bb8-ec3e-4bc8-9afe-161897a805b0", "bridge": "br-int", "label": "tempest-TestShelveInstance-236791102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d04a48df2b1c42f4a0a8826c66357f28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3afdbc0-48", "ovs_interfaceid": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Converting VIF {"id": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "address": "fa:16:3e:a9:ef:9b", "network": {"id": "d7fe6bb8-ec3e-4bc8-9afe-161897a805b0", "bridge": "br-int", "label": "tempest-TestShelveInstance-236791102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d04a48df2b1c42f4a0a8826c66357f28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3afdbc0-48", "ovs_interfaceid": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:ef:9b,bridge_name='br-int',has_traffic_filtering=True,id=b3afdbc0-4840-47bb-b5f9-71944340f04b,network=Network(d7fe6bb8-ec3e-4bc8-9afe-161897a805b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3afdbc0-48') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG os_vif [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:ef:9b,bridge_name='br-int',has_traffic_filtering=True,id=b3afdbc0-4840-47bb-b5f9-71944340f04b,network=Network(d7fe6bb8-ec3e-4bc8-9afe-161897a805b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3afdbc0-48') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3afdbc0-48, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=274ce7ac-c629-46fc-b758-c7ccb8a855d6) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:29 user nova-compute[74850]: INFO os_vif [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:ef:9b,bridge_name='br-int',has_traffic_filtering=True,id=b3afdbc0-4840-47bb-b5f9-71944340f04b,network=Network(d7fe6bb8-ec3e-4bc8-9afe-161897a805b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3afdbc0-48')
Nov 14 00:52:29 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pEVTGKrm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:52:29 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:52:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b81d67-8674-42e7-a5bc-368bfe33b92c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 00:52:29 user nova-compute[74850]: No targets found.
Nov 14 00:52:29 user nova-compute[74850]: iSNS:
Nov 14 00:52:29 user nova-compute[74850]: No targets found.
Nov 14 00:52:29 user nova-compute[74850]: STATIC:
Nov 14 00:52:29 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390
Nov 14 00:52:29 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:52:29 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:52:29 user nova-compute[74850]: FIRMWARE:
Nov 14 00:52:29 user nova-compute[74850]: No targets found.
Nov 14 00:52:29 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 00:52:29 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 00:52:29 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4608cb-a46f-4f81-b16b-e594ce9a1282]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada46911-a28f-47de-aa73-28ec00fd8e5d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:52:29 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:52:29 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a3c735ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390'): ({'sdc'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Removing single pathed devices sdc {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b86e79-483f-4d72-977f-e76041c7489d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ff8ddd-bc9e-497f-951f-eec8041e4055]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Flushing IO for device /dev/sdc {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec463f1-ec70-4115-ac06-186635a6f091]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[26862f92-4474-472b-8e44-cd74adadbdde]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] SCSI volumes sdc have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[677f4fa6-7a8f-43a7-8082-3b7ccc6abbc9]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7546bd-e568-42b2-a39a-0f64e26490b8]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390, portal: 172.16.0.220,3260]
Nov 14 00:52:29 user nova-compute[74850]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390, portal: 172.16.0.220,3260] successful.
Nov 14 00:52:29 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4dbcc1-43e5-4a43-b206-e30c719364ce]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] <== disconnect_volume: return (280ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:52:29 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 00:52:29 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Deleting instance files /opt/stack/data/nova/instances/1f3a0b8f-1591-49c8-afb1-88437d65fb75_del
Nov 14 00:52:29 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Deletion of /opt/stack/data/nova/instances/1f3a0b8f-1591-49c8-afb1-88437d65fb75_del complete
Nov 14 00:52:30 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:30 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:30 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Deleted allocations for instance 1f3a0b8f-1591-49c8-afb1-88437d65fb75
Nov 14 00:52:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:52:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:52:30 user nova-compute[74850]: DEBUG nova.objects.instance [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lazy-loading 'numa_topology' on Instance uuid 1f3a0b8f-1591-49c8-afb1-88437d65fb75 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:52:30 user nova-compute[74850]: DEBUG nova.objects.base [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Object Instance<1f3a0b8f-1591-49c8-afb1-88437d65fb75> lazy-loaded attributes: resources,numa_topology {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 00:52:31 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:52:31 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:52:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:52:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-96d7b8b9-7e5a-45d9-b5ff-0e580b55bd42 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lock "1f3a0b8f-1591-49c8-afb1-88437d65fb75" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.543s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:52:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Acquiring lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:52:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:52:37 user nova-compute[74850]: DEBUG nova.objects.instance [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lazy-loading 'flavor' on Instance uuid 4f1102c5-f5ef-48d5-b271-6e25bee5cc70 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:52:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:52:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Acquiring lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:52:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:52:37 user nova-compute[74850]: INFO nova.compute.manager [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Attaching volume fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf to /dev/vdb
Nov 14 00:52:37 user nova-compute[74850]: DEBUG os_brick.utils [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:52:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:37 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7af2d71-d317-4c44-acfa-878d30d66936]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:37 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[726fcc0b-9915-4121-8dd2-42c0bd6a6982]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:37 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92fdd39-2121-4e6b-a83d-0c470dfdcc14]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:37 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3413726-e9f4-4e1c-974e-c3e7f58bdb95]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:52:37 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 00:52:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:52:38 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 00:52:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c3a079-49aa-4e4f-8eb7-b481c1ad7578]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 00:52:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 00:52:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 00:52:38 user nova-compute[74850]: DEBUG os_brick.utils [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:52:38 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Updating existing volume attachment record: b9172bdd-c365-4b26-b6fe-e595bc5922be {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 00:52:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Acquiring lock "57f1e010-68bf-4047-9316-0412a2c89be2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:52:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Lock "57f1e010-68bf-4047-9316-0412a2c89be2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:52:38 user nova-compute[74850]: DEBUG nova.compute.manager [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 00:52:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:52:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:52:38 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 00:52:38 user nova-compute[74850]: INFO nova.compute.claims [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Claim successful on node user
Nov 14 00:52:38 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:52:38 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:52:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:52:38 user nova-compute[74850]: DEBUG nova.compute.manager [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 00:52:38 user nova-compute[74850]: DEBUG nova.compute.manager [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 00:52:38 user nova-compute[74850]: DEBUG nova.network.neutron [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 00:52:38 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 00:52:38 user nova-compute[74850]: DEBUG nova.compute.manager [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 00:52:38 user nova-compute[74850]: DEBUG nova.policy [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4fff45c6350248c2bdcaeeb703e20d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbc81e4bfc2438bbecb30c46089cd20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 00:52:39 user nova-compute[74850]: DEBUG nova.compute.manager [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 00:52:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 00:52:39 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Creating image(s)
Nov 14 00:52:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Acquiring lock "/opt/stack/data/nova/instances/57f1e010-68bf-4047-9316-0412a2c89be2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:52:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Lock "/opt/stack/data/nova/instances/57f1e010-68bf-4047-9316-0412a2c89be2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:52:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Lock "/opt/stack/data/nova/instances/57f1e010-68bf-4047-9316-0412a2c89be2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:52:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.174s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:52:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:52:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.176s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/57f1e010-68bf-4047-9316-0412a2c89be2/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/57f1e010-68bf-4047-9316-0412a2c89be2/disk 1073741824" returned: 0 in 0.045s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:52:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:39 user nova-compute[74850]: DEBUG nova.network.neutron [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Successfully created port: ca2713af-4b11-4391-93da-9b767fea0783 {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:52:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.176s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:39 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Checking if we can resize image /opt/stack/data/nova/instances/57f1e010-68bf-4047-9316-0412a2c89be2/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 00:52:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57f1e010-68bf-4047-9316-0412a2c89be2/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57f1e010-68bf-4047-9316-0412a2c89be2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:39 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Cannot resize image /opt/stack/data/nova/instances/57f1e010-68bf-4047-9316-0412a2c89be2/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 00:52:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 00:52:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Ensure instance console log exists: /opt/stack/data/nova/instances/57f1e010-68bf-4047-9316-0412a2c89be2/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 00:52:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:52:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:52:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG nova.network.neutron [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Successfully updated port: ca2713af-4b11-4391-93da-9b767fea0783 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Acquiring lock "refresh_cache-57f1e010-68bf-4047-9316-0412a2c89be2" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Acquired lock "refresh_cache-57f1e010-68bf-4047-9316-0412a2c89be2" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG nova.network.neutron [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG nova.compute.manager [req-dccdcef4-38f3-41b2-90cc-7db5b2a91bcc req-92b98c57-be16-41bf-a619-bddf2a2270bf service nova] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Received event network-changed-ca2713af-4b11-4391-93da-9b767fea0783 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG nova.compute.manager [req-dccdcef4-38f3-41b2-90cc-7db5b2a91bcc req-92b98c57-be16-41bf-a619-bddf2a2270bf service nova] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Refreshing instance network info cache due to event network-changed-ca2713af-4b11-4391-93da-9b767fea0783. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-dccdcef4-38f3-41b2-90cc-7db5b2a91bcc req-92b98c57-be16-41bf-a619-bddf2a2270bf service nova] Acquiring lock "refresh_cache-57f1e010-68bf-4047-9316-0412a2c89be2" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG nova.network.neutron [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG nova.network.neutron [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Updating instance_info_cache with network_info: [{"id": "ca2713af-4b11-4391-93da-9b767fea0783", "address": "fa:16:3e:34:bf:d7", "network": {"id": "5f593e54-bb69-4d38-ba7d-496a4c0f581b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-342901959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dbc81e4bfc2438bbecb30c46089cd20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca2713af-4b", "ovs_interfaceid": "ca2713af-4b11-4391-93da-9b767fea0783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Releasing lock "refresh_cache-57f1e010-68bf-4047-9316-0412a2c89be2" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG nova.compute.manager [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Instance network_info: |[{"id": "ca2713af-4b11-4391-93da-9b767fea0783", "address": "fa:16:3e:34:bf:d7", "network": {"id": "5f593e54-bb69-4d38-ba7d-496a4c0f581b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-342901959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dbc81e4bfc2438bbecb30c46089cd20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca2713af-4b", "ovs_interfaceid": "ca2713af-4b11-4391-93da-9b767fea0783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-dccdcef4-38f3-41b2-90cc-7db5b2a91bcc req-92b98c57-be16-41bf-a619-bddf2a2270bf service nova] Acquired lock "refresh_cache-57f1e010-68bf-4047-9316-0412a2c89be2" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG nova.network.neutron [req-dccdcef4-38f3-41b2-90cc-7db5b2a91bcc req-92b98c57-be16-41bf-a619-bddf2a2270bf service nova] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Refreshing network info cache for port ca2713af-4b11-4391-93da-9b767fea0783 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Start _get_guest_xml network_info=[{"id": "ca2713af-4b11-4391-93da-9b767fea0783", "address": "fa:16:3e:34:bf:d7", "network": {"id": "5f593e54-bb69-4d38-ba7d-496a4c0f581b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-342901959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dbc81e4bfc2438bbecb30c46089cd20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca2713af-4b", "ovs_interfaceid": "ca2713af-4b11-4391-93da-9b767fea0783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:52:40 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:52:40 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:52:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:52:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1436939986',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1436939986',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1436939',id=24,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGsiKxtlTR6t2g/D8qhps8uXiJgUz2Bv/aYMQB7anB4UVZokfehc3BRcM1HjHxWQTuRELTWaDeGx+SrOEleQurvRKMMHEDWmc2ooOG0aGeW00cY5OvSRc/ZdZg6ZdllFA==',key_name='tempest-keypair-457639716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dbc81e4bfc2438bbecb30c46089cd20',ramdisk_id='',reservation_id='r-0wf2kbaj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-869872645',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:52:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fff45c6350248c2bdcaeeb703e20d13',uuid=57f1e010-68bf-4047-9316-0412a2c89be2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca2713af-4b11-4391-93da-9b767fea0783", "address": "fa:16:3e:34:bf:d7", "network": {"id": "5f593e54-bb69-4d38-ba7d-496a4c0f581b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-342901959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dbc81e4bfc2438bbecb30c46089cd20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca2713af-4b", "ovs_interfaceid": "ca2713af-4b11-4391-93da-9b767fea0783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Converting VIF {"id": "ca2713af-4b11-4391-93da-9b767fea0783", "address": "fa:16:3e:34:bf:d7", "network": {"id": "5f593e54-bb69-4d38-ba7d-496a4c0f581b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-342901959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dbc81e4bfc2438bbecb30c46089cd20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca2713af-4b", "ovs_interfaceid": "ca2713af-4b11-4391-93da-9b767fea0783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:bf:d7,bridge_name='br-int',has_traffic_filtering=True,id=ca2713af-4b11-4391-93da-9b767fea0783,network=Network(5f593e54-bb69-4d38-ba7d-496a4c0f581b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca2713af-4b') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG nova.objects.instance [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Lazy-loading 'pci_devices' on Instance uuid 57f1e010-68bf-4047-9316-0412a2c89be2 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:52:40 user nova-compute[74850]:   <uuid>57f1e010-68bf-4047-9316-0412a2c89be2</uuid>
Nov 14 00:52:40 user nova-compute[74850]:   <name>instance-00000018</name>
Nov 14 00:52:40 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:52:40 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:52:40 user nova-compute[74850]:   <metadata>
Nov 14 00:52:40 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:52:40 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:52:40 user nova-compute[74850]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1436939986</nova:name>
Nov 14 00:52:40 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:52:40</nova:creationTime>
Nov 14 00:52:40 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:52:40 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:52:40 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:52:40 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:52:40 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:52:40 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:52:40 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:52:40 user nova-compute[74850]:       <nova:owner>
Nov 14 00:52:40 user nova-compute[74850]:         <nova:user uuid="4fff45c6350248c2bdcaeeb703e20d13">tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member</nova:user>
Nov 14 00:52:40 user nova-compute[74850]:         <nova:project uuid="5dbc81e4bfc2438bbecb30c46089cd20">tempest-TestServerVolumeAttachScenarioOldVersion-869872645</nova:project>
Nov 14 00:52:40 user nova-compute[74850]:       </nova:owner>
Nov 14 00:52:40 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:52:40 user nova-compute[74850]:       <nova:ports>
Nov 14 00:52:40 user nova-compute[74850]:         <nova:port uuid="ca2713af-4b11-4391-93da-9b767fea0783">
Nov 14 00:52:40 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 00:52:40 user nova-compute[74850]:         </nova:port>
Nov 14 00:52:40 user nova-compute[74850]:       </nova:ports>
Nov 14 00:52:40 user nova-compute[74850]:     </nova:instance>
Nov 14 00:52:40 user nova-compute[74850]:   </metadata>
Nov 14 00:52:40 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:52:40 user nova-compute[74850]:     <system>
Nov 14 00:52:40 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:52:40 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:52:40 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:52:40 user nova-compute[74850]:       <entry name="serial">57f1e010-68bf-4047-9316-0412a2c89be2</entry>
Nov 14 00:52:40 user nova-compute[74850]:       <entry name="uuid">57f1e010-68bf-4047-9316-0412a2c89be2</entry>
Nov 14 00:52:40 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:52:40 user nova-compute[74850]:     </system>
Nov 14 00:52:40 user nova-compute[74850]:   </sysinfo>
Nov 14 00:52:40 user nova-compute[74850]:   <os>
Nov 14 00:52:40 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:52:40 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 00:52:40 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:52:40 user nova-compute[74850]:   </os>
Nov 14 00:52:40 user nova-compute[74850]:   <features>
Nov 14 00:52:40 user nova-compute[74850]:     <acpi/>
Nov 14 00:52:40 user nova-compute[74850]:     <apic/>
Nov 14 00:52:40 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:52:40 user nova-compute[74850]:   </features>
Nov 14 00:52:40 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:52:40 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:52:40 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:52:40 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:52:40 user nova-compute[74850]:   </clock>
Nov 14 00:52:40 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:52:40 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:52:40 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:52:40 user nova-compute[74850]:   </cpu>
Nov 14 00:52:40 user nova-compute[74850]:   <devices>
Nov 14 00:52:40 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 00:52:40 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:52:40 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/57f1e010-68bf-4047-9316-0412a2c89be2/disk"/>
Nov 14 00:52:40 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:52:40 user nova-compute[74850]:     </disk>
Nov 14 00:52:40 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:52:40 user nova-compute[74850]:       <mac address="fa:16:3e:34:bf:d7"/>
Nov 14 00:52:40 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:52:40 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:52:40 user nova-compute[74850]:       <target dev="tapca2713af-4b"/>
Nov 14 00:52:40 user nova-compute[74850]:     </interface>
Nov 14 00:52:40 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:52:40 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/57f1e010-68bf-4047-9316-0412a2c89be2/console.log" append="off"/>
Nov 14 00:52:40 user nova-compute[74850]:     </serial>
Nov 14 00:52:40 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:52:40 user nova-compute[74850]:     <video>
Nov 14 00:52:40 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:52:40 user nova-compute[74850]:     </video>
Nov 14 00:52:40 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:52:40 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:52:40 user nova-compute[74850]:     </rng>
Nov 14 00:52:40 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:52:40 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:52:40 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:52:40 user nova-compute[74850]:     </memballoon>
Nov 14 00:52:40 user nova-compute[74850]:   </devices>
Nov 14 00:52:40 user nova-compute[74850]: </domain>
Nov 14 00:52:40 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:52:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1436939986',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1436939986',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1436939',id=24,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGsiKxtlTR6t2g/D8qhps8uXiJgUz2Bv/aYMQB7anB4UVZokfehc3BRcM1HjHxWQTuRELTWaDeGx+SrOEleQurvRKMMHEDWmc2ooOG0aGeW00cY5OvSRc/ZdZg6ZdllFA==',key_name='tempest-keypair-457639716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dbc81e4bfc2438bbecb30c46089cd20',ramdisk_id='',reservation_id='r-0wf2kbaj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-869872645',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:52:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fff45c6350248c2bdcaeeb703e20d13',uuid=57f1e010-68bf-4047-9316-0412a2c89be2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca2713af-4b11-4391-93da-9b767fea0783", "address": "fa:16:3e:34:bf:d7", "network": {"id": "5f593e54-bb69-4d38-ba7d-496a4c0f581b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-342901959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dbc81e4bfc2438bbecb30c46089cd20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca2713af-4b", "ovs_interfaceid": "ca2713af-4b11-4391-93da-9b767fea0783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Converting VIF {"id": "ca2713af-4b11-4391-93da-9b767fea0783", "address": "fa:16:3e:34:bf:d7", "network": {"id": "5f593e54-bb69-4d38-ba7d-496a4c0f581b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-342901959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dbc81e4bfc2438bbecb30c46089cd20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca2713af-4b", "ovs_interfaceid": "ca2713af-4b11-4391-93da-9b767fea0783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:bf:d7,bridge_name='br-int',has_traffic_filtering=True,id=ca2713af-4b11-4391-93da-9b767fea0783,network=Network(5f593e54-bb69-4d38-ba7d-496a4c0f581b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca2713af-4b') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG os_vif [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:bf:d7,bridge_name='br-int',has_traffic_filtering=True,id=ca2713af-4b11-4391-93da-9b767fea0783,network=Network(5f593e54-bb69-4d38-ba7d-496a4c0f581b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca2713af-4b') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '67e66e76-2d43-5bbd-b31a-10ed45076e0c', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca2713af-4b, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapca2713af-4b, col_values=(('qos', UUID('6094244f-c499-47e7-a5b6-3cbfefd22f1c')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapca2713af-4b, col_values=(('external_ids', {'iface-id': 'ca2713af-4b11-4391-93da-9b767fea0783', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:bf:d7', 'vm-uuid': '57f1e010-68bf-4047-9316-0412a2c89be2'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:40 user nova-compute[74850]: INFO os_vif [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:bf:d7,bridge_name='br-int',has_traffic_filtering=True,id=ca2713af-4b11-4391-93da-9b767fea0783,network=Network(5f593e54-bb69-4d38-ba7d-496a4c0f581b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca2713af-4b')
Nov 14 00:52:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] No VIF found with MAC fa:16:3e:34:bf:d7, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG nova.network.neutron [req-dccdcef4-38f3-41b2-90cc-7db5b2a91bcc req-92b98c57-be16-41bf-a619-bddf2a2270bf service nova] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Updated VIF entry in instance network info cache for port ca2713af-4b11-4391-93da-9b767fea0783. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG nova.network.neutron [req-dccdcef4-38f3-41b2-90cc-7db5b2a91bcc req-92b98c57-be16-41bf-a619-bddf2a2270bf service nova] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Updating instance_info_cache with network_info: [{"id": "ca2713af-4b11-4391-93da-9b767fea0783", "address": "fa:16:3e:34:bf:d7", "network": {"id": "5f593e54-bb69-4d38-ba7d-496a4c0f581b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-342901959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dbc81e4bfc2438bbecb30c46089cd20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca2713af-4b", "ovs_interfaceid": "ca2713af-4b11-4391-93da-9b767fea0783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:52:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-dccdcef4-38f3-41b2-90cc-7db5b2a91bcc req-92b98c57-be16-41bf-a619-bddf2a2270bf service nova] Releasing lock "refresh_cache-57f1e010-68bf-4047-9316-0412a2c89be2" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:52:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oniPaHRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:52:42 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:52:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:52:42 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:52:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:52:42 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 00:52:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36042fe-e814-477f-a0d1-4d6d9a83869b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 00:52:42 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e539ac7-56e8-46df-8422-ba32c767d4a7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf] added
Nov 14 00:52:42 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b1ae09-be16-4091-b382-48bc7e7c1eb5]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a477f3-8716-4def-9dc2-1b6cde5580c8]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oniPaHRL {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oniPaHRL" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[164cc272-e9e3-4dcb-918e-8d51a26d4b50]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oniPaHRL'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46ad3b5-7872-4486-9533-5017de6218f0]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0796689b-1185-4429-b100-b6b6d84ddbcf]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 00:52:42 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 00:52:42 user nova-compute[74850]:  {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:52:42 user nova-compute[74850]: WARNING os_brick.initiator.connectors.iscsi [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 00:52:42 user nova-compute[74850]: 
Nov 14 00:52:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2b3ed6-6982-4707-8d97-e45b1ac76eb5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf, portal: 172.16.0.220,3260]
Nov 14 00:52:42 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf, portal: 172.16.0.220,3260] successful.
Nov 14 00:52:42 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca289fd3-f6ba-4eed-9285-d2ed1eb31067]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ef3ef7-d934-4ddb-a588-1f2417ab61a6]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:52:42 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:52:42 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62fd894-f69e-4562-96b0-61b019627f3f]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oniPaHRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG nova.compute.manager [req-9c305fda-d693-490b-b29b-8ceb094ab78e req-c5d019ce-1651-469a-ada0-fc8b35d6aa8a service nova] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Received event network-vif-plugged-ca2713af-4b11-4391-93da-9b767fea0783 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9c305fda-d693-490b-b29b-8ceb094ab78e req-c5d019ce-1651-469a-ada0-fc8b35d6aa8a service nova] Acquiring lock "57f1e010-68bf-4047-9316-0412a2c89be2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9c305fda-d693-490b-b29b-8ceb094ab78e req-c5d019ce-1651-469a-ada0-fc8b35d6aa8a service nova] Lock "57f1e010-68bf-4047-9316-0412a2c89be2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9c305fda-d693-490b-b29b-8ceb094ab78e req-c5d019ce-1651-469a-ada0-fc8b35d6aa8a service nova] Lock "57f1e010-68bf-4047-9316-0412a2c89be2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:52:42 user nova-compute[74850]: DEBUG nova.compute.manager [req-9c305fda-d693-490b-b29b-8ceb094ab78e req-c5d019ce-1651-469a-ada0-fc8b35d6aa8a service nova] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] No waiting events found dispatching network-vif-plugged-ca2713af-4b11-4391-93da-9b767fea0783 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:52:42 user nova-compute[74850]: WARNING nova.compute.manager [req-9c305fda-d693-490b-b29b-8ceb094ab78e req-c5d019ce-1651-469a-ada0-fc8b35d6aa8a service nova] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Received unexpected event network-vif-plugged-ca2713af-4b11-4391-93da-9b767fea0783 for instance with vm_state building and task_state spawning.
Nov 14 00:52:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:43 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:52:43 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23039313564393733', 'path': '/dev/sdb'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:52:43 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039313564393733', 'path': '/dev/sdb'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 00:52:43 user nova-compute[74850]: DEBUG nova.objects.instance [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lazy-loading 'flavor' on Instance uuid 4f1102c5-f5ef-48d5-b271-6e25bee5cc70 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:52:43 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 00:52:43 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:52:43 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 00:52:43 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:52:43 user nova-compute[74850]:   <serial>fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf</serial>
Nov 14 00:52:43 user nova-compute[74850]: </disk>
Nov 14 00:52:43 user nova-compute[74850]:  {{(pid=74850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 00:52:43 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:52:43 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:52:43 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] No VIF found with MAC fa:16:3e:1e:5a:e7, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:52:43 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fa34f8cc-37c5-4f73-9c28-a31743c1f2f0 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.093s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:52:44 user nova-compute[74850]: DEBUG nova.compute.manager [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:52:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 00:52:44 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Instance spawned successfully.
Nov 14 00:52:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 00:52:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:52:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:52:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:52:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:52:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:52:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:52:44 user nova-compute[74850]: INFO nova.compute.manager [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Took 5.15 seconds to spawn the instance on the hypervisor.
Nov 14 00:52:44 user nova-compute[74850]: DEBUG nova.compute.manager [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:52:44 user nova-compute[74850]: INFO nova.compute.manager [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Took 5.89 seconds to build instance.
Nov 14 00:52:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-248ffaf2-bfc3-4c84-a77e-0c9b4d50ebe0 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Lock "57f1e010-68bf-4047-9316-0412a2c89be2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.990s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:52:44 user nova-compute[74850]: DEBUG nova.compute.manager [req-6ea427ce-dbdb-4f59-80a6-ba2cc11a51a9 req-c930da2c-1eeb-4d22-9cd7-38466e81d4b7 service nova] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Received event network-vif-plugged-ca2713af-4b11-4391-93da-9b767fea0783 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:52:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6ea427ce-dbdb-4f59-80a6-ba2cc11a51a9 req-c930da2c-1eeb-4d22-9cd7-38466e81d4b7 service nova] Acquiring lock "57f1e010-68bf-4047-9316-0412a2c89be2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:52:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6ea427ce-dbdb-4f59-80a6-ba2cc11a51a9 req-c930da2c-1eeb-4d22-9cd7-38466e81d4b7 service nova] Lock "57f1e010-68bf-4047-9316-0412a2c89be2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:52:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6ea427ce-dbdb-4f59-80a6-ba2cc11a51a9 req-c930da2c-1eeb-4d22-9cd7-38466e81d4b7 service nova] Lock "57f1e010-68bf-4047-9316-0412a2c89be2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:52:44 user nova-compute[74850]: DEBUG nova.compute.manager [req-6ea427ce-dbdb-4f59-80a6-ba2cc11a51a9 req-c930da2c-1eeb-4d22-9cd7-38466e81d4b7 service nova] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] No waiting events found dispatching network-vif-plugged-ca2713af-4b11-4391-93da-9b767fea0783 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:52:44 user nova-compute[74850]: WARNING nova.compute.manager [req-6ea427ce-dbdb-4f59-80a6-ba2cc11a51a9 req-c930da2c-1eeb-4d22-9cd7-38466e81d4b7 service nova] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Received unexpected event network-vif-plugged-ca2713af-4b11-4391-93da-9b767fea0783 for instance with vm_state active and task_state None.
Nov 14 00:52:44 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:52:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Acquiring lock "4b60ac08-e954-46d5-a280-a11146b3ebf4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:52:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lock "4b60ac08-e954-46d5-a280-a11146b3ebf4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:52:44 user nova-compute[74850]: DEBUG nova.objects.instance [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lazy-loading 'flavor' on Instance uuid 4b60ac08-e954-46d5-a280-a11146b3ebf4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:52:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lock "4b60ac08-e954-46d5-a280-a11146b3ebf4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:52:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Acquiring lock "4b60ac08-e954-46d5-a280-a11146b3ebf4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:52:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lock "4b60ac08-e954-46d5-a280-a11146b3ebf4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:52:45 user nova-compute[74850]: INFO nova.compute.manager [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Attaching volume 44fa6c77-8978-4921-b98e-3c21c1e75714 to /dev/vdb
Nov 14 00:52:45 user nova-compute[74850]: DEBUG os_brick.utils [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:52:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40d83c4-6f4c-4c9e-902f-64ed4a5f067a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[796ec1d8-e147-417e-af44-b25c0d5a7664]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea85039-e74f-4fd9-927e-b2314c33b566]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d9fa1f-7666-4390-a6db-094ceea73545]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:52:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 00:52:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:52:45 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 00:52:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c8971e-d6c4-421d-8730-497fe9acded3]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 00:52:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 00:52:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 00:52:45 user nova-compute[74850]: DEBUG os_brick.utils [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:52:45 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Updating existing volume attachment record: 8458b535-9e68-4cab-8986-6e14eba516ad {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 00:52:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:46 user nova-compute[74850]: DEBUG nova.compute.manager [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Stashing vm_state: active {{(pid=74850) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 14 00:52:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:52:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:52:46 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 00:52:46 user nova-compute[74850]: INFO nova.compute.claims [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Claim successful on node user
Nov 14 00:52:46 user nova-compute[74850]: INFO nova.compute.resource_tracker [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Updating resource usage from migration 031456c4-37fc-41ea-a496-f91bcf24372d
Nov 14 00:52:46 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:52:46 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:52:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.618s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:52:46 user nova-compute[74850]: INFO nova.compute.manager [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Migrating
Nov 14 00:52:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:52:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:52:46 user nova-compute[74850]: INFO nova.compute.rpcapi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 14 00:52:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:52:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Acquiring lock "refresh_cache-4f1102c5-f5ef-48d5-b271-6e25bee5cc70" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:52:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Acquired lock "refresh_cache-4f1102c5-f5ef-48d5-b271-6e25bee5cc70" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:52:46 user nova-compute[74850]: DEBUG nova.network.neutron [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:52:47 user nova-compute[74850]: DEBUG nova.network.neutron [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Updating instance_info_cache with network_info: [{"id": "745756ea-b360-423f-8258-5339a80658b5", "address": "fa:16:3e:1e:5a:e7", "network": {"id": "0e3f4d71-4998-448f-b706-8ae0f6d0d960", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-245892937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af65f5e7dcc3404292714adcecdd9939", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745756ea-b3", "ovs_interfaceid": "745756ea-b360-423f-8258-5339a80658b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:52:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Releasing lock "refresh_cache-4f1102c5-f5ef-48d5-b271-6e25bee5cc70" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:52:47 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Starting migrate_disk_and_power_off {{(pid=74850) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 14 00:52:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:47 user nova-compute[74850]: DEBUG nova.compute.manager [req-35dcd90d-9243-4aed-8c42-54ae7807cdb6 req-b2771c8f-d8e2-4c27-8476-e53cb8dfa6c1 service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Received event network-vif-unplugged-745756ea-b360-423f-8258-5339a80658b5 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:52:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-35dcd90d-9243-4aed-8c42-54ae7807cdb6 req-b2771c8f-d8e2-4c27-8476-e53cb8dfa6c1 service nova] Acquiring lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:52:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-35dcd90d-9243-4aed-8c42-54ae7807cdb6 req-b2771c8f-d8e2-4c27-8476-e53cb8dfa6c1 service nova] Lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:52:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-35dcd90d-9243-4aed-8c42-54ae7807cdb6 req-b2771c8f-d8e2-4c27-8476-e53cb8dfa6c1 service nova] Lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:52:47 user nova-compute[74850]: DEBUG nova.compute.manager [req-35dcd90d-9243-4aed-8c42-54ae7807cdb6 req-b2771c8f-d8e2-4c27-8476-e53cb8dfa6c1 service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] No waiting events found dispatching network-vif-unplugged-745756ea-b360-423f-8258-5339a80658b5 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:52:47 user nova-compute[74850]: WARNING nova.compute.manager [req-35dcd90d-9243-4aed-8c42-54ae7807cdb6 req-b2771c8f-d8e2-4c27-8476-e53cb8dfa6c1 service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Received unexpected event network-vif-unplugged-745756ea-b360-423f-8258-5339a80658b5 for instance with vm_state active and task_state resize_migrating.
Nov 14 00:52:47 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:52:48 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Instance destroyed successfully.
Nov 14 00:52:48 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:48:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-601800786',display_name='tempest-ServerActionsTestOtherB-server-601800786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-601800786',id=16,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwPveYWJd2P0BbCb28a9iVIK1Zsz5G3BGaDez0xzoCyU4RzkEN+R7LDyKbiUXGXbhQ6BKU8E1EnTC8pc8cZ9B9nXwhdl3wP+4ydXfXlf6SKZGReFXRGfyOHNNyPoLUUDg==',key_name='tempest-keypair-802679501',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:49:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='af65f5e7dcc3404292714adcecdd9939',ramdisk_id='',reservation_id='r-kr9hd7jm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1251502845',owner_user_name='tempest-ServerActionsTestOtherB-1251502845-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:52:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2647a5318ce4cdca3154aef93651505',uuid=4f1102c5-f5ef-48d5-b271-6e25bee5cc70,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "745756ea-b360-423f-8258-5339a80658b5", "address": "fa:16:3e:1e:5a:e7", "network": {"id": "0e3f4d71-4998-448f-b706-8ae0f6d0d960", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-245892937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-245892937-network", "vif_mac": "fa:16:3e:1e:5a:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af65f5e7dcc3404292714adcecdd9939", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745756ea-b3", "ovs_interfaceid": "745756ea-b360-423f-8258-5339a80658b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Converting VIF {"id": "745756ea-b360-423f-8258-5339a80658b5", "address": "fa:16:3e:1e:5a:e7", "network": {"id": "0e3f4d71-4998-448f-b706-8ae0f6d0d960", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-245892937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-245892937-network", "vif_mac": "fa:16:3e:1e:5a:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af65f5e7dcc3404292714adcecdd9939", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745756ea-b3", "ovs_interfaceid": "745756ea-b360-423f-8258-5339a80658b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:5a:e7,bridge_name='br-int',has_traffic_filtering=True,id=745756ea-b360-423f-8258-5339a80658b5,network=Network(0e3f4d71-4998-448f-b706-8ae0f6d0d960),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745756ea-b3') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG os_vif [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:5a:e7,bridge_name='br-int',has_traffic_filtering=True,id=745756ea-b360-423f-8258-5339a80658b5,network=Network(0e3f4d71-4998-448f-b706-8ae0f6d0d960),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745756ea-b3') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap745756ea-b3, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e0a37cde-095d-4385-b6c0-29e16b1fbbad) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:48 user nova-compute[74850]: INFO os_vif [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:5a:e7,bridge_name='br-int',has_traffic_filtering=True,id=745756ea-b360-423f-8258-5339a80658b5,network=Network(0e3f4d71-4998-448f-b706-8ae0f6d0d960),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745756ea-b3')
Nov 14 00:52:48 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oniPaHRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:52:48 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:52:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0980d81b-b632-462d-8d5a-115cdce75366]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 00:52:48 user nova-compute[74850]: No targets found.
Nov 14 00:52:48 user nova-compute[74850]: iSNS:
Nov 14 00:52:48 user nova-compute[74850]: No targets found.
Nov 14 00:52:48 user nova-compute[74850]: STATIC:
Nov 14 00:52:48 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf
Nov 14 00:52:48 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:52:48 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:52:48 user nova-compute[74850]: FIRMWARE:
Nov 14 00:52:48 user nova-compute[74850]: No targets found.
Nov 14 00:52:48 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 00:52:48 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 00:52:48 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b306f28a-772a-47ca-a11a-2ec41451b267]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3120e72a-e04b-4edd-a8b2-23f98e1f4d2e]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:52:48 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:52:48 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a5c2524d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf'): ({'sdb'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Removing single pathed devices sdb {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceaacc63-e2f5-4071-b3b9-f97a5d760161]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e60e74-9dc2-45f9-981d-2e1cb9a1cdd0]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Flushing IO for device /dev/sdb {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4d1f80-eb76-4522-8918-41e9e8ea54e9]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb8cdf1-3c56-4fa8-847f-fe47ba439cd6]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2baf3582-e7f5-4e12-9954-3af06d49beb1]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8468c03-0398-40b9-9e39-923a03fe679b]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf, portal: 172.16.0.220,3260]
Nov 14 00:52:48 user nova-compute[74850]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf, portal: 172.16.0.220,3260] successful.
Nov 14 00:52:48 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[44beaccb-d978-4fae-a516-33f73490ecf8]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] <== disconnect_volume: return (310ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:52:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70_resize/disk /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'edVGtwrJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:52:49 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:52:49 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:52:49 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:52:49 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:52:49 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] CMD "cp -r /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70_resize/disk /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk" returned: 0 in 0.560s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70_resize/disk.info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk.info {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28bffff-1a50-4e24-8302-2da999a2c647]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 00:52:49 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] CMD "cp -r /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70_resize/disk.info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk.info" returned: 0 in 0.038s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bec306d-85f6-45ce-aa37-e9f2241cfeca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714] added
Nov 14 00:52:49 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57f1e010-68bf-4047-9316-0412a2c89be2/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cf7867-3a1c-42c5-9323-666dfed4ced0]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e64c254-c836-4285-b59e-442215954ad2]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v edVGtwrJ {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v edVGtwrJ" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[71605349-a6c4-417a-b5ef-7db83a6db51e]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'edVGtwrJ'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3611452-975e-4758-b7d7-fe887764c281]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a4bda6-b24f-4481-83c1-4ea62ae3ecb6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 00:52:49 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 00:52:49 user nova-compute[74850]:  {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:52:49 user nova-compute[74850]: WARNING os_brick.initiator.connectors.iscsi [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 00:52:49 user nova-compute[74850]: 
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57f1e010-68bf-4047-9316-0412a2c89be2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57f1e010-68bf-4047-9316-0412a2c89be2/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[012d273e-cb79-420e-b2f8-51804678900b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714, portal: 172.16.0.220,3260]
Nov 14 00:52:49 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714, portal: 172.16.0.220,3260] successful.
Nov 14 00:52:49 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1fe422-c605-488c-b44a-2c1876ac1032]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG nova.compute.manager [req-fb69bb6e-a52a-4aff-854c-3201017d63e3 req-b544c7d6-ec06-4b97-964c-eb7153dfc02d service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Received event network-vif-plugged-745756ea-b360-423f-8258-5339a80658b5 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fb69bb6e-a52a-4aff-854c-3201017d63e3 req-b544c7d6-ec06-4b97-964c-eb7153dfc02d service nova] Acquiring lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fb69bb6e-a52a-4aff-854c-3201017d63e3 req-b544c7d6-ec06-4b97-964c-eb7153dfc02d service nova] Lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fb69bb6e-a52a-4aff-854c-3201017d63e3 req-b544c7d6-ec06-4b97-964c-eb7153dfc02d service nova] Lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG nova.compute.manager [req-fb69bb6e-a52a-4aff-854c-3201017d63e3 req-b544c7d6-ec06-4b97-964c-eb7153dfc02d service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] No waiting events found dispatching network-vif-plugged-745756ea-b360-423f-8258-5339a80658b5 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:52:49 user nova-compute[74850]: WARNING nova.compute.manager [req-fb69bb6e-a52a-4aff-854c-3201017d63e3 req-b544c7d6-ec06-4b97-964c-eb7153dfc02d service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Received unexpected event network-vif-plugged-745756ea-b360-423f-8258-5339a80658b5 for instance with vm_state active and task_state resize_migrating.
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[58af69fb-b5c4-41fe-9c65-3691a7b2995a]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:52:49 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:52:49 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.375s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9d4850-ed6f-4549-9482-93e425fad1e2]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:52:49 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'edVGtwrJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 00:52:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57f1e010-68bf-4047-9316-0412a2c89be2/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:50 user nova-compute[74850]: DEBUG nova.network.neutron [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Port 745756ea-b360-423f-8258-5339a80658b5 binding to destination host user is already ACTIVE {{(pid=74850) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 00:52:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Acquiring lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:52:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:52:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:52:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Acquiring lock "refresh_cache-4f1102c5-f5ef-48d5-b271-6e25bee5cc70" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:52:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Acquired lock "refresh_cache-4f1102c5-f5ef-48d5-b271-6e25bee5cc70" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:52:50 user nova-compute[74850]: DEBUG nova.network.neutron [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:52:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:50 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.459s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:52:50 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] <== connect_volume: return (1463ms) {'type': 'block', 'scsi_wwn': '26536363465623562', 'path': '/dev/sdb'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:52:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536363465623562', 'path': '/dev/sdb'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 00:52:50 user nova-compute[74850]: DEBUG nova.objects.instance [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lazy-loading 'flavor' on Instance uuid 4b60ac08-e954-46d5-a280-a11146b3ebf4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:52:51 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 00:52:51 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:52:51 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 00:52:51 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:52:51 user nova-compute[74850]:   <serial>44fa6c77-8978-4921-b98e-3c21c1e75714</serial>
Nov 14 00:52:51 user nova-compute[74850]: </disk>
Nov 14 00:52:51 user nova-compute[74850]:  {{(pid=74850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 00:52:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2f305e1-7092-4e8a-bb47-a15c89388eb2/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2f305e1-7092-4e8a-bb47-a15c89388eb2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2f305e1-7092-4e8a-bb47-a15c89388eb2/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:51 user nova-compute[74850]: DEBUG nova.network.neutron [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Updating instance_info_cache with network_info: [{"id": "745756ea-b360-423f-8258-5339a80658b5", "address": "fa:16:3e:1e:5a:e7", "network": {"id": "0e3f4d71-4998-448f-b706-8ae0f6d0d960", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-245892937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af65f5e7dcc3404292714adcecdd9939", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745756ea-b3", "ovs_interfaceid": "745756ea-b360-423f-8258-5339a80658b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:52:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Releasing lock "refresh_cache-4f1102c5-f5ef-48d5-b271-6e25bee5cc70" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:52:51 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:52:51 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:52:51 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] No VIF found with MAC fa:16:3e:ef:7a:d7, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:52:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2f305e1-7092-4e8a-bb47-a15c89388eb2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:51 user nova-compute[74850]: DEBUG os_brick.utils [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:52:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:51 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[54694cd6-8cb0-466d-a4d0-fbfcc2b3ad5d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:51 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd128150-05e0-4c01-94b3-5bb06d2b9715]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:51 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2f8266-bf3f-457e-98e6-e6f018ef1d26]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:51 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ed3056-8417-46bf-8ee5-f228baec6b52]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:52:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ecc391ea-5697-4c53-94fd-81bb49f8be4f tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lock "4b60ac08-e954-46d5-a280-a11146b3ebf4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.503s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:52:51 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 00:52:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:52:51 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 00:52:51 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8213de-146d-46fc-9f93-b44631596006]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:51 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 00:52:51 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 00:52:51 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 00:52:51 user nova-compute[74850]: DEBUG os_brick.utils [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:52:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:51 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:52:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:52:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:53 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:52:53 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:52:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=7922MB free_disk=25.33728790283203GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 00:52:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:52:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:52:53 user nova-compute[74850]: INFO nova.compute.manager [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Rescuing
Nov 14 00:52:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Acquiring lock "refresh_cache-4b60ac08-e954-46d5-a280-a11146b3ebf4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:52:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Acquired lock "refresh_cache-4b60ac08-e954-46d5-a280-a11146b3ebf4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:52:53 user nova-compute[74850]: DEBUG nova.network.neutron [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:52:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Applying migration context for instance 4f1102c5-f5ef-48d5-b271-6e25bee5cc70 as it has an incoming, in-progress migration 031456c4-37fc-41ea-a496-f91bcf24372d. Migration status is post-migrating {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 00:52:53 user nova-compute[74850]: INFO nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Updating resource usage from migration 031456c4-37fc-41ea-a496-f91bcf24372d
Nov 14 00:52:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance a70d0196-f90e-47c4-be67-bf7ef4c3d8c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:52:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 1879be4c-9226-4c8c-a56c-f8e37398851b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:52:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 4b60ac08-e954-46d5-a280-a11146b3ebf4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:52:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance a62a2eab-2502-4275-948b-3f18c3fcff36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:52:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 748d0da7-bbb9-4e86-aae3-e48b1fa04c14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:52:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance e2f305e1-7092-4e8a-bb47-a15c89388eb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:52:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 4474ad0e-8eee-4db4-9896-50c049d45d26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:52:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 57f1e010-68bf-4047-9316-0412a2c89be2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:52:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Migration 031456c4-37fc-41ea-a496-f91bcf24372d is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 00:52:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 4f1102c5-f5ef-48d5-b271-6e25bee5cc70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:52:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 00:52:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 00:52:53 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:52:53 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:52:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 00:52:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.485s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:52:54 user nova-compute[74850]: DEBUG nova.network.neutron [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Updating instance_info_cache with network_info: [{"id": "06e3d114-d80f-4634-840a-d4e120c77a88", "address": "fa:16:3e:ef:7a:d7", "network": {"id": "a32d38d7-3a21-4c1b-886b-473c5cac50a4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-777089423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ed4742aedf24e90a866dd0a8692635e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e3d114-d8", "ovs_interfaceid": "06e3d114-d80f-4634-840a-d4e120c77a88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:52:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Releasing lock "refresh_cache-4b60ac08-e954-46d5-a280-a11146b3ebf4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:52:54 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:54 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:54 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:54 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:54 user nova-compute[74850]: DEBUG nova.compute.manager [req-70d4dc32-6eaf-4822-931f-50498769296e req-f5e4294e-bcc8-4e23-8195-ec053c5ae178 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Received event network-vif-unplugged-06e3d114-d80f-4634-840a-d4e120c77a88 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:52:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-70d4dc32-6eaf-4822-931f-50498769296e req-f5e4294e-bcc8-4e23-8195-ec053c5ae178 service nova] Acquiring lock "4b60ac08-e954-46d5-a280-a11146b3ebf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:52:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-70d4dc32-6eaf-4822-931f-50498769296e req-f5e4294e-bcc8-4e23-8195-ec053c5ae178 service nova] Lock "4b60ac08-e954-46d5-a280-a11146b3ebf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:52:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-70d4dc32-6eaf-4822-931f-50498769296e req-f5e4294e-bcc8-4e23-8195-ec053c5ae178 service nova] Lock "4b60ac08-e954-46d5-a280-a11146b3ebf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:52:54 user nova-compute[74850]: DEBUG nova.compute.manager [req-70d4dc32-6eaf-4822-931f-50498769296e req-f5e4294e-bcc8-4e23-8195-ec053c5ae178 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] No waiting events found dispatching network-vif-unplugged-06e3d114-d80f-4634-840a-d4e120c77a88 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:52:54 user nova-compute[74850]: WARNING nova.compute.manager [req-70d4dc32-6eaf-4822-931f-50498769296e req-f5e4294e-bcc8-4e23-8195-ec053c5ae178 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Received unexpected event network-vif-unplugged-06e3d114-d80f-4634-840a-d4e120c77a88 for instance with vm_state active and task_state rescuing.
Nov 14 00:52:54 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:52:54 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:52:54 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 00:52:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "refresh_cache-4f1102c5-f5ef-48d5-b271-6e25bee5cc70" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:52:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquired lock "refresh_cache-4f1102c5-f5ef-48d5-b271-6e25bee5cc70" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:52:54 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Forcefully refreshing network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 00:52:55 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Instance destroyed successfully.
Nov 14 00:52:55 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Attempting a stable device rescue
Nov 14 00:52:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74850) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 00:52:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Instance directory exists: not creating {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 00:52:55 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Creating image(s)
Nov 14 00:52:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:52:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lock "/opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:52:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lock "/opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:52:55 user nova-compute[74850]: DEBUG nova.objects.instance [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4b60ac08-e954-46d5-a280-a11146b3ebf4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:52:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Acquiring lock "99ddb6bc78eecd6954936ecdfb0b10003c8e13f0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:52:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lock "99ddb6bc78eecd6954936ecdfb0b10003c8e13f0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:52:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/99ddb6bc78eecd6954936ecdfb0b10003c8e13f0.part --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:56 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Updating instance_info_cache with network_info: [{"id": "745756ea-b360-423f-8258-5339a80658b5", "address": "fa:16:3e:1e:5a:e7", "network": {"id": "0e3f4d71-4998-448f-b706-8ae0f6d0d960", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-245892937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af65f5e7dcc3404292714adcecdd9939", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745756ea-b3", "ovs_interfaceid": "745756ea-b360-423f-8258-5339a80658b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:52:56 user nova-compute[74850]: DEBUG nova.compute.manager [req-a2b6f304-47b7-44e7-96a4-a0f5398aca1e req-1219381e-a252-48c9-9adb-06d05dd53e29 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Received event network-vif-plugged-06e3d114-d80f-4634-840a-d4e120c77a88 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:52:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a2b6f304-47b7-44e7-96a4-a0f5398aca1e req-1219381e-a252-48c9-9adb-06d05dd53e29 service nova] Acquiring lock "4b60ac08-e954-46d5-a280-a11146b3ebf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:52:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a2b6f304-47b7-44e7-96a4-a0f5398aca1e req-1219381e-a252-48c9-9adb-06d05dd53e29 service nova] Lock "4b60ac08-e954-46d5-a280-a11146b3ebf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:52:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a2b6f304-47b7-44e7-96a4-a0f5398aca1e req-1219381e-a252-48c9-9adb-06d05dd53e29 service nova] Lock "4b60ac08-e954-46d5-a280-a11146b3ebf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:52:56 user nova-compute[74850]: DEBUG nova.compute.manager [req-a2b6f304-47b7-44e7-96a4-a0f5398aca1e req-1219381e-a252-48c9-9adb-06d05dd53e29 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] No waiting events found dispatching network-vif-plugged-06e3d114-d80f-4634-840a-d4e120c77a88 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:52:56 user nova-compute[74850]: WARNING nova.compute.manager [req-a2b6f304-47b7-44e7-96a4-a0f5398aca1e req-1219381e-a252-48c9-9adb-06d05dd53e29 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Received unexpected event network-vif-plugged-06e3d114-d80f-4634-840a-d4e120c77a88 for instance with vm_state active and task_state rescuing.
Nov 14 00:52:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Releasing lock "refresh_cache-4f1102c5-f5ef-48d5-b271-6e25bee5cc70" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:52:56 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Updated the network info_cache for instance {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 00:52:56 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:52:56 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:52:56 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:52:56 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 00:52:56 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Starting finish_migration {{(pid=74850) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 14 00:52:56 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Instance directory exists: not creating {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 00:52:56 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Creating image(s)
Nov 14 00:52:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:56 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:52:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/99ddb6bc78eecd6954936ecdfb0b10003c8e13f0.part --force-share --output=json" returned: 0 in 0.212s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:56 user nova-compute[74850]: DEBUG nova.virt.images [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] 7e647ff2-dca5-4329-a96b-d327fbe0d613 was qcow2, converting to raw {{(pid=74850) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 00:52:56 user nova-compute[74850]: DEBUG nova.privsep.utils [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74850) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 00:52:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/99ddb6bc78eecd6954936ecdfb0b10003c8e13f0.part /opt/stack/data/nova/instances/_base/99ddb6bc78eecd6954936ecdfb0b10003c8e13f0.converted {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.169s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:56 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk. size=21474836480 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 00:52:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk 21474836480 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk 21474836480" returned: 0 in 0.178s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Did not create local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Ensure instance console log exists: /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Start _get_guest_xml network_info=[{"id": "745756ea-b360-423f-8258-5339a80658b5", "address": "fa:16:3e:1e:5a:e7", "network": {"id": "0e3f4d71-4998-448f-b706-8ae0f6d0d960", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-245892937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-245892937-network", "vif_mac": "fa:16:3e:1e:5a:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af65f5e7dcc3404292714adcecdd9939", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745756ea-b3", "ovs_interfaceid": "745756ea-b360-423f-8258-5339a80658b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b64e7134-c083-4fa9-98b0-8027f0fb5e05', 'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oniPaHRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '4f1102c5-f5ef-48d5-b271-6e25bee5cc70', 'attached_at': '2023-11-14T00:52:56.000000', 'detached_at': '', 'volume_id': 'fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf', 'serial': 'fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf'}, 'volume_type': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:52:57 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:52:57 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:52:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oniPaHRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:52:57 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:52:57 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:52:57 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:52:57 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:52:57 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[18068c48-01a0-4e53-94d1-164d4d2c1981]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 00:52:57 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3fe02a-e740-4599-98ca-0939c599470b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf] added
Nov 14 00:52:57 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[177d6bcd-6c5a-4141-9502-81f8f3791207]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/99ddb6bc78eecd6954936ecdfb0b10003c8e13f0.part /opt/stack/data/nova/instances/_base/99ddb6bc78eecd6954936ecdfb0b10003c8e13f0.converted" returned: 0 in 0.738s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/99ddb6bc78eecd6954936ecdfb0b10003c8e13f0.converted --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc39bf1-e368-46a4-b2aa-f919c669de26]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oniPaHRL {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oniPaHRL" returned: 0 in 0.028s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a54846-52a4-4bda-a24e-a36a68ee9dfb]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oniPaHRL'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.041s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1811e190-f6b3-4e07-90cb-d23a0abe3c26]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8709806c-31ba-41a2-9291-b9a4c823a3a2]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:52:57 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:52:57 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/99ddb6bc78eecd6954936ecdfb0b10003c8e13f0.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lock "99ddb6bc78eecd6954936ecdfb0b10003c8e13f0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.595s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Acquiring lock "99ddb6bc78eecd6954936ecdfb0b10003c8e13f0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lock "99ddb6bc78eecd6954936ecdfb0b10003c8e13f0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/99ddb6bc78eecd6954936ecdfb0b10003c8e13f0 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b90863-f15f-4589-b646-ed0f626f4051]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf, portal: 172.16.0.220,3260]
Nov 14 00:52:57 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf, portal: 172.16.0.220,3260] successful.
Nov 14 00:52:57 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.043s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[660106b4-a052-40aa-b771-4e94521a5a07]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8005025f-8e89-40da-9376-0092d544a6f0]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:52:57 user nova-compute[74850]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:52:57 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:52:57 user nova-compute[74850]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:52:57 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.398s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5b1323-33c3-4f85-b5e4-0a16cd21206b]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oniPaHRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/99ddb6bc78eecd6954936ecdfb0b10003c8e13f0 --force-share --output=json" returned: 0 in 0.169s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/99ddb6bc78eecd6954936ecdfb0b10003c8e13f0,backing_fmt=raw /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk.rescue {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/99ddb6bc78eecd6954936ecdfb0b10003c8e13f0,backing_fmt=raw /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk.rescue" returned: 0 in 0.051s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lock "99ddb6bc78eecd6954936ecdfb0b10003c8e13f0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:52:57 user nova-compute[74850]: DEBUG nova.objects.instance [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lazy-loading 'migration_context' on Instance uuid 4b60ac08-e954-46d5-a280-a11146b3ebf4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG nova.objects.base [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Object Instance<4b60ac08-e954-46d5-a280-a11146b3ebf4> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Start _get_guest_xml network_info=[{"id": "06e3d114-d80f-4634-840a-d4e120c77a88", "address": "fa:16:3e:ef:7a:d7", "network": {"id": "a32d38d7-3a21-4c1b-886b-473c5cac50a4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-777089423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-777089423-network", "vif_mac": "fa:16:3e:ef:7a:d7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ed4742aedf24e90a866dd0a8692635e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e3d114-d8", "ovs_interfaceid": "06e3d114-d80f-4634-840a-d4e120c77a88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7e647ff2-dca5-4329-a96b-d327fbe0d613', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8458b535-9e68-4cab-8986-6e14eba516ad', 'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'edVGtwrJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '4b60ac08-e954-46d5-a280-a11146b3ebf4', 'attached_at': '', 'detached_at': '', 'volume_id': '44fa6c77-8978-4921-b98e-3c21c1e75714', 'serial': '44fa6c77-8978-4921-b98e-3c21c1e75714'}, 'volume_type': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG nova.objects.instance [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lazy-loading 'resources' on Instance uuid 4b60ac08-e954-46d5-a280-a11146b3ebf4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG nova.objects.base [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Object Instance<4b60ac08-e954-46d5-a280-a11146b3ebf4> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG nova.objects.instance [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lazy-loading 'numa_topology' on Instance uuid 4b60ac08-e954-46d5-a280-a11146b3ebf4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG nova.objects.base [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Object Instance<4b60ac08-e954-46d5-a280-a11146b3ebf4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 00:52:58 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:52:58 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:52:58 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG nova.objects.instance [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4b60ac08-e954-46d5-a280-a11146b3ebf4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG nova.objects.base [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Object Instance<4b60ac08-e954-46d5-a280-a11146b3ebf4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'edVGtwrJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:52:58 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:52:58 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.430s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] <== connect_volume: return (1432ms) {'type': 'block', 'scsi_wwn': '23039313564393733', 'path': '/dev/sdc'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039313564393733', 'path': '/dev/sdc'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.803s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:52:58 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:52:58 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:52:58 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 00:52:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19373e8-eb19-4a70-a0f8-6333bbea9dd5]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = edVGtwrJ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 00:52:58 user nova-compute[74850]: node.name = iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714
Nov 14 00:52:58 user nova-compute[74850]: node.tpgt = -1
Nov 14 00:52:58 user nova-compute[74850]: node.startup = automatic
Nov 14 00:52:58 user nova-compute[74850]: node.leading_login = No
Nov 14 00:52:58 user nova-compute[74850]: iface.iscsi_ifacename = default
Nov 14 00:52:58 user nova-compute[74850]: iface.net_ifacename = <empty>
Nov 14 00:52:58 user nova-compute[74850]: iface.ipaddress = <empty>
Nov 14 00:52:58 user nova-compute[74850]: iface.prefix_len = 0
Nov 14 00:52:58 user nova-compute[74850]: iface.hwaddress = <empty>
Nov 14 00:52:58 user nova-compute[74850]: iface.transport_name = tcp
Nov 14 00:52:58 user nova-compute[74850]: iface.initiatorname = <empty>
Nov 14 00:52:58 user nova-compute[74850]: iface.state = <empty>
Nov 14 00:52:58 user nova-compute[74850]: iface.vlan_id = 0
Nov 14 00:52:58 user nova-compute[74850]: iface.vlan_priority = 0
Nov 14 00:52:58 user nova-compute[74850]: iface.vlan_state = <empty>
Nov 14 00:52:58 user nova-compute[74850]: iface.iface_num = 0
Nov 14 00:52:58 user nova-compute[74850]: iface.mtu = 0
Nov 14 00:52:58 user nova-compute[74850]: iface.port = 0
Nov 14 00:52:58 user nova-compute[74850]: iface.bootproto = <empty>
Nov 14 00:52:58 user nova-compute[74850]: iface.subnet_mask = <empty>
Nov 14 00:52:58 user nova-compute[74850]: iface.gateway = <empty>
Nov 14 00:52:58 user nova-compute[74850]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 00:52:58 user nova-compute[74850]: iface.dhcp_alt_client_id = <empty>
Nov 14 00:52:58 user nova-compute[74850]: iface.dhcp_dns = <empty>
Nov 14 00:52:58 user nova-compute[74850]: iface.dhcp_learn_iqn = <empty>
Nov 14 00:52:58 user nova-compute[74850]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 00:52:58 user nova-compute[74850]: iface.dhcp_vendor_id_state = <empty>
Nov 14 00:52:58 user nova-compute[74850]: iface.dhcp_vendor_id = <empty>
Nov 14 00:52:58 user nova-compute[74850]: iface.dhcp_slp_da = <empty>
Nov 14 00:52:58 user nova-compute[74850]: iface.fragmentation = <empty>
Nov 14 00:52:58 user nova-compute[74850]: iface.gratuitous_arp = <empty>
Nov 14 00:52:58 user nova-compute[74850]: iface.incoming_forwarding = <empty>
Nov 14 00:52:58 user nova-compute[74850]: iface.tos_state = <empty>
Nov 14 00:52:58 user nova-compute[74850]: iface.tos = 0
Nov 14 00:52:58 user nova-compute[74850]: iface.ttl = 0
Nov 14 00:52:58 user nova-compute[74850]: iface.delayed_ack = <empty>
Nov 14 00:52:58 user nova-compute[74850]: iface.tcp_nagle = <empty>
Nov 14 00:52:58 user nova-compute[74850]: iface.tcp_wsf_state = <empty>
Nov 14 00:52:58 user nova-compute[74850]: iface.tcp_wsf = 0
Nov 14 00:52:58 user nova-compute[74850]: iface.tcp_timer_scale = 0
Nov 14 00:52:58 user nova-compute[74850]: iface.tcp_timestamp = <empty>
Nov 14 00:52:58 user nova-compute[74850]: iface.redirect = <empty>
Nov 14 00:52:58 user nova-compute[74850]: iface.def_task_mgmt_timeout = 0
Nov 14 00:52:58 user nova-compute[74850]: iface.header_digest = <empty>
Nov 14 00:52:58 user nova-compute[74850]: iface.data_digest = <empty>
Nov 14 00:52:58 user nova-compute[74850]: iface.immediate_data = <empty>
Nov 14 00:52:58 user nova-compute[74850]: iface.initial_r2t = <empty>
Nov 14 00:52:58 user nova-compute[74850]: iface.data_seq_inorder = <empty>
Nov 14 00:52:58 user nova-compute[74850]: iface.data_pdu_inorder = <empty>
Nov 14 00:52:58 user nova-compute[74850]: iface.erl = 0
Nov 14 00:52:58 user nova-compute[74850]: iface.max_receive_data_len = 0
Nov 14 00:52:58 user nova-compute[74850]: iface.first_burst_len = 0
Nov 14 00:52:58 user nova-compute[74850]: iface.max_outstanding_r2t = 0
Nov 14 00:52:58 user nova-compute[74850]: iface.max_burst_len = 0
Nov 14 00:52:58 user nova-compute[74850]: iface.chap_auth = <empty>
Nov 14 00:52:58 user nova-compute[74850]: iface.bidi_chap = <empty>
Nov 14 00:52:58 user nova-compute[74850]: iface.strict_login_compliance = <empty>
Nov 14 00:52:58 user nova-compute[74850]: iface.discovery_auth = <empty>
Nov 14 00:52:58 user nova-compute[74850]: iface.discovery_logout = <empty>
Nov 14 00:52:58 user nova-compute[74850]: node.discovery_address = <empty>
Nov 14 00:52:58 user nova-compute[74850]: node.discovery_port = 0
Nov 14 00:52:58 user nova-compute[74850]: node.discovery_type = static
Nov 14 00:52:58 user nova-compute[74850]: node.session.initial_cmdsn = 0
Nov 14 00:52:58 user nova-compute[74850]: node.session.initial_login_retry_max = 8
Nov 14 00:52:58 user nova-compute[74850]: node.session.xmit_thread_priority = -20
Nov 14 00:52:58 user nova-compute[74850]: node.session.cmds_max = 128
Nov 14 00:52:58 user nova-compute[74850]: node.session.queue_depth = 32
Nov 14 00:52:58 user nova-compute[74850]: node.session.nr_sessions = 1
Nov 14 00:52:58 user nova-compute[74850]: node.session.auth.authmethod = CHAP
Nov 14 00:52:58 user nova-compute[74850]: node.session.auth.username = edVGtwrJ
Nov 14 00:52:58 user nova-compute[74850]: node.session.auth.password = ***
Nov 14 00:52:58 user nova-compute[74850]: node.session.auth.username_in = <empty>
Nov 14 00:52:58 user nova-compute[74850]: node.session.auth.password_in = <empty>
Nov 14 00:52:58 user nova-compute[74850]: node.session.auth.chap_algs = MD5
Nov 14 00:52:58 user nova-compute[74850]: node.session.timeo.replacement_timeout = 120
Nov 14 00:52:58 user nova-compute[74850]: node.session.err_timeo.abort_timeout = 15
Nov 14 00:52:58 user nova-compute[74850]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 00:52:58 user nova-compute[74850]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 00:52:58 user nova-compute[74850]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 00:52:58 user nova-compute[74850]: node.session.iscsi.FastAbort = Yes
Nov 14 00:52:58 user nova-compute[74850]: node.session.iscsi.InitialR2T = No
Nov 14 00:52:58 user nova-compute[74850]: node.session.iscsi.ImmediateData = Yes
Nov 14 00:52:58 user nova-compute[74850]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 00:52:58 user nova-compute[74850]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 00:52:58 user nova-compute[74850]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 00:52:58 user nova-compute[74850]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 00:52:58 user nova-compute[74850]: node.session.iscsi.MaxConnections = 1
Nov 14 00:52:58 user nova-compute[74850]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 00:52:58 user nova-compute[74850]: node.session.iscsi.ERL = 0
Nov 14 00:52:58 user nova-compute[74850]: node.session.scan = manual
Nov 14 00:52:58 user nova-compute[74850]: node.session.reopen_max = 0
Nov 14 00:52:58 user nova-compute[74850]: node.conn[0].address = 172.16.0.220
Nov 14 00:52:58 user nova-compute[74850]: node.conn[0].port = 3260
Nov 14 00:52:58 user nova-compute[74850]: node.conn[0].startup = manual
Nov 14 00:52:58 user nova-compute[74850]: node.conn[0].tcp.window_size = 524288
Nov 14 00:52:58 user nova-compute[74850]: node.conn[0].tcp.type_of_service = 0
Nov 14 00:52:58 user nova-compute[74850]: node.conn[0].timeo.logout_timeout = 15
Nov 14 00:52:58 user nova-compute[74850]: node.conn[0].timeo.login_timeout = 15
Nov 14 00:52:58 user nova-compute[74850]: node.conn[0].timeo.auth_timeout = 45
Nov 14 00:52:58 user nova-compute[74850]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 00:52:58 user nova-compute[74850]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 00:52:58 user nova-compute[74850]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 00:52:58 user nova-compute[74850]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 00:52:58 user nova-compute[74850]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 00:52:58 user nova-compute[74850]: node.conn[0].iscsi.DataDigest = None
Nov 14 00:52:58 user nova-compute[74850]: node.conn[0].iscsi.IFMarker = No
Nov 14 00:52:58 user nova-compute[74850]: node.conn[0].iscsi.OFMarker = No
Nov 14 00:52:58 user nova-compute[74850]: # END RECORD
Nov 14 00:52:58 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:48:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-601800786',display_name='tempest-ServerActionsTestOtherB-server-601800786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-601800786',id=16,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwPveYWJd2P0BbCb28a9iVIK1Zsz5G3BGaDez0xzoCyU4RzkEN+R7LDyKbiUXGXbhQ6BKU8E1EnTC8pc8cZ9B9nXwhdl3wP+4ydXfXlf6SKZGReFXRGfyOHNNyPoLUUDg==',key_name='tempest-keypair-802679501',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:49:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='af65f5e7dcc3404292714adcecdd9939',ramdisk_id='',reservation_id='r-kr9hd7jm',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1251502845',owner_user_name='tempest-ServerActionsTestOtherB-1251502845-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:52:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2647a5318ce4cdca3154aef93651505',uuid=4f1102c5-f5ef-48d5-b271-6e25bee5cc70,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "745756ea-b360-423f-8258-5339a80658b5", "address": "fa:16:3e:1e:5a:e7", "network": {"id": "0e3f4d71-4998-448f-b706-8ae0f6d0d960", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-245892937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-245892937-network", "vif_mac": "fa:16:3e:1e:5a:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af65f5e7dcc3404292714adcecdd9939", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745756ea-b3", "ovs_interfaceid": "745756ea-b360-423f-8258-5339a80658b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Converting VIF {"id": "745756ea-b360-423f-8258-5339a80658b5", "address": "fa:16:3e:1e:5a:e7", "network": {"id": "0e3f4d71-4998-448f-b706-8ae0f6d0d960", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-245892937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-245892937-network", "vif_mac": "fa:16:3e:1e:5a:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af65f5e7dcc3404292714adcecdd9939", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745756ea-b3", "ovs_interfaceid": "745756ea-b360-423f-8258-5339a80658b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:5a:e7,bridge_name='br-int',has_traffic_filtering=True,id=745756ea-b360-423f-8258-5339a80658b5,network=Network(0e3f4d71-4998-448f-b706-8ae0f6d0d960),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745756ea-b3') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:52:58 user nova-compute[74850]:   <uuid>4f1102c5-f5ef-48d5-b271-6e25bee5cc70</uuid>
Nov 14 00:52:58 user nova-compute[74850]:   <name>instance-00000010</name>
Nov 14 00:52:58 user nova-compute[74850]:   <memory>2097152</memory>
Nov 14 00:52:58 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:52:58 user nova-compute[74850]:   <metadata>
Nov 14 00:52:58 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:52:58 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:52:58 user nova-compute[74850]:       <nova:name>tempest-ServerActionsTestOtherB-server-601800786</nova:name>
Nov 14 00:52:58 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:52:57</nova:creationTime>
Nov 14 00:52:58 user nova-compute[74850]:       <nova:flavor name="m1.small">
Nov 14 00:52:58 user nova-compute[74850]:         <nova:memory>2048</nova:memory>
Nov 14 00:52:58 user nova-compute[74850]:         <nova:disk>20</nova:disk>
Nov 14 00:52:58 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:52:58 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:52:58 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:52:58 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:52:58 user nova-compute[74850]:       <nova:owner>
Nov 14 00:52:58 user nova-compute[74850]:         <nova:user uuid="a2647a5318ce4cdca3154aef93651505">tempest-ServerActionsTestOtherB-1251502845-project-member</nova:user>
Nov 14 00:52:58 user nova-compute[74850]:         <nova:project uuid="af65f5e7dcc3404292714adcecdd9939">tempest-ServerActionsTestOtherB-1251502845</nova:project>
Nov 14 00:52:58 user nova-compute[74850]:       </nova:owner>
Nov 14 00:52:58 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:52:58 user nova-compute[74850]:       <nova:ports>
Nov 14 00:52:58 user nova-compute[74850]:         <nova:port uuid="745756ea-b360-423f-8258-5339a80658b5">
Nov 14 00:52:58 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 00:52:58 user nova-compute[74850]:         </nova:port>
Nov 14 00:52:58 user nova-compute[74850]:       </nova:ports>
Nov 14 00:52:58 user nova-compute[74850]:     </nova:instance>
Nov 14 00:52:58 user nova-compute[74850]:   </metadata>
Nov 14 00:52:58 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:52:58 user nova-compute[74850]:     <system>
Nov 14 00:52:58 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:52:58 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:52:58 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:52:58 user nova-compute[74850]:       <entry name="serial">4f1102c5-f5ef-48d5-b271-6e25bee5cc70</entry>
Nov 14 00:52:58 user nova-compute[74850]:       <entry name="uuid">4f1102c5-f5ef-48d5-b271-6e25bee5cc70</entry>
Nov 14 00:52:58 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:52:58 user nova-compute[74850]:     </system>
Nov 14 00:52:58 user nova-compute[74850]:   </sysinfo>
Nov 14 00:52:58 user nova-compute[74850]:   <os>
Nov 14 00:52:58 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:52:58 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 00:52:58 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:52:58 user nova-compute[74850]:   </os>
Nov 14 00:52:58 user nova-compute[74850]:   <features>
Nov 14 00:52:58 user nova-compute[74850]:     <acpi/>
Nov 14 00:52:58 user nova-compute[74850]:     <apic/>
Nov 14 00:52:58 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:52:58 user nova-compute[74850]:   </features>
Nov 14 00:52:58 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:52:58 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:52:58 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:52:58 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:52:58 user nova-compute[74850]:   </clock>
Nov 14 00:52:58 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:52:58 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:52:58 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:52:58 user nova-compute[74850]:   </cpu>
Nov 14 00:52:58 user nova-compute[74850]:   <devices>
Nov 14 00:52:58 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 00:52:58 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:52:58 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk"/>
Nov 14 00:52:58 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:52:58 user nova-compute[74850]:     </disk>
Nov 14 00:52:58 user nova-compute[74850]:     <disk type="block" device="disk">
Nov 14 00:52:58 user nova-compute[74850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:52:58 user nova-compute[74850]:       <source dev="/dev/sdc"/>
Nov 14 00:52:58 user nova-compute[74850]:       <target dev="vdb" bus="virtio"/>
Nov 14 00:52:58 user nova-compute[74850]:       <serial>fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf</serial>
Nov 14 00:52:58 user nova-compute[74850]:     </disk>
Nov 14 00:52:58 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:52:58 user nova-compute[74850]:       <mac address="fa:16:3e:1e:5a:e7"/>
Nov 14 00:52:58 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:52:58 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:52:58 user nova-compute[74850]:       <target dev="tap745756ea-b3"/>
Nov 14 00:52:58 user nova-compute[74850]:     </interface>
Nov 14 00:52:58 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:52:58 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/console.log" append="off"/>
Nov 14 00:52:58 user nova-compute[74850]:     </serial>
Nov 14 00:52:58 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:52:58 user nova-compute[74850]:     <video>
Nov 14 00:52:58 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:52:58 user nova-compute[74850]:     </video>
Nov 14 00:52:58 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:52:58 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:52:58 user nova-compute[74850]:     </rng>
Nov 14 00:52:58 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:52:58 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:52:58 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:52:58 user nova-compute[74850]:     </memballoon>
Nov 14 00:52:58 user nova-compute[74850]:   </devices>
Nov 14 00:52:58 user nova-compute[74850]: </domain>
Nov 14 00:52:58 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:48:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-601800786',display_name='tempest-ServerActionsTestOtherB-server-601800786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-601800786',id=16,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwPveYWJd2P0BbCb28a9iVIK1Zsz5G3BGaDez0xzoCyU4RzkEN+R7LDyKbiUXGXbhQ6BKU8E1EnTC8pc8cZ9B9nXwhdl3wP+4ydXfXlf6SKZGReFXRGfyOHNNyPoLUUDg==',key_name='tempest-keypair-802679501',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:49:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='af65f5e7dcc3404292714adcecdd9939',ramdisk_id='',reservation_id='r-kr9hd7jm',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1251502845',owner_user_name='tempest-ServerActionsTestOtherB-1251502845-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:52:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2647a5318ce4cdca3154aef93651505',uuid=4f1102c5-f5ef-48d5-b271-6e25bee5cc70,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "745756ea-b360-423f-8258-5339a80658b5", "address": "fa:16:3e:1e:5a:e7", "network": {"id": "0e3f4d71-4998-448f-b706-8ae0f6d0d960", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-245892937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-245892937-network", "vif_mac": "fa:16:3e:1e:5a:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af65f5e7dcc3404292714adcecdd9939", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745756ea-b3", "ovs_interfaceid": "745756ea-b360-423f-8258-5339a80658b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Converting VIF {"id": "745756ea-b360-423f-8258-5339a80658b5", "address": "fa:16:3e:1e:5a:e7", "network": {"id": "0e3f4d71-4998-448f-b706-8ae0f6d0d960", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-245892937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-245892937-network", "vif_mac": "fa:16:3e:1e:5a:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af65f5e7dcc3404292714adcecdd9939", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745756ea-b3", "ovs_interfaceid": "745756ea-b360-423f-8258-5339a80658b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:5a:e7,bridge_name='br-int',has_traffic_filtering=True,id=745756ea-b360-423f-8258-5339a80658b5,network=Network(0e3f4d71-4998-448f-b706-8ae0f6d0d960),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745756ea-b3') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG os_vif [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:5a:e7,bridge_name='br-int',has_traffic_filtering=True,id=745756ea-b360-423f-8258-5339a80658b5,network=Network(0e3f4d71-4998-448f-b706-8ae0f6d0d960),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745756ea-b3') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5c741d96-38cb-574c-be22-7f2400d549d5', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[31776340-07bc-4ef2-a71c-af2fb1ebe0dd]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap745756ea-b3, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap745756ea-b3, col_values=(('qos', UUID('9169e7f7-0407-4f2f-b71f-a2c13606d7f0')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap745756ea-b3, col_values=(('external_ids', {'iface-id': '745756ea-b360-423f-8258-5339a80658b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:5a:e7', 'vm-uuid': '4f1102c5-f5ef-48d5-b271-6e25bee5cc70'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bd94d1-0742-4ec9-b30e-1a7ea30215d5]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v edVGtwrJ {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:52:58 user nova-compute[74850]: INFO os_vif [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:5a:e7,bridge_name='br-int',has_traffic_filtering=True,id=745756ea-b360-423f-8258-5339a80658b5,network=Network(0e3f4d71-4998-448f-b706-8ae0f6d0d960),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745756ea-b3')
Nov 14 00:52:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v edVGtwrJ" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c79b9ce-f836-4077-83ca-fb562ad4af3f]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'edVGtwrJ'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:52:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba10c33-d756-4fc3-8ed5-ed8f01ec6a3f]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:52:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[34dbc33b-ad1e-4af0-92a3-d63f82d4aab7]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:52:59 user nova-compute[74850]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:52:59 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:52:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:52:59 user nova-compute[74850]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:52:59 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:52:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.141s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:52:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 00:52:59 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] HCTL ('33', '0', '0', 0) found on session 22 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 00:52:59 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 00:52:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:52:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:52:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:52:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] No VIF found with MAC fa:16:3e:1e:5a:e7, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:52:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:52:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b94187-b796-4869-b7df-e5105ca3c383]: (4, ('0 0 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:52:59 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Searching for a device in session 22 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:52:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'edVGtwrJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 00:52:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.163s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:52:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] <== connect_volume: return (966ms) {'type': 'block', 'scsi_wwn': '26536363465623562', 'path': '/dev/sdb'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:52:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536363465623562', 'path': '/dev/sdb'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 00:52:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-502986324',display_name='tempest-ServerStableDeviceRescueTest-server-502986324',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-502986324',id=18,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7DltpeR7TImMhiz+vzatLidyU5MCPKFXrwJ76ilV9bswy73VBpt9fNiyC6+uDzkOHbbKXSHJv4ktbAISFjmBLQtaWHTbA8NxX8MGw55IlShPGquLMCYgZgWN/gER1IGQ==',key_name='tempest-keypair-1374070990',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:49:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ed4742aedf24e90a866dd0a8692635e',ramdisk_id='',reservation_id='r-hyy4v5xs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1482343790',owner_user_name='tempest-ServerStableDeviceRescueTest-1482343790-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:51:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e945e1f8b6a4b269d54e0e8293b59e7',uuid=4b60ac08-e954-46d5-a280-a11146b3ebf4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06e3d114-d80f-4634-840a-d4e120c77a88", "address": "fa:16:3e:ef:7a:d7", "network": {"id": "a32d38d7-3a21-4c1b-886b-473c5cac50a4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-777089423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-777089423-network", "vif_mac": "fa:16:3e:ef:7a:d7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ed4742aedf24e90a866dd0a8692635e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e3d114-d8", "ovs_interfaceid": "06e3d114-d80f-4634-840a-d4e120c77a88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:52:59 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Converting VIF {"id": "06e3d114-d80f-4634-840a-d4e120c77a88", "address": "fa:16:3e:ef:7a:d7", "network": {"id": "a32d38d7-3a21-4c1b-886b-473c5cac50a4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-777089423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-777089423-network", "vif_mac": "fa:16:3e:ef:7a:d7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ed4742aedf24e90a866dd0a8692635e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e3d114-d8", "ovs_interfaceid": "06e3d114-d80f-4634-840a-d4e120c77a88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:52:59 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:7a:d7,bridge_name='br-int',has_traffic_filtering=True,id=06e3d114-d80f-4634-840a-d4e120c77a88,network=Network(a32d38d7-3a21-4c1b-886b-473c5cac50a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06e3d114-d8') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:52:59 user nova-compute[74850]: DEBUG nova.objects.instance [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b60ac08-e954-46d5-a280-a11146b3ebf4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:52:59 user nova-compute[74850]: DEBUG nova.objects.base [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Object Instance<4b60ac08-e954-46d5-a280-a11146b3ebf4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 00:52:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:52:59 user nova-compute[74850]:   <uuid>4b60ac08-e954-46d5-a280-a11146b3ebf4</uuid>
Nov 14 00:52:59 user nova-compute[74850]:   <name>instance-00000012</name>
Nov 14 00:52:59 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:52:59 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:52:59 user nova-compute[74850]:   <metadata>
Nov 14 00:52:59 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:52:59 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:52:59 user nova-compute[74850]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-502986324</nova:name>
Nov 14 00:52:59 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:52:58</nova:creationTime>
Nov 14 00:52:59 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:52:59 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:52:59 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:52:59 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:52:59 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:52:59 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:52:59 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:52:59 user nova-compute[74850]:       <nova:owner>
Nov 14 00:52:59 user nova-compute[74850]:         <nova:user uuid="9e945e1f8b6a4b269d54e0e8293b59e7">tempest-ServerStableDeviceRescueTest-1482343790-project-member</nova:user>
Nov 14 00:52:59 user nova-compute[74850]:         <nova:project uuid="9ed4742aedf24e90a866dd0a8692635e">tempest-ServerStableDeviceRescueTest-1482343790</nova:project>
Nov 14 00:52:59 user nova-compute[74850]:       </nova:owner>
Nov 14 00:52:59 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:52:59 user nova-compute[74850]:       <nova:ports>
Nov 14 00:52:59 user nova-compute[74850]:         <nova:port uuid="06e3d114-d80f-4634-840a-d4e120c77a88">
Nov 14 00:52:59 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 00:52:59 user nova-compute[74850]:         </nova:port>
Nov 14 00:52:59 user nova-compute[74850]:       </nova:ports>
Nov 14 00:52:59 user nova-compute[74850]:     </nova:instance>
Nov 14 00:52:59 user nova-compute[74850]:   </metadata>
Nov 14 00:52:59 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:52:59 user nova-compute[74850]:     <system>
Nov 14 00:52:59 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:52:59 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:52:59 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:52:59 user nova-compute[74850]:       <entry name="serial">4b60ac08-e954-46d5-a280-a11146b3ebf4</entry>
Nov 14 00:52:59 user nova-compute[74850]:       <entry name="uuid">4b60ac08-e954-46d5-a280-a11146b3ebf4</entry>
Nov 14 00:52:59 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:52:59 user nova-compute[74850]:     </system>
Nov 14 00:52:59 user nova-compute[74850]:   </sysinfo>
Nov 14 00:52:59 user nova-compute[74850]:   <os>
Nov 14 00:52:59 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:52:59 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:52:59 user nova-compute[74850]:   </os>
Nov 14 00:52:59 user nova-compute[74850]:   <features>
Nov 14 00:52:59 user nova-compute[74850]:     <acpi/>
Nov 14 00:52:59 user nova-compute[74850]:     <apic/>
Nov 14 00:52:59 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:52:59 user nova-compute[74850]:   </features>
Nov 14 00:52:59 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:52:59 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:52:59 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:52:59 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:52:59 user nova-compute[74850]:   </clock>
Nov 14 00:52:59 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:52:59 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:52:59 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:52:59 user nova-compute[74850]:   </cpu>
Nov 14 00:52:59 user nova-compute[74850]:   <devices>
Nov 14 00:52:59 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 00:52:59 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:52:59 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk"/>
Nov 14 00:52:59 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:52:59 user nova-compute[74850]:     </disk>
Nov 14 00:52:59 user nova-compute[74850]:     <disk type="block" device="disk">
Nov 14 00:52:59 user nova-compute[74850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:52:59 user nova-compute[74850]:       <source dev="/dev/sdb"/>
Nov 14 00:52:59 user nova-compute[74850]:       <target dev="vdb" bus="virtio"/>
Nov 14 00:52:59 user nova-compute[74850]:       <serial>44fa6c77-8978-4921-b98e-3c21c1e75714</serial>
Nov 14 00:52:59 user nova-compute[74850]:     </disk>
Nov 14 00:52:59 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 00:52:59 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:52:59 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk.rescue"/>
Nov 14 00:52:59 user nova-compute[74850]:       <target dev="vdc" bus="virtio"/>
Nov 14 00:52:59 user nova-compute[74850]:       <boot order="1"/>
Nov 14 00:52:59 user nova-compute[74850]:     </disk>
Nov 14 00:52:59 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:52:59 user nova-compute[74850]:       <mac address="fa:16:3e:ef:7a:d7"/>
Nov 14 00:52:59 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:52:59 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:52:59 user nova-compute[74850]:       <target dev="tap06e3d114-d8"/>
Nov 14 00:52:59 user nova-compute[74850]:     </interface>
Nov 14 00:52:59 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:52:59 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/console.log" append="off"/>
Nov 14 00:52:59 user nova-compute[74850]:     </serial>
Nov 14 00:52:59 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:52:59 user nova-compute[74850]:     <video>
Nov 14 00:52:59 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:52:59 user nova-compute[74850]:     </video>
Nov 14 00:52:59 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:52:59 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:52:59 user nova-compute[74850]:     </rng>
Nov 14 00:52:59 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:52:59 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:52:59 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:52:59 user nova-compute[74850]:     </memballoon>
Nov 14 00:52:59 user nova-compute[74850]:   </devices>
Nov 14 00:52:59 user nova-compute[74850]: </domain>
Nov 14 00:52:59 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:52:59 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Instance destroyed successfully.
Nov 14 00:52:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:52:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:52:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:52:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] No VIF found with MAC fa:16:3e:ef:7a:d7, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:53:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:01 user nova-compute[74850]: DEBUG nova.compute.manager [req-fa0df547-fd33-4a90-9d57-76319c47ca0a req-611dbcc5-a424-4774-97ab-accc9a6b6ef5 service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Received event network-vif-plugged-745756ea-b360-423f-8258-5339a80658b5 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:53:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fa0df547-fd33-4a90-9d57-76319c47ca0a req-611dbcc5-a424-4774-97ab-accc9a6b6ef5 service nova] Acquiring lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:53:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fa0df547-fd33-4a90-9d57-76319c47ca0a req-611dbcc5-a424-4774-97ab-accc9a6b6ef5 service nova] Lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:53:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fa0df547-fd33-4a90-9d57-76319c47ca0a req-611dbcc5-a424-4774-97ab-accc9a6b6ef5 service nova] Lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:53:01 user nova-compute[74850]: DEBUG nova.compute.manager [req-fa0df547-fd33-4a90-9d57-76319c47ca0a req-611dbcc5-a424-4774-97ab-accc9a6b6ef5 service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] No waiting events found dispatching network-vif-plugged-745756ea-b360-423f-8258-5339a80658b5 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:53:01 user nova-compute[74850]: WARNING nova.compute.manager [req-fa0df547-fd33-4a90-9d57-76319c47ca0a req-611dbcc5-a424-4774-97ab-accc9a6b6ef5 service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Received unexpected event network-vif-plugged-745756ea-b360-423f-8258-5339a80658b5 for instance with vm_state active and task_state resize_finish.
Nov 14 00:53:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:01 user nova-compute[74850]: DEBUG nova.compute.manager [req-23f0e6ac-9a1d-4b79-91a1-b666ae8a4d73 req-be64ed7e-6e48-49b4-9f8a-40a92f5b446d service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Received event network-vif-plugged-06e3d114-d80f-4634-840a-d4e120c77a88 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:53:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-23f0e6ac-9a1d-4b79-91a1-b666ae8a4d73 req-be64ed7e-6e48-49b4-9f8a-40a92f5b446d service nova] Acquiring lock "4b60ac08-e954-46d5-a280-a11146b3ebf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:53:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-23f0e6ac-9a1d-4b79-91a1-b666ae8a4d73 req-be64ed7e-6e48-49b4-9f8a-40a92f5b446d service nova] Lock "4b60ac08-e954-46d5-a280-a11146b3ebf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:53:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-23f0e6ac-9a1d-4b79-91a1-b666ae8a4d73 req-be64ed7e-6e48-49b4-9f8a-40a92f5b446d service nova] Lock "4b60ac08-e954-46d5-a280-a11146b3ebf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:53:01 user nova-compute[74850]: DEBUG nova.compute.manager [req-23f0e6ac-9a1d-4b79-91a1-b666ae8a4d73 req-be64ed7e-6e48-49b4-9f8a-40a92f5b446d service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] No waiting events found dispatching network-vif-plugged-06e3d114-d80f-4634-840a-d4e120c77a88 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:53:01 user nova-compute[74850]: WARNING nova.compute.manager [req-23f0e6ac-9a1d-4b79-91a1-b666ae8a4d73 req-be64ed7e-6e48-49b4-9f8a-40a92f5b446d service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Received unexpected event network-vif-plugged-06e3d114-d80f-4634-840a-d4e120c77a88 for instance with vm_state active and task_state rescuing.
Nov 14 00:53:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:03 user nova-compute[74850]: DEBUG nova.compute.manager [req-3d872f86-8978-42a7-8c8c-7bb601adf82b req-939eeb2d-f6a9-40dd-9475-e43417ba72f8 service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Received event network-vif-plugged-745756ea-b360-423f-8258-5339a80658b5 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:53:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3d872f86-8978-42a7-8c8c-7bb601adf82b req-939eeb2d-f6a9-40dd-9475-e43417ba72f8 service nova] Acquiring lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:53:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3d872f86-8978-42a7-8c8c-7bb601adf82b req-939eeb2d-f6a9-40dd-9475-e43417ba72f8 service nova] Lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:53:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3d872f86-8978-42a7-8c8c-7bb601adf82b req-939eeb2d-f6a9-40dd-9475-e43417ba72f8 service nova] Lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:53:03 user nova-compute[74850]: DEBUG nova.compute.manager [req-3d872f86-8978-42a7-8c8c-7bb601adf82b req-939eeb2d-f6a9-40dd-9475-e43417ba72f8 service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] No waiting events found dispatching network-vif-plugged-745756ea-b360-423f-8258-5339a80658b5 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:53:03 user nova-compute[74850]: WARNING nova.compute.manager [req-3d872f86-8978-42a7-8c8c-7bb601adf82b req-939eeb2d-f6a9-40dd-9475-e43417ba72f8 service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Received unexpected event network-vif-plugged-745756ea-b360-423f-8258-5339a80658b5 for instance with vm_state active and task_state resize_finish.
Nov 14 00:53:03 user nova-compute[74850]: DEBUG nova.compute.manager [req-82e36d33-c0fc-4d6b-8a43-8e751929c5e0 req-11cff7df-1515-41ce-a9d8-d3abf44ee366 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Received event network-vif-plugged-06e3d114-d80f-4634-840a-d4e120c77a88 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:53:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-82e36d33-c0fc-4d6b-8a43-8e751929c5e0 req-11cff7df-1515-41ce-a9d8-d3abf44ee366 service nova] Acquiring lock "4b60ac08-e954-46d5-a280-a11146b3ebf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:53:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-82e36d33-c0fc-4d6b-8a43-8e751929c5e0 req-11cff7df-1515-41ce-a9d8-d3abf44ee366 service nova] Lock "4b60ac08-e954-46d5-a280-a11146b3ebf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:53:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-82e36d33-c0fc-4d6b-8a43-8e751929c5e0 req-11cff7df-1515-41ce-a9d8-d3abf44ee366 service nova] Lock "4b60ac08-e954-46d5-a280-a11146b3ebf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:53:03 user nova-compute[74850]: DEBUG nova.compute.manager [req-82e36d33-c0fc-4d6b-8a43-8e751929c5e0 req-11cff7df-1515-41ce-a9d8-d3abf44ee366 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] No waiting events found dispatching network-vif-plugged-06e3d114-d80f-4634-840a-d4e120c77a88 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:53:03 user nova-compute[74850]: WARNING nova.compute.manager [req-82e36d33-c0fc-4d6b-8a43-8e751929c5e0 req-11cff7df-1515-41ce-a9d8-d3abf44ee366 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Received unexpected event network-vif-plugged-06e3d114-d80f-4634-840a-d4e120c77a88 for instance with vm_state active and task_state rescuing.
Nov 14 00:53:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:04 user nova-compute[74850]: DEBUG nova.compute.manager [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:53:04 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Instance running successfully.
Nov 14 00:53:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Failed to set time: agent not configured {{(pid=74850) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 14 00:53:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b041a5cb-3c10-431b-925f-2c671ef3ecea tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] finish_migration finished successfully. {{(pid=74850) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 14 00:53:04 user nova-compute[74850]: DEBUG nova.compute.manager [None req-e02de186-bd39-4029-832d-c0310d4ea165 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:53:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f3cedbe5-1311-4cde-8b30-79ce692e4c79 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Acquiring lock "e2f305e1-7092-4e8a-bb47-a15c89388eb2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:53:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f3cedbe5-1311-4cde-8b30-79ce692e4c79 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Lock "e2f305e1-7092-4e8a-bb47-a15c89388eb2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:53:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f3cedbe5-1311-4cde-8b30-79ce692e4c79 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Acquiring lock "e2f305e1-7092-4e8a-bb47-a15c89388eb2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:53:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f3cedbe5-1311-4cde-8b30-79ce692e4c79 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Lock "e2f305e1-7092-4e8a-bb47-a15c89388eb2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:53:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f3cedbe5-1311-4cde-8b30-79ce692e4c79 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Lock "e2f305e1-7092-4e8a-bb47-a15c89388eb2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:53:08 user nova-compute[74850]: INFO nova.compute.manager [None req-f3cedbe5-1311-4cde-8b30-79ce692e4c79 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Terminating instance
Nov 14 00:53:08 user nova-compute[74850]: DEBUG nova.compute.manager [None req-f3cedbe5-1311-4cde-8b30-79ce692e4c79 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 00:53:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:08 user nova-compute[74850]: DEBUG nova.compute.manager [req-ae097e55-2235-43d6-ae5d-d7791d8a901e req-57b3b4d4-c6fa-4dbd-91fc-20a15137facd service nova] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Received event network-vif-unplugged-494f4389-78fe-41c4-aa06-c1b2666915cb {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:53:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ae097e55-2235-43d6-ae5d-d7791d8a901e req-57b3b4d4-c6fa-4dbd-91fc-20a15137facd service nova] Acquiring lock "e2f305e1-7092-4e8a-bb47-a15c89388eb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:53:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ae097e55-2235-43d6-ae5d-d7791d8a901e req-57b3b4d4-c6fa-4dbd-91fc-20a15137facd service nova] Lock "e2f305e1-7092-4e8a-bb47-a15c89388eb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:53:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ae097e55-2235-43d6-ae5d-d7791d8a901e req-57b3b4d4-c6fa-4dbd-91fc-20a15137facd service nova] Lock "e2f305e1-7092-4e8a-bb47-a15c89388eb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:53:08 user nova-compute[74850]: DEBUG nova.compute.manager [req-ae097e55-2235-43d6-ae5d-d7791d8a901e req-57b3b4d4-c6fa-4dbd-91fc-20a15137facd service nova] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] No waiting events found dispatching network-vif-unplugged-494f4389-78fe-41c4-aa06-c1b2666915cb {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:53:08 user nova-compute[74850]: DEBUG nova.compute.manager [req-ae097e55-2235-43d6-ae5d-d7791d8a901e req-57b3b4d4-c6fa-4dbd-91fc-20a15137facd service nova] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Received event network-vif-unplugged-494f4389-78fe-41c4-aa06-c1b2666915cb for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 00:53:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:09 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Instance destroyed successfully.
Nov 14 00:53:09 user nova-compute[74850]: DEBUG nova.objects.instance [None req-f3cedbe5-1311-4cde-8b30-79ce692e4c79 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Lazy-loading 'resources' on Instance uuid e2f305e1-7092-4e8a-bb47-a15c89388eb2 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:53:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-f3cedbe5-1311-4cde-8b30-79ce692e4c79 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:51:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1518541907',display_name='tempest-ServersNegativeTestJSON-server-1518541907',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1518541907',id=22,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:51:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf004672a7b54f718937d1a0db6cec04',ramdisk_id='',reservation_id='r-qyggtxhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1191110421',owner_user_name='tempest-ServersNegativeTestJSON-1191110421-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:51:26Z,user_data=None,user_id='1fb1ab671fa64b55ac3d30df3d41cb3b',uuid=e2f305e1-7092-4e8a-bb47-a15c89388eb2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "494f4389-78fe-41c4-aa06-c1b2666915cb", "address": "fa:16:3e:f7:89:24", "network": {"id": "70b59622-f2a8-4dfc-9f03-828f4824be1e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1478695014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf004672a7b54f718937d1a0db6cec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494f4389-78", "ovs_interfaceid": "494f4389-78fe-41c4-aa06-c1b2666915cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:53:09 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-f3cedbe5-1311-4cde-8b30-79ce692e4c79 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Converting VIF {"id": "494f4389-78fe-41c4-aa06-c1b2666915cb", "address": "fa:16:3e:f7:89:24", "network": {"id": "70b59622-f2a8-4dfc-9f03-828f4824be1e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1478695014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf004672a7b54f718937d1a0db6cec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494f4389-78", "ovs_interfaceid": "494f4389-78fe-41c4-aa06-c1b2666915cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:53:09 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-f3cedbe5-1311-4cde-8b30-79ce692e4c79 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:89:24,bridge_name='br-int',has_traffic_filtering=True,id=494f4389-78fe-41c4-aa06-c1b2666915cb,network=Network(70b59622-f2a8-4dfc-9f03-828f4824be1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494f4389-78') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:53:09 user nova-compute[74850]: DEBUG os_vif [None req-f3cedbe5-1311-4cde-8b30-79ce692e4c79 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:89:24,bridge_name='br-int',has_traffic_filtering=True,id=494f4389-78fe-41c4-aa06-c1b2666915cb,network=Network(70b59622-f2a8-4dfc-9f03-828f4824be1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494f4389-78') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:53:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap494f4389-78, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:53:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dbb4ff83-ba41-4caf-b8c9-ae490b3f37f3) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:53:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:09 user nova-compute[74850]: INFO os_vif [None req-f3cedbe5-1311-4cde-8b30-79ce692e4c79 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:89:24,bridge_name='br-int',has_traffic_filtering=True,id=494f4389-78fe-41c4-aa06-c1b2666915cb,network=Network(70b59622-f2a8-4dfc-9f03-828f4824be1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494f4389-78')
Nov 14 00:53:09 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-f3cedbe5-1311-4cde-8b30-79ce692e4c79 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Deleting instance files /opt/stack/data/nova/instances/e2f305e1-7092-4e8a-bb47-a15c89388eb2_del
Nov 14 00:53:09 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-f3cedbe5-1311-4cde-8b30-79ce692e4c79 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Deletion of /opt/stack/data/nova/instances/e2f305e1-7092-4e8a-bb47-a15c89388eb2_del complete
Nov 14 00:53:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:09 user nova-compute[74850]: INFO nova.compute.manager [None req-f3cedbe5-1311-4cde-8b30-79ce692e4c79 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Took 0.74 seconds to destroy the instance on the hypervisor.
Nov 14 00:53:09 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-f3cedbe5-1311-4cde-8b30-79ce692e4c79 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 00:53:09 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 00:53:09 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 00:53:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:09 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:53:09 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Took 0.66 seconds to deallocate network for instance.
Nov 14 00:53:09 user nova-compute[74850]: DEBUG nova.compute.manager [req-5d0353c8-c56c-4160-afc7-6c337936b995 req-9ce65c5c-938d-4fe4-9399-4a4c71ec1886 service nova] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Received event network-vif-deleted-494f4389-78fe-41c4-aa06-c1b2666915cb {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:53:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f3cedbe5-1311-4cde-8b30-79ce692e4c79 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:53:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f3cedbe5-1311-4cde-8b30-79ce692e4c79 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:53:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:10 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-f3cedbe5-1311-4cde-8b30-79ce692e4c79 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:53:10 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-f3cedbe5-1311-4cde-8b30-79ce692e4c79 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:53:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f3cedbe5-1311-4cde-8b30-79ce692e4c79 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.499s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:53:10 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-f3cedbe5-1311-4cde-8b30-79ce692e4c79 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Deleted allocations for instance e2f305e1-7092-4e8a-bb47-a15c89388eb2
Nov 14 00:53:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f3cedbe5-1311-4cde-8b30-79ce692e4c79 tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Lock "e2f305e1-7092-4e8a-bb47-a15c89388eb2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.117s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:53:10 user nova-compute[74850]: DEBUG nova.compute.manager [req-7595699f-c9f5-48a4-a2b8-a5360c99166e req-a9606d85-a5ce-4a9d-bb3b-abe769c80d43 service nova] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Received event network-vif-plugged-494f4389-78fe-41c4-aa06-c1b2666915cb {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:53:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7595699f-c9f5-48a4-a2b8-a5360c99166e req-a9606d85-a5ce-4a9d-bb3b-abe769c80d43 service nova] Acquiring lock "e2f305e1-7092-4e8a-bb47-a15c89388eb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:53:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7595699f-c9f5-48a4-a2b8-a5360c99166e req-a9606d85-a5ce-4a9d-bb3b-abe769c80d43 service nova] Lock "e2f305e1-7092-4e8a-bb47-a15c89388eb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:53:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7595699f-c9f5-48a4-a2b8-a5360c99166e req-a9606d85-a5ce-4a9d-bb3b-abe769c80d43 service nova] Lock "e2f305e1-7092-4e8a-bb47-a15c89388eb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:53:10 user nova-compute[74850]: DEBUG nova.compute.manager [req-7595699f-c9f5-48a4-a2b8-a5360c99166e req-a9606d85-a5ce-4a9d-bb3b-abe769c80d43 service nova] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] No waiting events found dispatching network-vif-plugged-494f4389-78fe-41c4-aa06-c1b2666915cb {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:53:10 user nova-compute[74850]: WARNING nova.compute.manager [req-7595699f-c9f5-48a4-a2b8-a5360c99166e req-a9606d85-a5ce-4a9d-bb3b-abe769c80d43 service nova] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Received unexpected event network-vif-plugged-494f4389-78fe-41c4-aa06-c1b2666915cb for instance with vm_state deleted and task_state None.
Nov 14 00:53:10 user nova-compute[74850]: DEBUG nova.compute.manager [req-7595699f-c9f5-48a4-a2b8-a5360c99166e req-a9606d85-a5ce-4a9d-bb3b-abe769c80d43 service nova] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Received event network-vif-plugged-494f4389-78fe-41c4-aa06-c1b2666915cb {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:53:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7595699f-c9f5-48a4-a2b8-a5360c99166e req-a9606d85-a5ce-4a9d-bb3b-abe769c80d43 service nova] Acquiring lock "e2f305e1-7092-4e8a-bb47-a15c89388eb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:53:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7595699f-c9f5-48a4-a2b8-a5360c99166e req-a9606d85-a5ce-4a9d-bb3b-abe769c80d43 service nova] Lock "e2f305e1-7092-4e8a-bb47-a15c89388eb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:53:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7595699f-c9f5-48a4-a2b8-a5360c99166e req-a9606d85-a5ce-4a9d-bb3b-abe769c80d43 service nova] Lock "e2f305e1-7092-4e8a-bb47-a15c89388eb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:53:10 user nova-compute[74850]: DEBUG nova.compute.manager [req-7595699f-c9f5-48a4-a2b8-a5360c99166e req-a9606d85-a5ce-4a9d-bb3b-abe769c80d43 service nova] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] No waiting events found dispatching network-vif-plugged-494f4389-78fe-41c4-aa06-c1b2666915cb {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:53:10 user nova-compute[74850]: WARNING nova.compute.manager [req-7595699f-c9f5-48a4-a2b8-a5360c99166e req-a9606d85-a5ce-4a9d-bb3b-abe769c80d43 service nova] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Received unexpected event network-vif-plugged-494f4389-78fe-41c4-aa06-c1b2666915cb for instance with vm_state deleted and task_state None.
Nov 14 00:53:10 user nova-compute[74850]: DEBUG nova.compute.manager [req-7595699f-c9f5-48a4-a2b8-a5360c99166e req-a9606d85-a5ce-4a9d-bb3b-abe769c80d43 service nova] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Received event network-vif-plugged-494f4389-78fe-41c4-aa06-c1b2666915cb {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:53:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7595699f-c9f5-48a4-a2b8-a5360c99166e req-a9606d85-a5ce-4a9d-bb3b-abe769c80d43 service nova] Acquiring lock "e2f305e1-7092-4e8a-bb47-a15c89388eb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:53:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7595699f-c9f5-48a4-a2b8-a5360c99166e req-a9606d85-a5ce-4a9d-bb3b-abe769c80d43 service nova] Lock "e2f305e1-7092-4e8a-bb47-a15c89388eb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:53:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7595699f-c9f5-48a4-a2b8-a5360c99166e req-a9606d85-a5ce-4a9d-bb3b-abe769c80d43 service nova] Lock "e2f305e1-7092-4e8a-bb47-a15c89388eb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:53:10 user nova-compute[74850]: DEBUG nova.compute.manager [req-7595699f-c9f5-48a4-a2b8-a5360c99166e req-a9606d85-a5ce-4a9d-bb3b-abe769c80d43 service nova] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] No waiting events found dispatching network-vif-plugged-494f4389-78fe-41c4-aa06-c1b2666915cb {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:53:10 user nova-compute[74850]: WARNING nova.compute.manager [req-7595699f-c9f5-48a4-a2b8-a5360c99166e req-a9606d85-a5ce-4a9d-bb3b-abe769c80d43 service nova] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Received unexpected event network-vif-plugged-494f4389-78fe-41c4-aa06-c1b2666915cb for instance with vm_state deleted and task_state None.
Nov 14 00:53:10 user nova-compute[74850]: DEBUG nova.compute.manager [req-7595699f-c9f5-48a4-a2b8-a5360c99166e req-a9606d85-a5ce-4a9d-bb3b-abe769c80d43 service nova] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Received event network-vif-unplugged-494f4389-78fe-41c4-aa06-c1b2666915cb {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:53:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7595699f-c9f5-48a4-a2b8-a5360c99166e req-a9606d85-a5ce-4a9d-bb3b-abe769c80d43 service nova] Acquiring lock "e2f305e1-7092-4e8a-bb47-a15c89388eb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:53:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7595699f-c9f5-48a4-a2b8-a5360c99166e req-a9606d85-a5ce-4a9d-bb3b-abe769c80d43 service nova] Lock "e2f305e1-7092-4e8a-bb47-a15c89388eb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:53:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7595699f-c9f5-48a4-a2b8-a5360c99166e req-a9606d85-a5ce-4a9d-bb3b-abe769c80d43 service nova] Lock "e2f305e1-7092-4e8a-bb47-a15c89388eb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:53:10 user nova-compute[74850]: DEBUG nova.compute.manager [req-7595699f-c9f5-48a4-a2b8-a5360c99166e req-a9606d85-a5ce-4a9d-bb3b-abe769c80d43 service nova] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] No waiting events found dispatching network-vif-unplugged-494f4389-78fe-41c4-aa06-c1b2666915cb {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:53:10 user nova-compute[74850]: WARNING nova.compute.manager [req-7595699f-c9f5-48a4-a2b8-a5360c99166e req-a9606d85-a5ce-4a9d-bb3b-abe769c80d43 service nova] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Received unexpected event network-vif-unplugged-494f4389-78fe-41c4-aa06-c1b2666915cb for instance with vm_state deleted and task_state None.
Nov 14 00:53:10 user nova-compute[74850]: DEBUG nova.compute.manager [req-7595699f-c9f5-48a4-a2b8-a5360c99166e req-a9606d85-a5ce-4a9d-bb3b-abe769c80d43 service nova] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Received event network-vif-plugged-494f4389-78fe-41c4-aa06-c1b2666915cb {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:53:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7595699f-c9f5-48a4-a2b8-a5360c99166e req-a9606d85-a5ce-4a9d-bb3b-abe769c80d43 service nova] Acquiring lock "e2f305e1-7092-4e8a-bb47-a15c89388eb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:53:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7595699f-c9f5-48a4-a2b8-a5360c99166e req-a9606d85-a5ce-4a9d-bb3b-abe769c80d43 service nova] Lock "e2f305e1-7092-4e8a-bb47-a15c89388eb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:53:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7595699f-c9f5-48a4-a2b8-a5360c99166e req-a9606d85-a5ce-4a9d-bb3b-abe769c80d43 service nova] Lock "e2f305e1-7092-4e8a-bb47-a15c89388eb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:53:10 user nova-compute[74850]: DEBUG nova.compute.manager [req-7595699f-c9f5-48a4-a2b8-a5360c99166e req-a9606d85-a5ce-4a9d-bb3b-abe769c80d43 service nova] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] No waiting events found dispatching network-vif-plugged-494f4389-78fe-41c4-aa06-c1b2666915cb {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:53:10 user nova-compute[74850]: WARNING nova.compute.manager [req-7595699f-c9f5-48a4-a2b8-a5360c99166e req-a9606d85-a5ce-4a9d-bb3b-abe769c80d43 service nova] [instance: e2f305e1-7092-4e8a-bb47-a15c89388eb2] Received unexpected event network-vif-plugged-494f4389-78fe-41c4-aa06-c1b2666915cb for instance with vm_state deleted and task_state None.
Nov 14 00:53:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:15 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:53:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:53:16 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 00:53:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:53:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:53:16 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 00:53:16 user nova-compute[74850]: INFO nova.compute.claims [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Claim successful on node user
Nov 14 00:53:17 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:53:17 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:53:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:53:17 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 00:53:17 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 00:53:17 user nova-compute[74850]: DEBUG nova.network.neutron [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 00:53:17 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 00:53:17 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 00:53:17 user nova-compute[74850]: DEBUG nova.policy [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '84158c07e3344e01bf82e0e25e2a7244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933e8bc63bd442d882ff59243bd7faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 00:53:17 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 00:53:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 00:53:17 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Creating image(s)
Nov 14 00:53:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "/opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:53:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "/opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:53:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "/opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:53:17 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:17 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.176s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:53:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:53:17 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:17 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.181s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:17 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:17 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk 1073741824" returned: 0 in 0.063s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:53:17 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:17 user nova-compute[74850]: DEBUG nova.network.neutron [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Successfully created port: 5a111053-6390-4a23-97c2-9171e744c3c7 {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:53:17 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.173s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:17 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Checking if we can resize image /opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 00:53:17 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:18 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Cannot resize image /opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 00:53:18 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 00:53:18 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Ensure instance console log exists: /opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 00:53:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:53:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:53:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:53:18 user nova-compute[74850]: DEBUG nova.network.neutron [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Successfully updated port: 5a111053-6390-4a23-97c2-9171e744c3c7 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:53:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "refresh_cache-211c1477-8a76-4ecd-a7c8-dc0b5903d38c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:53:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquired lock "refresh_cache-211c1477-8a76-4ecd-a7c8-dc0b5903d38c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:53:18 user nova-compute[74850]: DEBUG nova.network.neutron [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:53:18 user nova-compute[74850]: DEBUG nova.compute.manager [req-b1e14ac1-7dc8-47d6-bfc4-9f62b9985805 req-4526b656-8332-47d0-8727-0ccbbeeb8439 service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Received event network-changed-5a111053-6390-4a23-97c2-9171e744c3c7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:53:18 user nova-compute[74850]: DEBUG nova.compute.manager [req-b1e14ac1-7dc8-47d6-bfc4-9f62b9985805 req-4526b656-8332-47d0-8727-0ccbbeeb8439 service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Refreshing instance network info cache due to event network-changed-5a111053-6390-4a23-97c2-9171e744c3c7. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:53:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b1e14ac1-7dc8-47d6-bfc4-9f62b9985805 req-4526b656-8332-47d0-8727-0ccbbeeb8439 service nova] Acquiring lock "refresh_cache-211c1477-8a76-4ecd-a7c8-dc0b5903d38c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:53:18 user nova-compute[74850]: DEBUG nova.network.neutron [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:53:18 user nova-compute[74850]: DEBUG nova.network.neutron [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Updating instance_info_cache with network_info: [{"id": "5a111053-6390-4a23-97c2-9171e744c3c7", "address": "fa:16:3e:52:fd:39", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a111053-63", "ovs_interfaceid": "5a111053-6390-4a23-97c2-9171e744c3c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:53:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Releasing lock "refresh_cache-211c1477-8a76-4ecd-a7c8-dc0b5903d38c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:53:18 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Instance network_info: |[{"id": "5a111053-6390-4a23-97c2-9171e744c3c7", "address": "fa:16:3e:52:fd:39", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a111053-63", "ovs_interfaceid": "5a111053-6390-4a23-97c2-9171e744c3c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 00:53:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b1e14ac1-7dc8-47d6-bfc4-9f62b9985805 req-4526b656-8332-47d0-8727-0ccbbeeb8439 service nova] Acquired lock "refresh_cache-211c1477-8a76-4ecd-a7c8-dc0b5903d38c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:53:18 user nova-compute[74850]: DEBUG nova.network.neutron [req-b1e14ac1-7dc8-47d6-bfc4-9f62b9985805 req-4526b656-8332-47d0-8727-0ccbbeeb8439 service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Refreshing network info cache for port 5a111053-6390-4a23-97c2-9171e744c3c7 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:53:18 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Start _get_guest_xml network_info=[{"id": "5a111053-6390-4a23-97c2-9171e744c3c7", "address": "fa:16:3e:52:fd:39", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a111053-63", "ovs_interfaceid": "5a111053-6390-4a23-97c2-9171e744c3c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:53:18 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:53:18 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:53:18 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:53:18 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:53:18 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:53:18 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:53:18 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:53:18 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:53:18 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:53:18 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:53:18 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:53:18 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:53:18 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:53:18 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:53:18 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:53:18 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:53:18 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:53:18 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:53:19 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1861720430',display_name='tempest-ServerRescueNegativeTestJSON-server-1861720430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1861720430',id=25,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1R4v8zKtyosS53OifNAB7kqp6eZmbuqDbYYyccqJkmGYh7Qj/Z0gVko0VLZsVSZ9mFQ9vPph+SAXAMe6TVaSwOY0UjEI/J86dVqOxg1LLdfUZg+8Hx9p8XFQmsZUZe9w==',key_name='tempest-keypair-344758225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e933e8bc63bd442d882ff59243bd7faa',ramdisk_id='',reservation_id='r-tu15g70v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-103787426',owner_user_name='tempest-ServerRescueNegativeTestJSON-103787426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:53:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84158c07e3344e01bf82e0e25e2a7244',uuid=211c1477-8a76-4ecd-a7c8-dc0b5903d38c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a111053-6390-4a23-97c2-9171e744c3c7", "address": "fa:16:3e:52:fd:39", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a111053-63", "ovs_interfaceid": "5a111053-6390-4a23-97c2-9171e744c3c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:53:19 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Converting VIF {"id": "5a111053-6390-4a23-97c2-9171e744c3c7", "address": "fa:16:3e:52:fd:39", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a111053-63", "ovs_interfaceid": "5a111053-6390-4a23-97c2-9171e744c3c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:53:19 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:fd:39,bridge_name='br-int',has_traffic_filtering=True,id=5a111053-6390-4a23-97c2-9171e744c3c7,network=Network(4bb9b9bb-4485-4fed-bf0e-f549b29f09da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a111053-63') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:53:19 user nova-compute[74850]: DEBUG nova.objects.instance [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lazy-loading 'pci_devices' on Instance uuid 211c1477-8a76-4ecd-a7c8-dc0b5903d38c {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:53:19 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:53:19 user nova-compute[74850]:   <uuid>211c1477-8a76-4ecd-a7c8-dc0b5903d38c</uuid>
Nov 14 00:53:19 user nova-compute[74850]:   <name>instance-00000019</name>
Nov 14 00:53:19 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:53:19 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:53:19 user nova-compute[74850]:   <metadata>
Nov 14 00:53:19 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:53:19 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:53:19 user nova-compute[74850]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1861720430</nova:name>
Nov 14 00:53:19 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:53:18</nova:creationTime>
Nov 14 00:53:19 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:53:19 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:53:19 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:53:19 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:53:19 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:53:19 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:53:19 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:53:19 user nova-compute[74850]:       <nova:owner>
Nov 14 00:53:19 user nova-compute[74850]:         <nova:user uuid="84158c07e3344e01bf82e0e25e2a7244">tempest-ServerRescueNegativeTestJSON-103787426-project-member</nova:user>
Nov 14 00:53:19 user nova-compute[74850]:         <nova:project uuid="e933e8bc63bd442d882ff59243bd7faa">tempest-ServerRescueNegativeTestJSON-103787426</nova:project>
Nov 14 00:53:19 user nova-compute[74850]:       </nova:owner>
Nov 14 00:53:19 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:53:19 user nova-compute[74850]:       <nova:ports>
Nov 14 00:53:19 user nova-compute[74850]:         <nova:port uuid="5a111053-6390-4a23-97c2-9171e744c3c7">
Nov 14 00:53:19 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 00:53:19 user nova-compute[74850]:         </nova:port>
Nov 14 00:53:19 user nova-compute[74850]:       </nova:ports>
Nov 14 00:53:19 user nova-compute[74850]:     </nova:instance>
Nov 14 00:53:19 user nova-compute[74850]:   </metadata>
Nov 14 00:53:19 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:53:19 user nova-compute[74850]:     <system>
Nov 14 00:53:19 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:53:19 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:53:19 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:53:19 user nova-compute[74850]:       <entry name="serial">211c1477-8a76-4ecd-a7c8-dc0b5903d38c</entry>
Nov 14 00:53:19 user nova-compute[74850]:       <entry name="uuid">211c1477-8a76-4ecd-a7c8-dc0b5903d38c</entry>
Nov 14 00:53:19 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:53:19 user nova-compute[74850]:     </system>
Nov 14 00:53:19 user nova-compute[74850]:   </sysinfo>
Nov 14 00:53:19 user nova-compute[74850]:   <os>
Nov 14 00:53:19 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:53:19 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 00:53:19 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:53:19 user nova-compute[74850]:   </os>
Nov 14 00:53:19 user nova-compute[74850]:   <features>
Nov 14 00:53:19 user nova-compute[74850]:     <acpi/>
Nov 14 00:53:19 user nova-compute[74850]:     <apic/>
Nov 14 00:53:19 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:53:19 user nova-compute[74850]:   </features>
Nov 14 00:53:19 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:53:19 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:53:19 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:53:19 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:53:19 user nova-compute[74850]:   </clock>
Nov 14 00:53:19 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:53:19 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:53:19 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:53:19 user nova-compute[74850]:   </cpu>
Nov 14 00:53:19 user nova-compute[74850]:   <devices>
Nov 14 00:53:19 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 00:53:19 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:53:19 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk"/>
Nov 14 00:53:19 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:53:19 user nova-compute[74850]:     </disk>
Nov 14 00:53:19 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:53:19 user nova-compute[74850]:       <mac address="fa:16:3e:52:fd:39"/>
Nov 14 00:53:19 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:53:19 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:53:19 user nova-compute[74850]:       <target dev="tap5a111053-63"/>
Nov 14 00:53:19 user nova-compute[74850]:     </interface>
Nov 14 00:53:19 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:53:19 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/console.log" append="off"/>
Nov 14 00:53:19 user nova-compute[74850]:     </serial>
Nov 14 00:53:19 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:53:19 user nova-compute[74850]:     <video>
Nov 14 00:53:19 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:53:19 user nova-compute[74850]:     </video>
Nov 14 00:53:19 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:53:19 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:53:19 user nova-compute[74850]:     </rng>
Nov 14 00:53:19 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:53:19 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:53:19 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:53:19 user nova-compute[74850]:     </memballoon>
Nov 14 00:53:19 user nova-compute[74850]:   </devices>
Nov 14 00:53:19 user nova-compute[74850]: </domain>
Nov 14 00:53:19 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:53:19 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1861720430',display_name='tempest-ServerRescueNegativeTestJSON-server-1861720430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1861720430',id=25,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1R4v8zKtyosS53OifNAB7kqp6eZmbuqDbYYyccqJkmGYh7Qj/Z0gVko0VLZsVSZ9mFQ9vPph+SAXAMe6TVaSwOY0UjEI/J86dVqOxg1LLdfUZg+8Hx9p8XFQmsZUZe9w==',key_name='tempest-keypair-344758225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e933e8bc63bd442d882ff59243bd7faa',ramdisk_id='',reservation_id='r-tu15g70v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-103787426',owner_user_name='tempest-ServerRescueNegativeTestJSON-103787426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:53:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84158c07e3344e01bf82e0e25e2a7244',uuid=211c1477-8a76-4ecd-a7c8-dc0b5903d38c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a111053-6390-4a23-97c2-9171e744c3c7", "address": "fa:16:3e:52:fd:39", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a111053-63", "ovs_interfaceid": "5a111053-6390-4a23-97c2-9171e744c3c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:53:19 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Converting VIF {"id": "5a111053-6390-4a23-97c2-9171e744c3c7", "address": "fa:16:3e:52:fd:39", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a111053-63", "ovs_interfaceid": "5a111053-6390-4a23-97c2-9171e744c3c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:53:19 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:fd:39,bridge_name='br-int',has_traffic_filtering=True,id=5a111053-6390-4a23-97c2-9171e744c3c7,network=Network(4bb9b9bb-4485-4fed-bf0e-f549b29f09da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a111053-63') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:53:19 user nova-compute[74850]: DEBUG os_vif [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:fd:39,bridge_name='br-int',has_traffic_filtering=True,id=5a111053-6390-4a23-97c2-9171e744c3c7,network=Network(4bb9b9bb-4485-4fed-bf0e-f549b29f09da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a111053-63') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:53:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:53:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:53:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '68ad9f8f-b8f1-578b-add1-bb5a4f9b4c02', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:53:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:53:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a111053-63, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:53:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5a111053-63, col_values=(('qos', UUID('bff96806-f247-4ef6-a612-adee580f2b8c')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:53:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5a111053-63, col_values=(('external_ids', {'iface-id': '5a111053-6390-4a23-97c2-9171e744c3c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:fd:39', 'vm-uuid': '211c1477-8a76-4ecd-a7c8-dc0b5903d38c'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:53:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:53:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:19 user nova-compute[74850]: INFO os_vif [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:fd:39,bridge_name='br-int',has_traffic_filtering=True,id=5a111053-6390-4a23-97c2-9171e744c3c7,network=Network(4bb9b9bb-4485-4fed-bf0e-f549b29f09da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a111053-63')
Nov 14 00:53:19 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:53:19 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] No VIF found with MAC fa:16:3e:52:fd:39, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:53:19 user nova-compute[74850]: DEBUG nova.network.neutron [req-b1e14ac1-7dc8-47d6-bfc4-9f62b9985805 req-4526b656-8332-47d0-8727-0ccbbeeb8439 service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Updated VIF entry in instance network info cache for port 5a111053-6390-4a23-97c2-9171e744c3c7. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:53:19 user nova-compute[74850]: DEBUG nova.network.neutron [req-b1e14ac1-7dc8-47d6-bfc4-9f62b9985805 req-4526b656-8332-47d0-8727-0ccbbeeb8439 service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Updating instance_info_cache with network_info: [{"id": "5a111053-6390-4a23-97c2-9171e744c3c7", "address": "fa:16:3e:52:fd:39", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a111053-63", "ovs_interfaceid": "5a111053-6390-4a23-97c2-9171e744c3c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:53:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b1e14ac1-7dc8-47d6-bfc4-9f62b9985805 req-4526b656-8332-47d0-8727-0ccbbeeb8439 service nova] Releasing lock "refresh_cache-211c1477-8a76-4ecd-a7c8-dc0b5903d38c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:53:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:20 user nova-compute[74850]: DEBUG nova.compute.manager [req-ccd658a6-b169-4656-846c-e0fdcef333c3 req-85653b3c-2799-4175-8a3e-aeef27dacedd service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Received event network-vif-plugged-5a111053-6390-4a23-97c2-9171e744c3c7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:53:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ccd658a6-b169-4656-846c-e0fdcef333c3 req-85653b3c-2799-4175-8a3e-aeef27dacedd service nova] Acquiring lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:53:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ccd658a6-b169-4656-846c-e0fdcef333c3 req-85653b3c-2799-4175-8a3e-aeef27dacedd service nova] Lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:53:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ccd658a6-b169-4656-846c-e0fdcef333c3 req-85653b3c-2799-4175-8a3e-aeef27dacedd service nova] Lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:53:20 user nova-compute[74850]: DEBUG nova.compute.manager [req-ccd658a6-b169-4656-846c-e0fdcef333c3 req-85653b3c-2799-4175-8a3e-aeef27dacedd service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] No waiting events found dispatching network-vif-plugged-5a111053-6390-4a23-97c2-9171e744c3c7 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:53:20 user nova-compute[74850]: WARNING nova.compute.manager [req-ccd658a6-b169-4656-846c-e0fdcef333c3 req-85653b3c-2799-4175-8a3e-aeef27dacedd service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Received unexpected event network-vif-plugged-5a111053-6390-4a23-97c2-9171e744c3c7 for instance with vm_state building and task_state spawning.
Nov 14 00:53:22 user nova-compute[74850]: DEBUG nova.compute.manager [req-e063395b-8e21-448f-86d8-9955babcf0f0 req-e2341e3d-a022-499b-8ab6-cc11d294158c service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Received event network-vif-plugged-5a111053-6390-4a23-97c2-9171e744c3c7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:53:22 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e063395b-8e21-448f-86d8-9955babcf0f0 req-e2341e3d-a022-499b-8ab6-cc11d294158c service nova] Acquiring lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:53:22 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e063395b-8e21-448f-86d8-9955babcf0f0 req-e2341e3d-a022-499b-8ab6-cc11d294158c service nova] Lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:53:22 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e063395b-8e21-448f-86d8-9955babcf0f0 req-e2341e3d-a022-499b-8ab6-cc11d294158c service nova] Lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:53:22 user nova-compute[74850]: DEBUG nova.compute.manager [req-e063395b-8e21-448f-86d8-9955babcf0f0 req-e2341e3d-a022-499b-8ab6-cc11d294158c service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] No waiting events found dispatching network-vif-plugged-5a111053-6390-4a23-97c2-9171e744c3c7 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:53:22 user nova-compute[74850]: WARNING nova.compute.manager [req-e063395b-8e21-448f-86d8-9955babcf0f0 req-e2341e3d-a022-499b-8ab6-cc11d294158c service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Received unexpected event network-vif-plugged-5a111053-6390-4a23-97c2-9171e744c3c7 for instance with vm_state building and task_state spawning.
Nov 14 00:53:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:22 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:53:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 00:53:22 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Instance spawned successfully.
Nov 14 00:53:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 00:53:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:53:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:53:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:53:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:53:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:53:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:53:22 user nova-compute[74850]: INFO nova.compute.manager [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Took 5.64 seconds to spawn the instance on the hypervisor.
Nov 14 00:53:22 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:53:23 user nova-compute[74850]: INFO nova.compute.manager [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Took 6.42 seconds to build instance.
Nov 14 00:53:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6949ffff-9205-4ce9-bbf0-9677e3ddc9a4 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.527s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:53:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:30 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "c7952bff-87d6-46c1-a6d4-7729dc4893ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:53:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "c7952bff-87d6-46c1-a6d4-7729dc4893ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:53:33 user nova-compute[74850]: DEBUG nova.compute.manager [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 00:53:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:53:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:53:33 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 00:53:33 user nova-compute[74850]: INFO nova.compute.claims [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Claim successful on node user
Nov 14 00:53:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:53:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:53:33 user nova-compute[74850]: DEBUG nova.compute.manager [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 00:53:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:53:33 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:53:33 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:53:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:53:33 user nova-compute[74850]: DEBUG nova.compute.manager [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 00:53:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.295s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:53:33 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 00:53:33 user nova-compute[74850]: INFO nova.compute.claims [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Claim successful on node user
Nov 14 00:53:33 user nova-compute[74850]: DEBUG nova.compute.manager [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 00:53:33 user nova-compute[74850]: DEBUG nova.network.neutron [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 00:53:33 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 00:53:33 user nova-compute[74850]: DEBUG nova.compute.manager [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 00:53:33 user nova-compute[74850]: DEBUG nova.policy [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a5bb5d788a3b4871ae41f57d06f785f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491aa2a4f38140788cb0de9762a8baf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 00:53:33 user nova-compute[74850]: DEBUG nova.compute.manager [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 00:53:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 00:53:33 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Creating image(s)
Nov 14 00:53:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "/opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:53:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "/opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:53:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "/opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:53:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.172s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:53:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:53:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:34 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:53:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:34 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:53:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.571s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:53:34 user nova-compute[74850]: DEBUG nova.compute.manager [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 00:53:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.184s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:34 user nova-compute[74850]: DEBUG nova.compute.manager [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 00:53:34 user nova-compute[74850]: DEBUG nova.network.neutron [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 00:53:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk 1073741824" returned: 0 in 0.066s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:53:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:34 user nova-compute[74850]: DEBUG nova.network.neutron [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Successfully created port: de35d2a9-b199-4dbc-8394-915938223e27 {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:53:34 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 00:53:34 user nova-compute[74850]: DEBUG nova.compute.manager [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 00:53:34 user nova-compute[74850]: DEBUG nova.policy [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dab7bcadfc32457e8bfa6fa81cba2702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d09cd8d15a4b058988fa348d7fdc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 00:53:34 user nova-compute[74850]: DEBUG nova.compute.manager [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 00:53:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 00:53:34 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Creating image(s)
Nov 14 00:53:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "/opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:53:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "/opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:53:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "/opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:53:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.212s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:34 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 00:53:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:34 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Cannot resize image /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 00:53:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 00:53:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Ensure instance console log exists: /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 00:53:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:53:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:53:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:53:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.181s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:53:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:53:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.172s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk 1073741824" returned: 0 in 0.055s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:53:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.network.neutron [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Successfully created port: eac9af58-5f10-4ea2-a8ef-fb93b63fa661 {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.192s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.network.neutron [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Successfully updated port: de35d2a9-b199-4dbc-8394-915938223e27 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "refresh_cache-c7952bff-87d6-46c1-a6d4-7729dc4893ff" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquired lock "refresh_cache-c7952bff-87d6-46c1-a6d4-7729dc4893ff" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.network.neutron [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.compute.manager [req-bfab10b9-29cc-4ca3-86d5-8a17b6a08998 req-285d2045-f5f6-4e04-9f8f-28c627af1764 service nova] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Received event network-changed-de35d2a9-b199-4dbc-8394-915938223e27 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.compute.manager [req-bfab10b9-29cc-4ca3-86d5-8a17b6a08998 req-285d2045-f5f6-4e04-9f8f-28c627af1764 service nova] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Refreshing instance network info cache due to event network-changed-de35d2a9-b199-4dbc-8394-915938223e27. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-bfab10b9-29cc-4ca3-86d5-8a17b6a08998 req-285d2045-f5f6-4e04-9f8f-28c627af1764 service nova] Acquiring lock "refresh_cache-c7952bff-87d6-46c1-a6d4-7729dc4893ff" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Cannot resize image /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Ensure instance console log exists: /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.network.neutron [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.network.neutron [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Updating instance_info_cache with network_info: [{"id": "de35d2a9-b199-4dbc-8394-915938223e27", "address": "fa:16:3e:b9:56:80", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde35d2a9-b1", "ovs_interfaceid": "de35d2a9-b199-4dbc-8394-915938223e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Releasing lock "refresh_cache-c7952bff-87d6-46c1-a6d4-7729dc4893ff" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.compute.manager [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Instance network_info: |[{"id": "de35d2a9-b199-4dbc-8394-915938223e27", "address": "fa:16:3e:b9:56:80", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde35d2a9-b1", "ovs_interfaceid": "de35d2a9-b199-4dbc-8394-915938223e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-bfab10b9-29cc-4ca3-86d5-8a17b6a08998 req-285d2045-f5f6-4e04-9f8f-28c627af1764 service nova] Acquired lock "refresh_cache-c7952bff-87d6-46c1-a6d4-7729dc4893ff" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.network.neutron [req-bfab10b9-29cc-4ca3-86d5-8a17b6a08998 req-285d2045-f5f6-4e04-9f8f-28c627af1764 service nova] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Refreshing network info cache for port de35d2a9-b199-4dbc-8394-915938223e27 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Start _get_guest_xml network_info=[{"id": "de35d2a9-b199-4dbc-8394-915938223e27", "address": "fa:16:3e:b9:56:80", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde35d2a9-b1", "ovs_interfaceid": "de35d2a9-b199-4dbc-8394-915938223e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:53:35 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:53:35 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:53:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1812687421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1812687421',id=26,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='491aa2a4f38140788cb0de9762a8baf4',ramdisk_id='',reservation_id='r-w45a4rq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-726213232',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:53:34Z,user_data=None,user_id='a5bb5d788a3b4871ae41f57d06f785f2',uuid=c7952bff-87d6-46c1-a6d4-7729dc4893ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de35d2a9-b199-4dbc-8394-915938223e27", "address": "fa:16:3e:b9:56:80", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde35d2a9-b1", "ovs_interfaceid": "de35d2a9-b199-4dbc-8394-915938223e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Converting VIF {"id": "de35d2a9-b199-4dbc-8394-915938223e27", "address": "fa:16:3e:b9:56:80", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde35d2a9-b1", "ovs_interfaceid": "de35d2a9-b199-4dbc-8394-915938223e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:56:80,bridge_name='br-int',has_traffic_filtering=True,id=de35d2a9-b199-4dbc-8394-915938223e27,network=Network(6f8f66ca-e2e8-4565-a05c-df75a16699ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde35d2a9-b1') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.objects.instance [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lazy-loading 'pci_devices' on Instance uuid c7952bff-87d6-46c1-a6d4-7729dc4893ff {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:53:35 user nova-compute[74850]:   <uuid>c7952bff-87d6-46c1-a6d4-7729dc4893ff</uuid>
Nov 14 00:53:35 user nova-compute[74850]:   <name>instance-0000001a</name>
Nov 14 00:53:35 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:53:35 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:53:35 user nova-compute[74850]:   <metadata>
Nov 14 00:53:35 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:53:35 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:53:35 user nova-compute[74850]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1812687421</nova:name>
Nov 14 00:53:35 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:53:35</nova:creationTime>
Nov 14 00:53:35 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:53:35 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:53:35 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:53:35 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:53:35 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:53:35 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:53:35 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:53:35 user nova-compute[74850]:       <nova:owner>
Nov 14 00:53:35 user nova-compute[74850]:         <nova:user uuid="a5bb5d788a3b4871ae41f57d06f785f2">tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member</nova:user>
Nov 14 00:53:35 user nova-compute[74850]:         <nova:project uuid="491aa2a4f38140788cb0de9762a8baf4">tempest-ServerBootFromVolumeStableRescueTest-726213232</nova:project>
Nov 14 00:53:35 user nova-compute[74850]:       </nova:owner>
Nov 14 00:53:35 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:53:35 user nova-compute[74850]:       <nova:ports>
Nov 14 00:53:35 user nova-compute[74850]:         <nova:port uuid="de35d2a9-b199-4dbc-8394-915938223e27">
Nov 14 00:53:35 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 00:53:35 user nova-compute[74850]:         </nova:port>
Nov 14 00:53:35 user nova-compute[74850]:       </nova:ports>
Nov 14 00:53:35 user nova-compute[74850]:     </nova:instance>
Nov 14 00:53:35 user nova-compute[74850]:   </metadata>
Nov 14 00:53:35 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:53:35 user nova-compute[74850]:     <system>
Nov 14 00:53:35 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:53:35 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:53:35 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:53:35 user nova-compute[74850]:       <entry name="serial">c7952bff-87d6-46c1-a6d4-7729dc4893ff</entry>
Nov 14 00:53:35 user nova-compute[74850]:       <entry name="uuid">c7952bff-87d6-46c1-a6d4-7729dc4893ff</entry>
Nov 14 00:53:35 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:53:35 user nova-compute[74850]:     </system>
Nov 14 00:53:35 user nova-compute[74850]:   </sysinfo>
Nov 14 00:53:35 user nova-compute[74850]:   <os>
Nov 14 00:53:35 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:53:35 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 00:53:35 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:53:35 user nova-compute[74850]:   </os>
Nov 14 00:53:35 user nova-compute[74850]:   <features>
Nov 14 00:53:35 user nova-compute[74850]:     <acpi/>
Nov 14 00:53:35 user nova-compute[74850]:     <apic/>
Nov 14 00:53:35 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:53:35 user nova-compute[74850]:   </features>
Nov 14 00:53:35 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:53:35 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:53:35 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:53:35 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:53:35 user nova-compute[74850]:   </clock>
Nov 14 00:53:35 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:53:35 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:53:35 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:53:35 user nova-compute[74850]:   </cpu>
Nov 14 00:53:35 user nova-compute[74850]:   <devices>
Nov 14 00:53:35 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 00:53:35 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:53:35 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk"/>
Nov 14 00:53:35 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:53:35 user nova-compute[74850]:     </disk>
Nov 14 00:53:35 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:53:35 user nova-compute[74850]:       <mac address="fa:16:3e:b9:56:80"/>
Nov 14 00:53:35 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:53:35 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:53:35 user nova-compute[74850]:       <target dev="tapde35d2a9-b1"/>
Nov 14 00:53:35 user nova-compute[74850]:     </interface>
Nov 14 00:53:35 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:53:35 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/console.log" append="off"/>
Nov 14 00:53:35 user nova-compute[74850]:     </serial>
Nov 14 00:53:35 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:53:35 user nova-compute[74850]:     <video>
Nov 14 00:53:35 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:53:35 user nova-compute[74850]:     </video>
Nov 14 00:53:35 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:53:35 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:53:35 user nova-compute[74850]:     </rng>
Nov 14 00:53:35 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:53:35 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:53:35 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:53:35 user nova-compute[74850]:     </memballoon>
Nov 14 00:53:35 user nova-compute[74850]:   </devices>
Nov 14 00:53:35 user nova-compute[74850]: </domain>
Nov 14 00:53:35 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:53:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1812687421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1812687421',id=26,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='491aa2a4f38140788cb0de9762a8baf4',ramdisk_id='',reservation_id='r-w45a4rq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-726213232',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:53:34Z,user_data=None,user_id='a5bb5d788a3b4871ae41f57d06f785f2',uuid=c7952bff-87d6-46c1-a6d4-7729dc4893ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de35d2a9-b199-4dbc-8394-915938223e27", "address": "fa:16:3e:b9:56:80", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde35d2a9-b1", "ovs_interfaceid": "de35d2a9-b199-4dbc-8394-915938223e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Converting VIF {"id": "de35d2a9-b199-4dbc-8394-915938223e27", "address": "fa:16:3e:b9:56:80", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde35d2a9-b1", "ovs_interfaceid": "de35d2a9-b199-4dbc-8394-915938223e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:56:80,bridge_name='br-int',has_traffic_filtering=True,id=de35d2a9-b199-4dbc-8394-915938223e27,network=Network(6f8f66ca-e2e8-4565-a05c-df75a16699ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde35d2a9-b1') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG os_vif [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:56:80,bridge_name='br-int',has_traffic_filtering=True,id=de35d2a9-b199-4dbc-8394-915938223e27,network=Network(6f8f66ca-e2e8-4565-a05c-df75a16699ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde35d2a9-b1') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '44eb0655-180f-5bc5-8a42-294a8fc44520', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde35d2a9-b1, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapde35d2a9-b1, col_values=(('qos', UUID('3ef9eb47-107b-4250-b7bc-ff2a03564449')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapde35d2a9-b1, col_values=(('external_ids', {'iface-id': 'de35d2a9-b199-4dbc-8394-915938223e27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:56:80', 'vm-uuid': 'c7952bff-87d6-46c1-a6d4-7729dc4893ff'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:35 user nova-compute[74850]: INFO os_vif [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:56:80,bridge_name='br-int',has_traffic_filtering=True,id=de35d2a9-b199-4dbc-8394-915938223e27,network=Network(6f8f66ca-e2e8-4565-a05c-df75a16699ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde35d2a9-b1')
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] No VIF found with MAC fa:16:3e:b9:56:80, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.network.neutron [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Successfully updated port: eac9af58-5f10-4ea2-a8ef-fb93b63fa661 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "refresh_cache-5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquired lock "refresh_cache-5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.network.neutron [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.compute.manager [req-d5dd125b-fd2e-4f06-a49c-adad6fca6cfe req-81521062-d053-40c9-a7f7-9c23dbad7ae2 service nova] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Received event network-changed-eac9af58-5f10-4ea2-a8ef-fb93b63fa661 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.compute.manager [req-d5dd125b-fd2e-4f06-a49c-adad6fca6cfe req-81521062-d053-40c9-a7f7-9c23dbad7ae2 service nova] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Refreshing instance network info cache due to event network-changed-eac9af58-5f10-4ea2-a8ef-fb93b63fa661. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d5dd125b-fd2e-4f06-a49c-adad6fca6cfe req-81521062-d053-40c9-a7f7-9c23dbad7ae2 service nova] Acquiring lock "refresh_cache-5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.network.neutron [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.network.neutron [req-bfab10b9-29cc-4ca3-86d5-8a17b6a08998 req-285d2045-f5f6-4e04-9f8f-28c627af1764 service nova] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Updated VIF entry in instance network info cache for port de35d2a9-b199-4dbc-8394-915938223e27. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG nova.network.neutron [req-bfab10b9-29cc-4ca3-86d5-8a17b6a08998 req-285d2045-f5f6-4e04-9f8f-28c627af1764 service nova] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Updating instance_info_cache with network_info: [{"id": "de35d2a9-b199-4dbc-8394-915938223e27", "address": "fa:16:3e:b9:56:80", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde35d2a9-b1", "ovs_interfaceid": "de35d2a9-b199-4dbc-8394-915938223e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:53:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-bfab10b9-29cc-4ca3-86d5-8a17b6a08998 req-285d2045-f5f6-4e04-9f8f-28c627af1764 service nova] Releasing lock "refresh_cache-c7952bff-87d6-46c1-a6d4-7729dc4893ff" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG nova.network.neutron [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Updating instance_info_cache with network_info: [{"id": "eac9af58-5f10-4ea2-a8ef-fb93b63fa661", "address": "fa:16:3e:7d:47:f6", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac9af58-5f", "ovs_interfaceid": "eac9af58-5f10-4ea2-a8ef-fb93b63fa661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Releasing lock "refresh_cache-5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG nova.compute.manager [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Instance network_info: |[{"id": "eac9af58-5f10-4ea2-a8ef-fb93b63fa661", "address": "fa:16:3e:7d:47:f6", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac9af58-5f", "ovs_interfaceid": "eac9af58-5f10-4ea2-a8ef-fb93b63fa661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d5dd125b-fd2e-4f06-a49c-adad6fca6cfe req-81521062-d053-40c9-a7f7-9c23dbad7ae2 service nova] Acquired lock "refresh_cache-5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG nova.network.neutron [req-d5dd125b-fd2e-4f06-a49c-adad6fca6cfe req-81521062-d053-40c9-a7f7-9c23dbad7ae2 service nova] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Refreshing network info cache for port eac9af58-5f10-4ea2-a8ef-fb93b63fa661 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Start _get_guest_xml network_info=[{"id": "eac9af58-5f10-4ea2-a8ef-fb93b63fa661", "address": "fa:16:3e:7d:47:f6", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac9af58-5f", "ovs_interfaceid": "eac9af58-5f10-4ea2-a8ef-fb93b63fa661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:53:36 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:53:36 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:53:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:53:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1625476669',display_name='tempest-tempest.common.compute-instance-1625476669',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1625476669',id=27,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDV2rMj6ypVN79NzZquMwuzVGFzBjsYheQsnYgiaIuxZDRWAmZIAl29ZfE9ZXIZPbNiV6W1etqaTbE7SdUIDyBWr5Q7XZ0JyP5fqpcxD+e7pdwSJyDS2tj+RVfGVMn8zvg==',key_name='tempest-keypair-1763585720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67d09cd8d15a4b058988fa348d7fdc2e',ramdisk_id='',reservation_id='r-6aqonybt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1680693726',owner_user_name='tempest-ServerActionsTestOtherA-1680693726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:53:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dab7bcadfc32457e8bfa6fa81cba2702',uuid=5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eac9af58-5f10-4ea2-a8ef-fb93b63fa661", "address": "fa:16:3e:7d:47:f6", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac9af58-5f", "ovs_interfaceid": "eac9af58-5f10-4ea2-a8ef-fb93b63fa661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Converting VIF {"id": "eac9af58-5f10-4ea2-a8ef-fb93b63fa661", "address": "fa:16:3e:7d:47:f6", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac9af58-5f", "ovs_interfaceid": "eac9af58-5f10-4ea2-a8ef-fb93b63fa661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:47:f6,bridge_name='br-int',has_traffic_filtering=True,id=eac9af58-5f10-4ea2-a8ef-fb93b63fa661,network=Network(6e563565-dc0c-4f19-9030-742bf28811d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac9af58-5f') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG nova.objects.instance [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lazy-loading 'pci_devices' on Instance uuid 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:53:36 user nova-compute[74850]:   <uuid>5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf</uuid>
Nov 14 00:53:36 user nova-compute[74850]:   <name>instance-0000001b</name>
Nov 14 00:53:36 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:53:36 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:53:36 user nova-compute[74850]:   <metadata>
Nov 14 00:53:36 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:53:36 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:53:36 user nova-compute[74850]:       <nova:name>tempest-tempest.common.compute-instance-1625476669</nova:name>
Nov 14 00:53:36 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:53:36</nova:creationTime>
Nov 14 00:53:36 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:53:36 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:53:36 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:53:36 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:53:36 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:53:36 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:53:36 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:53:36 user nova-compute[74850]:       <nova:owner>
Nov 14 00:53:36 user nova-compute[74850]:         <nova:user uuid="dab7bcadfc32457e8bfa6fa81cba2702">tempest-ServerActionsTestOtherA-1680693726-project-member</nova:user>
Nov 14 00:53:36 user nova-compute[74850]:         <nova:project uuid="67d09cd8d15a4b058988fa348d7fdc2e">tempest-ServerActionsTestOtherA-1680693726</nova:project>
Nov 14 00:53:36 user nova-compute[74850]:       </nova:owner>
Nov 14 00:53:36 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:53:36 user nova-compute[74850]:       <nova:ports>
Nov 14 00:53:36 user nova-compute[74850]:         <nova:port uuid="eac9af58-5f10-4ea2-a8ef-fb93b63fa661">
Nov 14 00:53:36 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 00:53:36 user nova-compute[74850]:         </nova:port>
Nov 14 00:53:36 user nova-compute[74850]:       </nova:ports>
Nov 14 00:53:36 user nova-compute[74850]:     </nova:instance>
Nov 14 00:53:36 user nova-compute[74850]:   </metadata>
Nov 14 00:53:36 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:53:36 user nova-compute[74850]:     <system>
Nov 14 00:53:36 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:53:36 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:53:36 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:53:36 user nova-compute[74850]:       <entry name="serial">5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf</entry>
Nov 14 00:53:36 user nova-compute[74850]:       <entry name="uuid">5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf</entry>
Nov 14 00:53:36 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:53:36 user nova-compute[74850]:     </system>
Nov 14 00:53:36 user nova-compute[74850]:   </sysinfo>
Nov 14 00:53:36 user nova-compute[74850]:   <os>
Nov 14 00:53:36 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:53:36 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 00:53:36 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:53:36 user nova-compute[74850]:   </os>
Nov 14 00:53:36 user nova-compute[74850]:   <features>
Nov 14 00:53:36 user nova-compute[74850]:     <acpi/>
Nov 14 00:53:36 user nova-compute[74850]:     <apic/>
Nov 14 00:53:36 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:53:36 user nova-compute[74850]:   </features>
Nov 14 00:53:36 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:53:36 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:53:36 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:53:36 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:53:36 user nova-compute[74850]:   </clock>
Nov 14 00:53:36 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:53:36 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:53:36 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:53:36 user nova-compute[74850]:   </cpu>
Nov 14 00:53:36 user nova-compute[74850]:   <devices>
Nov 14 00:53:36 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 00:53:36 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:53:36 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk"/>
Nov 14 00:53:36 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:53:36 user nova-compute[74850]:     </disk>
Nov 14 00:53:36 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:53:36 user nova-compute[74850]:       <mac address="fa:16:3e:7d:47:f6"/>
Nov 14 00:53:36 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:53:36 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:53:36 user nova-compute[74850]:       <target dev="tapeac9af58-5f"/>
Nov 14 00:53:36 user nova-compute[74850]:     </interface>
Nov 14 00:53:36 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:53:36 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/console.log" append="off"/>
Nov 14 00:53:36 user nova-compute[74850]:     </serial>
Nov 14 00:53:36 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:53:36 user nova-compute[74850]:     <video>
Nov 14 00:53:36 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:53:36 user nova-compute[74850]:     </video>
Nov 14 00:53:36 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:53:36 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:53:36 user nova-compute[74850]:     </rng>
Nov 14 00:53:36 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:53:36 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:53:36 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:53:36 user nova-compute[74850]:     </memballoon>
Nov 14 00:53:36 user nova-compute[74850]:   </devices>
Nov 14 00:53:36 user nova-compute[74850]: </domain>
Nov 14 00:53:36 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:53:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1625476669',display_name='tempest-tempest.common.compute-instance-1625476669',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1625476669',id=27,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDV2rMj6ypVN79NzZquMwuzVGFzBjsYheQsnYgiaIuxZDRWAmZIAl29ZfE9ZXIZPbNiV6W1etqaTbE7SdUIDyBWr5Q7XZ0JyP5fqpcxD+e7pdwSJyDS2tj+RVfGVMn8zvg==',key_name='tempest-keypair-1763585720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67d09cd8d15a4b058988fa348d7fdc2e',ramdisk_id='',reservation_id='r-6aqonybt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1680693726',owner_user_name='tempest-ServerActionsTestOtherA-1680693726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:53:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dab7bcadfc32457e8bfa6fa81cba2702',uuid=5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eac9af58-5f10-4ea2-a8ef-fb93b63fa661", "address": "fa:16:3e:7d:47:f6", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac9af58-5f", "ovs_interfaceid": "eac9af58-5f10-4ea2-a8ef-fb93b63fa661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Converting VIF {"id": "eac9af58-5f10-4ea2-a8ef-fb93b63fa661", "address": "fa:16:3e:7d:47:f6", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac9af58-5f", "ovs_interfaceid": "eac9af58-5f10-4ea2-a8ef-fb93b63fa661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:47:f6,bridge_name='br-int',has_traffic_filtering=True,id=eac9af58-5f10-4ea2-a8ef-fb93b63fa661,network=Network(6e563565-dc0c-4f19-9030-742bf28811d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac9af58-5f') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG os_vif [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:47:f6,bridge_name='br-int',has_traffic_filtering=True,id=eac9af58-5f10-4ea2-a8ef-fb93b63fa661,network=Network(6e563565-dc0c-4f19-9030-742bf28811d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac9af58-5f') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f2567595-9cc8-5de7-9fee-339db337223c', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeac9af58-5f, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeac9af58-5f, col_values=(('qos', UUID('3d106a59-9c09-46be-bb20-8bfe0851a77a')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeac9af58-5f, col_values=(('external_ids', {'iface-id': 'eac9af58-5f10-4ea2-a8ef-fb93b63fa661', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:47:f6', 'vm-uuid': '5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:36 user nova-compute[74850]: INFO os_vif [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:47:f6,bridge_name='br-int',has_traffic_filtering=True,id=eac9af58-5f10-4ea2-a8ef-fb93b63fa661,network=Network(6e563565-dc0c-4f19-9030-742bf28811d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac9af58-5f')
Nov 14 00:53:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] No VIF found with MAC fa:16:3e:7d:47:f6, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG nova.network.neutron [req-d5dd125b-fd2e-4f06-a49c-adad6fca6cfe req-81521062-d053-40c9-a7f7-9c23dbad7ae2 service nova] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Updated VIF entry in instance network info cache for port eac9af58-5f10-4ea2-a8ef-fb93b63fa661. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG nova.network.neutron [req-d5dd125b-fd2e-4f06-a49c-adad6fca6cfe req-81521062-d053-40c9-a7f7-9c23dbad7ae2 service nova] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Updating instance_info_cache with network_info: [{"id": "eac9af58-5f10-4ea2-a8ef-fb93b63fa661", "address": "fa:16:3e:7d:47:f6", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac9af58-5f", "ovs_interfaceid": "eac9af58-5f10-4ea2-a8ef-fb93b63fa661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d5dd125b-fd2e-4f06-a49c-adad6fca6cfe req-81521062-d053-40c9-a7f7-9c23dbad7ae2 service nova] Releasing lock "refresh_cache-5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG nova.compute.manager [req-9f915722-d816-4ecd-82c7-63b08c158a57 req-819b82dc-8478-4439-9ee3-f9dd76257a07 service nova] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Received event network-changed-d5b53759-f1dd-4a6c-83c0-d4fe816d1131 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG nova.compute.manager [req-9f915722-d816-4ecd-82c7-63b08c158a57 req-819b82dc-8478-4439-9ee3-f9dd76257a07 service nova] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Refreshing instance network info cache due to event network-changed-d5b53759-f1dd-4a6c-83c0-d4fe816d1131. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9f915722-d816-4ecd-82c7-63b08c158a57 req-819b82dc-8478-4439-9ee3-f9dd76257a07 service nova] Acquiring lock "refresh_cache-4474ad0e-8eee-4db4-9896-50c049d45d26" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9f915722-d816-4ecd-82c7-63b08c158a57 req-819b82dc-8478-4439-9ee3-f9dd76257a07 service nova] Acquired lock "refresh_cache-4474ad0e-8eee-4db4-9896-50c049d45d26" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:53:36 user nova-compute[74850]: DEBUG nova.network.neutron [req-9f915722-d816-4ecd-82c7-63b08c158a57 req-819b82dc-8478-4439-9ee3-f9dd76257a07 service nova] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Refreshing network info cache for port d5b53759-f1dd-4a6c-83c0-d4fe816d1131 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:53:37 user nova-compute[74850]: DEBUG nova.network.neutron [req-9f915722-d816-4ecd-82c7-63b08c158a57 req-819b82dc-8478-4439-9ee3-f9dd76257a07 service nova] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Updated VIF entry in instance network info cache for port d5b53759-f1dd-4a6c-83c0-d4fe816d1131. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:53:37 user nova-compute[74850]: DEBUG nova.network.neutron [req-9f915722-d816-4ecd-82c7-63b08c158a57 req-819b82dc-8478-4439-9ee3-f9dd76257a07 service nova] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Updating instance_info_cache with network_info: [{"id": "d5b53759-f1dd-4a6c-83c0-d4fe816d1131", "address": "fa:16:3e:50:2f:7c", "network": {"id": "b096d728-1246-4eaa-9222-ed8eee74870c", "bridge": "br-int", "label": "tempest-TestStampPattern-1207618832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e17bbd82f843fdaa3c48d8cb64a2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b53759-f1", "ovs_interfaceid": "d5b53759-f1dd-4a6c-83c0-d4fe816d1131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:53:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9f915722-d816-4ecd-82c7-63b08c158a57 req-819b82dc-8478-4439-9ee3-f9dd76257a07 service nova] Releasing lock "refresh_cache-4474ad0e-8eee-4db4-9896-50c049d45d26" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:53:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Acquiring lock "4474ad0e-8eee-4db4-9896-50c049d45d26" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:53:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "4474ad0e-8eee-4db4-9896-50c049d45d26" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:53:37 user nova-compute[74850]: DEBUG nova.objects.instance [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lazy-loading 'flavor' on Instance uuid 4474ad0e-8eee-4db4-9896-50c049d45d26 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:53:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "4474ad0e-8eee-4db4-9896-50c049d45d26" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:53:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Acquiring lock "4474ad0e-8eee-4db4-9896-50c049d45d26" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:53:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "4474ad0e-8eee-4db4-9896-50c049d45d26" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:53:37 user nova-compute[74850]: INFO nova.compute.manager [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Attaching volume fe131013-3528-49a1-9bb7-cdd69b8f4c86 to /dev/vdb
Nov 14 00:53:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:37 user nova-compute[74850]: DEBUG os_brick.utils [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:53:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:37 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9be20a-72bc-4753-87bc-9bc08fb01744]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:53:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:37 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed2bb4c-5863-4323-8f5a-e1be6e926acc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:53:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:37 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[344d027c-0ae1-418d-a844-3f7154cec8d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:53:37 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2d60e2-21bc-40cf-a427-5ab81df4d41b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:53:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:53:37 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 00:53:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:53:37 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 00:53:37 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[701a0da0-e68a-4cb1-9fb2-428ddc7a3bd9]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:53:37 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 00:53:37 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 00:53:37 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 00:53:37 user nova-compute[74850]: DEBUG os_brick.utils [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:53:37 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Updating existing volume attachment record: 05773c7f-234b-4039-85ce-a8f10a2e8573 {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 00:53:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:38 user nova-compute[74850]: DEBUG nova.compute.manager [req-14060cdb-c7b3-49c3-960c-427a8f3ec133 req-f2e04cd6-6571-4bdf-a180-26c8f59d4ec4 service nova] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Received event network-vif-plugged-de35d2a9-b199-4dbc-8394-915938223e27 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:53:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-14060cdb-c7b3-49c3-960c-427a8f3ec133 req-f2e04cd6-6571-4bdf-a180-26c8f59d4ec4 service nova] Acquiring lock "c7952bff-87d6-46c1-a6d4-7729dc4893ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:53:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-14060cdb-c7b3-49c3-960c-427a8f3ec133 req-f2e04cd6-6571-4bdf-a180-26c8f59d4ec4 service nova] Lock "c7952bff-87d6-46c1-a6d4-7729dc4893ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:53:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-14060cdb-c7b3-49c3-960c-427a8f3ec133 req-f2e04cd6-6571-4bdf-a180-26c8f59d4ec4 service nova] Lock "c7952bff-87d6-46c1-a6d4-7729dc4893ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:53:38 user nova-compute[74850]: DEBUG nova.compute.manager [req-14060cdb-c7b3-49c3-960c-427a8f3ec133 req-f2e04cd6-6571-4bdf-a180-26c8f59d4ec4 service nova] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] No waiting events found dispatching network-vif-plugged-de35d2a9-b199-4dbc-8394-915938223e27 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:53:38 user nova-compute[74850]: WARNING nova.compute.manager [req-14060cdb-c7b3-49c3-960c-427a8f3ec133 req-f2e04cd6-6571-4bdf-a180-26c8f59d4ec4 service nova] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Received unexpected event network-vif-plugged-de35d2a9-b199-4dbc-8394-915938223e27 for instance with vm_state building and task_state spawning.
Nov 14 00:53:38 user nova-compute[74850]: DEBUG nova.compute.manager [req-14060cdb-c7b3-49c3-960c-427a8f3ec133 req-f2e04cd6-6571-4bdf-a180-26c8f59d4ec4 service nova] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Received event network-vif-plugged-de35d2a9-b199-4dbc-8394-915938223e27 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:53:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-14060cdb-c7b3-49c3-960c-427a8f3ec133 req-f2e04cd6-6571-4bdf-a180-26c8f59d4ec4 service nova] Acquiring lock "c7952bff-87d6-46c1-a6d4-7729dc4893ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:53:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-14060cdb-c7b3-49c3-960c-427a8f3ec133 req-f2e04cd6-6571-4bdf-a180-26c8f59d4ec4 service nova] Lock "c7952bff-87d6-46c1-a6d4-7729dc4893ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:53:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-14060cdb-c7b3-49c3-960c-427a8f3ec133 req-f2e04cd6-6571-4bdf-a180-26c8f59d4ec4 service nova] Lock "c7952bff-87d6-46c1-a6d4-7729dc4893ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:53:38 user nova-compute[74850]: DEBUG nova.compute.manager [req-14060cdb-c7b3-49c3-960c-427a8f3ec133 req-f2e04cd6-6571-4bdf-a180-26c8f59d4ec4 service nova] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] No waiting events found dispatching network-vif-plugged-de35d2a9-b199-4dbc-8394-915938223e27 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:53:38 user nova-compute[74850]: WARNING nova.compute.manager [req-14060cdb-c7b3-49c3-960c-427a8f3ec133 req-f2e04cd6-6571-4bdf-a180-26c8f59d4ec4 service nova] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Received unexpected event network-vif-plugged-de35d2a9-b199-4dbc-8394-915938223e27 for instance with vm_state building and task_state spawning.
Nov 14 00:53:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:40 user nova-compute[74850]: DEBUG nova.compute.manager [req-48ffc751-7d86-43f9-a147-bb77390be567 req-42178eea-4e68-48e8-9714-948f947ac301 service nova] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Received event network-vif-plugged-eac9af58-5f10-4ea2-a8ef-fb93b63fa661 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:53:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-48ffc751-7d86-43f9-a147-bb77390be567 req-42178eea-4e68-48e8-9714-948f947ac301 service nova] Acquiring lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:53:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-48ffc751-7d86-43f9-a147-bb77390be567 req-42178eea-4e68-48e8-9714-948f947ac301 service nova] Lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:53:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-48ffc751-7d86-43f9-a147-bb77390be567 req-42178eea-4e68-48e8-9714-948f947ac301 service nova] Lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:53:40 user nova-compute[74850]: DEBUG nova.compute.manager [req-48ffc751-7d86-43f9-a147-bb77390be567 req-42178eea-4e68-48e8-9714-948f947ac301 service nova] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] No waiting events found dispatching network-vif-plugged-eac9af58-5f10-4ea2-a8ef-fb93b63fa661 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:53:40 user nova-compute[74850]: WARNING nova.compute.manager [req-48ffc751-7d86-43f9-a147-bb77390be567 req-42178eea-4e68-48e8-9714-948f947ac301 service nova] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Received unexpected event network-vif-plugged-eac9af58-5f10-4ea2-a8ef-fb93b63fa661 for instance with vm_state building and task_state spawning.
Nov 14 00:53:40 user nova-compute[74850]: DEBUG nova.compute.manager [req-48ffc751-7d86-43f9-a147-bb77390be567 req-42178eea-4e68-48e8-9714-948f947ac301 service nova] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Received event network-vif-plugged-eac9af58-5f10-4ea2-a8ef-fb93b63fa661 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:53:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-48ffc751-7d86-43f9-a147-bb77390be567 req-42178eea-4e68-48e8-9714-948f947ac301 service nova] Acquiring lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:53:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-48ffc751-7d86-43f9-a147-bb77390be567 req-42178eea-4e68-48e8-9714-948f947ac301 service nova] Lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:53:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-48ffc751-7d86-43f9-a147-bb77390be567 req-42178eea-4e68-48e8-9714-948f947ac301 service nova] Lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:53:40 user nova-compute[74850]: DEBUG nova.compute.manager [req-48ffc751-7d86-43f9-a147-bb77390be567 req-42178eea-4e68-48e8-9714-948f947ac301 service nova] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] No waiting events found dispatching network-vif-plugged-eac9af58-5f10-4ea2-a8ef-fb93b63fa661 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:53:40 user nova-compute[74850]: WARNING nova.compute.manager [req-48ffc751-7d86-43f9-a147-bb77390be567 req-42178eea-4e68-48e8-9714-948f947ac301 service nova] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Received unexpected event network-vif-plugged-eac9af58-5f10-4ea2-a8ef-fb93b63fa661 for instance with vm_state building and task_state spawning.
Nov 14 00:53:40 user nova-compute[74850]: DEBUG nova.compute.manager [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:53:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 00:53:40 user nova-compute[74850]: DEBUG nova.compute.manager [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:53:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 00:53:40 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Instance spawned successfully.
Nov 14 00:53:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 00:53:40 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Instance spawned successfully.
Nov 14 00:53:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 00:53:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:53:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:53:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:53:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:53:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:53:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:53:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:53:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:53:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:53:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:53:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:53:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:53:41 user nova-compute[74850]: INFO nova.compute.manager [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Took 6.68 seconds to spawn the instance on the hypervisor.
Nov 14 00:53:41 user nova-compute[74850]: DEBUG nova.compute.manager [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:53:41 user nova-compute[74850]: INFO nova.compute.manager [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Took 7.35 seconds to spawn the instance on the hypervisor.
Nov 14 00:53:41 user nova-compute[74850]: DEBUG nova.compute.manager [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:53:41 user nova-compute[74850]: INFO nova.compute.manager [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Took 7.94 seconds to build instance.
Nov 14 00:53:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-70e807be-2bd1-42dc-82ec-c8b18c08fcd0 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.046s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:53:41 user nova-compute[74850]: INFO nova.compute.manager [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Took 8.13 seconds to build instance.
Nov 14 00:53:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-866725d9-7880-4864-a9f1-8247b7554941 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "c7952bff-87d6-46c1-a6d4-7729dc4893ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.222s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:53:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:41 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 00:53:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uPyeZFLh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:53:41 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:53:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:53:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:53:41 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:53:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:53:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:53:41 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 00:53:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86 -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:41 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77ffca4-0bb8-4bb6-8a85-0bda01fab630]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:53:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 00:53:41 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:53:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86 -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:41 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1ca7a3-b06f-4ee8-8162-11e4a5bab05b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:53:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86] added
Nov 14 00:53:42 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:53:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5603d4-d2c0-492e-a614-fea00ac93ff2]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:53:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:53:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aec6969-52ce-4696-830f-04a618168551]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:53:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:53:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uPyeZFLh {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uPyeZFLh" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad17e8b-3ded-4292-bc61-313848daf70c]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:53:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uPyeZFLh'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:53:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5094af94-5189-4d5e-b1e1-7c3c78e30281]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:53:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:53:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d6d96f-31ce-40cf-ae3a-21bdadd5b233]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:53:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:53:42 user nova-compute[74850]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:53:42 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:53:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:53:42 user nova-compute[74850]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:53:42 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:53:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86 -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86 -p 172.16.0.220:3260 --login" returned: 0 in 1.072s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:43 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fe42d3-ed7f-412b-abe4-8e01cd9b35f5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:53:43 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86, portal: 172.16.0.220,3260]
Nov 14 00:53:43 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86, portal: 172.16.0.220,3260] successful.
Nov 14 00:53:43 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:53:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:43 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0198aac2-bde9-4e48-a008-c15ccd08ac6c]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:53:43 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:53:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:43 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11d6dfb-4fd6-419a-8da6-e7345d1e06f9]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:53:43 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:53:43 user nova-compute[74850]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:53:43 user nova-compute[74850]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86 (non-flash)
Nov 14 00:53:43 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:53:43 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:53:43 user nova-compute[74850]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:53:43 user nova-compute[74850]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86 (non-flash)
Nov 14 00:53:43 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:53:43 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.299s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:53:43 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 00:53:43 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 00:53:43 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 00:53:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:43 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd089ec-17c0-41b0-98e7-089a70a03b62]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:53:43 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: None {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:53:44 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:53:44 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uPyeZFLh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 00:53:44 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.327s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:53:44 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] <== connect_volume: return (2328ms) {'type': 'block', 'scsi_wwn': '26534636335386265', 'path': '/dev/sdd'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:53:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534636335386265', 'path': '/dev/sdd'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 00:53:44 user nova-compute[74850]: DEBUG nova.objects.instance [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lazy-loading 'flavor' on Instance uuid 4474ad0e-8eee-4db4-9896-50c049d45d26 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:53:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 00:53:44 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:53:44 user nova-compute[74850]:   <source dev="/dev/sdd"/>
Nov 14 00:53:44 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:53:44 user nova-compute[74850]:   <serial>fe131013-3528-49a1-9bb7-cdd69b8f4c86</serial>
Nov 14 00:53:44 user nova-compute[74850]: </disk>
Nov 14 00:53:44 user nova-compute[74850]:  {{(pid=74850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 00:53:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:53:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:53:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] No VIF found with MAC fa:16:3e:50:2f:7c, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:53:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9f41c907-4e1f-40fd-b967-20a479c653a2 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "4474ad0e-8eee-4db4-9896-50c049d45d26" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.434s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:53:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:45 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:53:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-cfcdaf02-a93b-4a57-92e2-8eb784d2f16d tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Acquiring lock "4474ad0e-8eee-4db4-9896-50c049d45d26" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:53:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-cfcdaf02-a93b-4a57-92e2-8eb784d2f16d tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "4474ad0e-8eee-4db4-9896-50c049d45d26" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:53:46 user nova-compute[74850]: INFO nova.compute.manager [None req-cfcdaf02-a93b-4a57-92e2-8eb784d2f16d tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Detaching volume fe131013-3528-49a1-9bb7-cdd69b8f4c86
Nov 14 00:53:46 user nova-compute[74850]: INFO nova.virt.block_device [None req-cfcdaf02-a93b-4a57-92e2-8eb784d2f16d tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Attempting to driver detach volume fe131013-3528-49a1-9bb7-cdd69b8f4c86 from mountpoint /dev/vdb
Nov 14 00:53:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-cfcdaf02-a93b-4a57-92e2-8eb784d2f16d tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Attempting to detach device vdb from instance 4474ad0e-8eee-4db4-9896-50c049d45d26 from the persistent domain config. {{(pid=74850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 00:53:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-cfcdaf02-a93b-4a57-92e2-8eb784d2f16d tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 00:53:46 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:53:46 user nova-compute[74850]:   <source dev="/dev/sdd"/>
Nov 14 00:53:46 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:53:46 user nova-compute[74850]:   <serial>fe131013-3528-49a1-9bb7-cdd69b8f4c86</serial>
Nov 14 00:53:46 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 00:53:46 user nova-compute[74850]: </disk>
Nov 14 00:53:46 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 00:53:47 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-cfcdaf02-a93b-4a57-92e2-8eb784d2f16d tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Successfully detached device vdb from instance 4474ad0e-8eee-4db4-9896-50c049d45d26 from the persistent domain config.
Nov 14 00:53:47 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-cfcdaf02-a93b-4a57-92e2-8eb784d2f16d tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4474ad0e-8eee-4db4-9896-50c049d45d26 from the live domain config. {{(pid=74850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 00:53:47 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-cfcdaf02-a93b-4a57-92e2-8eb784d2f16d tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 00:53:47 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:53:47 user nova-compute[74850]:   <source dev="/dev/sdd"/>
Nov 14 00:53:47 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:53:47 user nova-compute[74850]:   <serial>fe131013-3528-49a1-9bb7-cdd69b8f4c86</serial>
Nov 14 00:53:47 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 00:53:47 user nova-compute[74850]: </disk>
Nov 14 00:53:47 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 00:53:47 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-cfcdaf02-a93b-4a57-92e2-8eb784d2f16d tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4474ad0e-8eee-4db4-9896-50c049d45d26 {{(pid=74850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 00:53:47 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:53:48 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:53:49 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:53:49 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:53:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:53:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:53:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:53:49 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 00:53:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57f1e010-68bf-4047-9316-0412a2c89be2/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57f1e010-68bf-4047-9316-0412a2c89be2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57f1e010-68bf-4047-9316-0412a2c89be2/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57f1e010-68bf-4047-9316-0412a2c89be2/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:53:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:54 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:53:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:53:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:53:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:55 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:53:55 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:53:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=7380MB free_disk=25.170345306396484GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 00:53:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:53:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:53:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Applying migration context for instance 4f1102c5-f5ef-48d5-b271-6e25bee5cc70 as it has an incoming, in-progress migration 031456c4-37fc-41ea-a496-f91bcf24372d. Migration status is finished {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 00:53:55 user nova-compute[74850]: INFO nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Updating resource usage from migration 031456c4-37fc-41ea-a496-f91bcf24372d
Nov 14 00:53:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance a70d0196-f90e-47c4-be67-bf7ef4c3d8c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:53:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 1879be4c-9226-4c8c-a56c-f8e37398851b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:53:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 4b60ac08-e954-46d5-a280-a11146b3ebf4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:53:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance a62a2eab-2502-4275-948b-3f18c3fcff36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:53:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 748d0da7-bbb9-4e86-aae3-e48b1fa04c14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:53:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 4474ad0e-8eee-4db4-9896-50c049d45d26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:53:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 57f1e010-68bf-4047-9316-0412a2c89be2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:53:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Migration 031456c4-37fc-41ea-a496-f91bcf24372d is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 00:53:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 4f1102c5-f5ef-48d5-b271-6e25bee5cc70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:53:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 211c1477-8a76-4ecd-a7c8-dc0b5903d38c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:53:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance c7952bff-87d6-46c1-a6d4-7729dc4893ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:53:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:53:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 00:53:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 00:53:55 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:53:55 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:53:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 00:53:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.485s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:53:56 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:53:57 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:53:57 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:53:57 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 00:53:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "refresh_cache-4b60ac08-e954-46d5-a280-a11146b3ebf4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:53:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquired lock "refresh_cache-4b60ac08-e954-46d5-a280-a11146b3ebf4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:53:57 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Forcefully refreshing network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 00:53:58 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Updating instance_info_cache with network_info: [{"id": "06e3d114-d80f-4634-840a-d4e120c77a88", "address": "fa:16:3e:ef:7a:d7", "network": {"id": "a32d38d7-3a21-4c1b-886b-473c5cac50a4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-777089423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ed4742aedf24e90a866dd0a8692635e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e3d114-d8", "ovs_interfaceid": "06e3d114-d80f-4634-840a-d4e120c77a88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:53:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Releasing lock "refresh_cache-4b60ac08-e954-46d5-a280-a11146b3ebf4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:53:58 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Updated the network info_cache for instance {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 00:53:58 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:53:58 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:53:58 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 00:54:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:07 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-cfcdaf02-a93b-4a57-92e2-8eb784d2f16d tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4474ad0e-8eee-4db4-9896-50c049d45d26 is timed out.
Nov 14 00:54:07 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-cfcdaf02-a93b-4a57-92e2-8eb784d2f16d tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Successfully detached device vdb from instance 4474ad0e-8eee-4db4-9896-50c049d45d26 from the live domain config.
Nov 14 00:54:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfcdaf02-a93b-4a57-92e2-8eb784d2f16d tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcdaf02-a93b-4a57-92e2-8eb784d2f16d tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uPyeZFLh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:54:07 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-cfcdaf02-a93b-4a57-92e2-8eb784d2f16d tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:54:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-cfcdaf02-a93b-4a57-92e2-8eb784d2f16d tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-cfcdaf02-a93b-4a57-92e2-8eb784d2f16d tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[107aab60-f09b-48ae-9903-99d905679ca3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcdaf02-a93b-4a57-92e2-8eb784d2f16d tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 00:54:07 user nova-compute[74850]: No targets found.
Nov 14 00:54:07 user nova-compute[74850]: iSNS:
Nov 14 00:54:07 user nova-compute[74850]: No targets found.
Nov 14 00:54:07 user nova-compute[74850]: STATIC:
Nov 14 00:54:07 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf
Nov 14 00:54:07 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:54:07 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:54:07 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86
Nov 14 00:54:07 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:54:07 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:54:07 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714
Nov 14 00:54:07 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:54:07 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:54:07 user nova-compute[74850]: FIRMWARE:
Nov 14 00:54:07 user nova-compute[74850]: No targets found.
Nov 14 00:54:07 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcdaf02-a93b-4a57-92e2-8eb784d2f16d tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 00:54:07 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 00:54:07 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcdaf02-a93b-4a57-92e2-8eb784d2f16d tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7808450a-c271-40d2-bfc1-988ee07ba9b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ad7b3e-e4ab-49d0-86af-d312d6d081c6]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcdaf02-a93b-4a57-92e2-8eb784d2f16d tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:54:07 user nova-compute[74850]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:54:07 user nova-compute[74850]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86 (non-flash)
Nov 14 00:54:07 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcdaf02-a93b-4a57-92e2-8eb784d2f16d tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:54:07 user nova-compute[74850]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:54:07 user nova-compute[74850]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86 (non-flash)
Nov 14 00:54:07 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcdaf02-a93b-4a57-92e2-8eb784d2f16d tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a3c134dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86'): ({'sdd'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-cfcdaf02-a93b-4a57-92e2-8eb784d2f16d tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Removing single pathed devices sdd {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7816f06-3d57-4e38-a868-3d41a571fe45]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d138a1-6cf9-4af9-b7fc-ac9bac7e2f92]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-cfcdaf02-a93b-4a57-92e2-8eb784d2f16d tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Flushing IO for device /dev/sdd {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed5c099-ac2b-4939-9f13-f14accf1689e]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-cfcdaf02-a93b-4a57-92e2-8eb784d2f16d tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09feb4c-d9cb-4004-9f7a-5e0d71be8d3a]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-cfcdaf02-a93b-4a57-92e2-8eb784d2f16d tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-cfcdaf02-a93b-4a57-92e2-8eb784d2f16d tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] SCSI volumes sdd have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcdaf02-a93b-4a57-92e2-8eb784d2f16d tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6b4da3-a5a4-413e-8255-6f8c5ce4e790]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcdaf02-a93b-4a57-92e2-8eb784d2f16d tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86 -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0441da2-d07c-4ecd-97b4-d7918c1545fa]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcdaf02-a93b-4a57-92e2-8eb784d2f16d tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86, portal: 172.16.0.220,3260]
Nov 14 00:54:07 user nova-compute[74850]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86, portal: 172.16.0.220,3260] successful.
Nov 14 00:54:07 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86 -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe131013-3528-49a1-9bb7-cdd69b8f4c86 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4eca99-24d2-49ba-8be2-520d8832aa16]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcdaf02-a93b-4a57-92e2-8eb784d2f16d tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-cfcdaf02-a93b-4a57-92e2-8eb784d2f16d tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcdaf02-a93b-4a57-92e2-8eb784d2f16d tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] <== disconnect_volume: return (304ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:54:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfcdaf02-a93b-4a57-92e2-8eb784d2f16d tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 00:54:08 user nova-compute[74850]: DEBUG nova.objects.instance [None req-cfcdaf02-a93b-4a57-92e2-8eb784d2f16d tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lazy-loading 'flavor' on Instance uuid 4474ad0e-8eee-4db4-9896-50c049d45d26 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:54:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-cfcdaf02-a93b-4a57-92e2-8eb784d2f16d tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "4474ad0e-8eee-4db4-9896-50c049d45d26" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.661s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:54:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:15 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Acquiring lock "1f3a0b8f-1591-49c8-afb1-88437d65fb75" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:54:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lock "1f3a0b8f-1591-49c8-afb1-88437d65fb75" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:54:19 user nova-compute[74850]: INFO nova.compute.manager [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Unshelving
Nov 14 00:54:19 user nova-compute[74850]: INFO nova.virt.block_device [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Booting with volume e558166b-85d2-4742-ac34-c2ee02202390 at /dev/vda
Nov 14 00:54:19 user nova-compute[74850]: DEBUG os_brick.utils [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:54:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[11088ea8-e31f-49eb-b725-6456e9c226d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadccb8e-c82f-4f46-99fb-2e0f9f906234]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f04342-288a-4246-82da-7db99c2a1ef0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd11f8e-4bed-4f3d-b4f6-3ef806e0c811]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:54:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 00:54:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:54:19 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 00:54:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f734d9af-290d-4ffb-bf0c-fd161ce1cdb2]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 00:54:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 00:54:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 00:54:19 user nova-compute[74850]: DEBUG os_brick.utils [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:54:19 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Updating existing volume attachment record: 828f6110-6c12-4dc2-b6f5-8c35f1ebb21d {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 00:54:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:54:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:54:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:54:24 user nova-compute[74850]: DEBUG nova.objects.instance [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lazy-loading 'pci_requests' on Instance uuid 1f3a0b8f-1591-49c8-afb1-88437d65fb75 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:54:24 user nova-compute[74850]: DEBUG nova.objects.instance [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lazy-loading 'numa_topology' on Instance uuid 1f3a0b8f-1591-49c8-afb1-88437d65fb75 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:54:24 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 00:54:24 user nova-compute[74850]: INFO nova.compute.claims [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Claim successful on node user
Nov 14 00:54:24 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:54:24 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:54:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.631s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:54:24 user nova-compute[74850]: INFO nova.network.neutron [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Updating port b3afdbc0-4840-47bb-b5f9-71944340f04b with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 00:54:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Acquiring lock "refresh_cache-1f3a0b8f-1591-49c8-afb1-88437d65fb75" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:54:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Acquired lock "refresh_cache-1f3a0b8f-1591-49c8-afb1-88437d65fb75" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:54:25 user nova-compute[74850]: DEBUG nova.network.neutron [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:54:25 user nova-compute[74850]: DEBUG nova.compute.manager [req-4c822e51-269f-44ec-a57f-96fe31c9bfdc req-c9bd7129-9e55-41c3-b0b3-54cd96fff186 service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Received event network-changed-b3afdbc0-4840-47bb-b5f9-71944340f04b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:54:25 user nova-compute[74850]: DEBUG nova.compute.manager [req-4c822e51-269f-44ec-a57f-96fe31c9bfdc req-c9bd7129-9e55-41c3-b0b3-54cd96fff186 service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Refreshing instance network info cache due to event network-changed-b3afdbc0-4840-47bb-b5f9-71944340f04b. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:54:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-4c822e51-269f-44ec-a57f-96fe31c9bfdc req-c9bd7129-9e55-41c3-b0b3-54cd96fff186 service nova] Acquiring lock "refresh_cache-1f3a0b8f-1591-49c8-afb1-88437d65fb75" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:54:25 user nova-compute[74850]: DEBUG nova.network.neutron [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Updating instance_info_cache with network_info: [{"id": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "address": "fa:16:3e:a9:ef:9b", "network": {"id": "d7fe6bb8-ec3e-4bc8-9afe-161897a805b0", "bridge": "br-int", "label": "tempest-TestShelveInstance-236791102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d04a48df2b1c42f4a0a8826c66357f28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3afdbc0-48", "ovs_interfaceid": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:54:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Releasing lock "refresh_cache-1f3a0b8f-1591-49c8-afb1-88437d65fb75" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:54:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 00:54:25 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Creating image(s)
Nov 14 00:54:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Did not create local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 00:54:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Ensure instance console log exists: /opt/stack/data/nova/instances/1f3a0b8f-1591-49c8-afb1-88437d65fb75/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 00:54:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:54:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:54:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:54:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Start _get_guest_xml network_info=[{"id": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "address": "fa:16:3e:a9:ef:9b", "network": {"id": "d7fe6bb8-ec3e-4bc8-9afe-161897a805b0", "bridge": "br-int", "label": "tempest-TestShelveInstance-236791102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d04a48df2b1c42f4a0a8826c66357f28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3afdbc0-48", "ovs_interfaceid": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '828f6110-6c12-4dc2-b6f5-8c35f1ebb21d', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pEVTGKrm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1f3a0b8f-1591-49c8-afb1-88437d65fb75', 'attached_at': '', 'detached_at': '', 'volume_id': 'e558166b-85d2-4742-ac34-c2ee02202390', 'serial': 'e558166b-85d2-4742-ac34-c2ee02202390'}, 'volume_type': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:54:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-4c822e51-269f-44ec-a57f-96fe31c9bfdc req-c9bd7129-9e55-41c3-b0b3-54cd96fff186 service nova] Acquired lock "refresh_cache-1f3a0b8f-1591-49c8-afb1-88437d65fb75" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:54:25 user nova-compute[74850]: DEBUG nova.network.neutron [req-4c822e51-269f-44ec-a57f-96fe31c9bfdc req-c9bd7129-9e55-41c3-b0b3-54cd96fff186 service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Refreshing network info cache for port b3afdbc0-4840-47bb-b5f9-71944340f04b {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:54:25 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:54:25 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:54:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:54:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:54:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:54:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:54:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:54:25 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:54:25 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG nova.objects.instance [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1f3a0b8f-1591-49c8-afb1-88437d65fb75 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG nova.objects.base [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Object Instance<1f3a0b8f-1591-49c8-afb1-88437d65fb75> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pEVTGKrm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:54:26 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:54:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:54:26 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:54:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:54:26 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 00:54:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c479ded5-f45f-4bcf-bef5-23597322acf7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 00:54:26 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b5130d-1891-44b6-ba8e-cf25531e1be3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390] added
Nov 14 00:54:26 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ea2f82-868e-4b9c-847a-f95663af0dfe]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[da98f2c4-6cdc-4728-9fa7-e8a79c880815]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pEVTGKrm {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pEVTGKrm" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2e5961-502b-48e5-840a-cca21f5ae8fd]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pEVTGKrm'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ea66d6-19ba-4100-a624-f51cf655b202]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8917961-f6ca-4519-81c2-72bd4ffd9124]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:54:26 user nova-compute[74850]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:54:26 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:54:26 user nova-compute[74850]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:54:26 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[079affcf-09f0-4ad5-8286-5da37d65ac85]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390, portal: 172.16.0.220,3260]
Nov 14 00:54:26 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390, portal: 172.16.0.220,3260] successful.
Nov 14 00:54:26 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9413e8c1-fe02-4643-9780-a881f809c56c]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fd941b-447c-4ca2-95a2-1628bb970dce]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:54:26 user nova-compute[74850]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:54:26 user nova-compute[74850]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:54:26 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:54:26 user nova-compute[74850]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:54:26 user nova-compute[74850]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:54:26 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9a2ce3-ae40-43bd-b11e-08c4609eaa57]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pEVTGKrm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG nova.network.neutron [req-4c822e51-269f-44ec-a57f-96fe31c9bfdc req-c9bd7129-9e55-41c3-b0b3-54cd96fff186 service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Updated VIF entry in instance network info cache for port b3afdbc0-4840-47bb-b5f9-71944340f04b. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG nova.network.neutron [req-4c822e51-269f-44ec-a57f-96fe31c9bfdc req-c9bd7129-9e55-41c3-b0b3-54cd96fff186 service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Updating instance_info_cache with network_info: [{"id": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "address": "fa:16:3e:a9:ef:9b", "network": {"id": "d7fe6bb8-ec3e-4bc8-9afe-161897a805b0", "bridge": "br-int", "label": "tempest-TestShelveInstance-236791102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d04a48df2b1c42f4a0a8826c66357f28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3afdbc0-48", "ovs_interfaceid": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-4c822e51-269f-44ec-a57f-96fe31c9bfdc req-c9bd7129-9e55-41c3-b0b3-54cd96fff186 service nova] Releasing lock "refresh_cache-1f3a0b8f-1591-49c8-afb1-88437d65fb75" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:54:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:54:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26561353661326566', 'path': '/dev/sdd'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:54:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561353661326566', 'path': '/dev/sdd'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 00:54:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T00:50:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-999057832',display_name='tempest-TestShelveInstance-server-999057832',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-999057832',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2033278270',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:50:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d04a48df2b1c42f4a0a8826c66357f28',ramdisk_id='',reservation_id='r-cuownc8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1921981995',owner_user_name='tempest-TestShelveInstance-1921981995-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:54:20Z,user_data=None,user_id='5a8ca83acba64f15bd10d275fd053475',uuid=1f3a0b8f-1591-49c8-afb1-88437d65fb75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "address": "fa:16:3e:a9:ef:9b", "network": {"id": "d7fe6bb8-ec3e-4bc8-9afe-161897a805b0", "bridge": "br-int", "label": "tempest-TestShelveInstance-236791102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d04a48df2b1c42f4a0a8826c66357f28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3afdbc0-48", "ovs_interfaceid": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:54:27 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Converting VIF {"id": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "address": "fa:16:3e:a9:ef:9b", "network": {"id": "d7fe6bb8-ec3e-4bc8-9afe-161897a805b0", "bridge": "br-int", "label": "tempest-TestShelveInstance-236791102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d04a48df2b1c42f4a0a8826c66357f28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3afdbc0-48", "ovs_interfaceid": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:54:27 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:ef:9b,bridge_name='br-int',has_traffic_filtering=True,id=b3afdbc0-4840-47bb-b5f9-71944340f04b,network=Network(d7fe6bb8-ec3e-4bc8-9afe-161897a805b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3afdbc0-48') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:54:27 user nova-compute[74850]: DEBUG nova.objects.instance [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lazy-loading 'pci_devices' on Instance uuid 1f3a0b8f-1591-49c8-afb1-88437d65fb75 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:54:27 user nova-compute[74850]: DEBUG nova.objects.base [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Object Instance<1f3a0b8f-1591-49c8-afb1-88437d65fb75> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 00:54:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:54:27 user nova-compute[74850]:   <uuid>1f3a0b8f-1591-49c8-afb1-88437d65fb75</uuid>
Nov 14 00:54:27 user nova-compute[74850]:   <name>instance-00000015</name>
Nov 14 00:54:27 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:54:27 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:54:27 user nova-compute[74850]:   <metadata>
Nov 14 00:54:27 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:54:27 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:54:27 user nova-compute[74850]:       <nova:name>tempest-TestShelveInstance-server-999057832</nova:name>
Nov 14 00:54:27 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:54:25</nova:creationTime>
Nov 14 00:54:27 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:54:27 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:54:27 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:54:27 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:54:27 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:54:27 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:54:27 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:54:27 user nova-compute[74850]:       <nova:owner>
Nov 14 00:54:27 user nova-compute[74850]:         <nova:user uuid="5a8ca83acba64f15bd10d275fd053475">tempest-TestShelveInstance-1921981995-project-member</nova:user>
Nov 14 00:54:27 user nova-compute[74850]:         <nova:project uuid="d04a48df2b1c42f4a0a8826c66357f28">tempest-TestShelveInstance-1921981995</nova:project>
Nov 14 00:54:27 user nova-compute[74850]:       </nova:owner>
Nov 14 00:54:27 user nova-compute[74850]:       <nova:ports>
Nov 14 00:54:27 user nova-compute[74850]:         <nova:port uuid="b3afdbc0-4840-47bb-b5f9-71944340f04b">
Nov 14 00:54:27 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 00:54:27 user nova-compute[74850]:         </nova:port>
Nov 14 00:54:27 user nova-compute[74850]:       </nova:ports>
Nov 14 00:54:27 user nova-compute[74850]:     </nova:instance>
Nov 14 00:54:27 user nova-compute[74850]:   </metadata>
Nov 14 00:54:27 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:54:27 user nova-compute[74850]:     <system>
Nov 14 00:54:27 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:54:27 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:54:27 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:54:27 user nova-compute[74850]:       <entry name="serial">1f3a0b8f-1591-49c8-afb1-88437d65fb75</entry>
Nov 14 00:54:27 user nova-compute[74850]:       <entry name="uuid">1f3a0b8f-1591-49c8-afb1-88437d65fb75</entry>
Nov 14 00:54:27 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:54:27 user nova-compute[74850]:     </system>
Nov 14 00:54:27 user nova-compute[74850]:   </sysinfo>
Nov 14 00:54:27 user nova-compute[74850]:   <os>
Nov 14 00:54:27 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:54:27 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 00:54:27 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:54:27 user nova-compute[74850]:   </os>
Nov 14 00:54:27 user nova-compute[74850]:   <features>
Nov 14 00:54:27 user nova-compute[74850]:     <acpi/>
Nov 14 00:54:27 user nova-compute[74850]:     <apic/>
Nov 14 00:54:27 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:54:27 user nova-compute[74850]:   </features>
Nov 14 00:54:27 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:54:27 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:54:27 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:54:27 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:54:27 user nova-compute[74850]:   </clock>
Nov 14 00:54:27 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:54:27 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:54:27 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:54:27 user nova-compute[74850]:   </cpu>
Nov 14 00:54:27 user nova-compute[74850]:   <devices>
Nov 14 00:54:27 user nova-compute[74850]:     <disk type="block" device="disk">
Nov 14 00:54:27 user nova-compute[74850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:54:27 user nova-compute[74850]:       <source dev="/dev/sdd"/>
Nov 14 00:54:27 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:54:27 user nova-compute[74850]:       <serial>e558166b-85d2-4742-ac34-c2ee02202390</serial>
Nov 14 00:54:27 user nova-compute[74850]:     </disk>
Nov 14 00:54:27 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:54:27 user nova-compute[74850]:       <mac address="fa:16:3e:a9:ef:9b"/>
Nov 14 00:54:27 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:54:27 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:54:27 user nova-compute[74850]:       <target dev="tapb3afdbc0-48"/>
Nov 14 00:54:27 user nova-compute[74850]:     </interface>
Nov 14 00:54:27 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:54:27 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/1f3a0b8f-1591-49c8-afb1-88437d65fb75/console.log" append="off"/>
Nov 14 00:54:27 user nova-compute[74850]:     </serial>
Nov 14 00:54:27 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:54:27 user nova-compute[74850]:     <video>
Nov 14 00:54:27 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:54:27 user nova-compute[74850]:     </video>
Nov 14 00:54:27 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:54:27 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:54:27 user nova-compute[74850]:     </rng>
Nov 14 00:54:27 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:54:27 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:54:27 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:54:27 user nova-compute[74850]:     </memballoon>
Nov 14 00:54:27 user nova-compute[74850]:   </devices>
Nov 14 00:54:27 user nova-compute[74850]: </domain>
Nov 14 00:54:27 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:54:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T00:50:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-999057832',display_name='tempest-TestShelveInstance-server-999057832',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-999057832',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2033278270',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:50:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d04a48df2b1c42f4a0a8826c66357f28',ramdisk_id='',reservation_id='r-cuownc8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1921981995',owner_user_name='tempest-TestShelveInstance-1921981995-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:54:20Z,user_data=None,user_id='5a8ca83acba64f15bd10d275fd053475',uuid=1f3a0b8f-1591-49c8-afb1-88437d65fb75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "address": "fa:16:3e:a9:ef:9b", "network": {"id": "d7fe6bb8-ec3e-4bc8-9afe-161897a805b0", "bridge": "br-int", "label": "tempest-TestShelveInstance-236791102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d04a48df2b1c42f4a0a8826c66357f28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3afdbc0-48", "ovs_interfaceid": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:54:27 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Converting VIF {"id": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "address": "fa:16:3e:a9:ef:9b", "network": {"id": "d7fe6bb8-ec3e-4bc8-9afe-161897a805b0", "bridge": "br-int", "label": "tempest-TestShelveInstance-236791102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d04a48df2b1c42f4a0a8826c66357f28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3afdbc0-48", "ovs_interfaceid": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:54:27 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:ef:9b,bridge_name='br-int',has_traffic_filtering=True,id=b3afdbc0-4840-47bb-b5f9-71944340f04b,network=Network(d7fe6bb8-ec3e-4bc8-9afe-161897a805b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3afdbc0-48') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:54:27 user nova-compute[74850]: DEBUG os_vif [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:ef:9b,bridge_name='br-int',has_traffic_filtering=True,id=b3afdbc0-4840-47bb-b5f9-71944340f04b,network=Network(d7fe6bb8-ec3e-4bc8-9afe-161897a805b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3afdbc0-48') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:54:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:54:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:54:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f20647e7-ccc8-58a9-9e5d-e1d42c3fda97', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:54:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:54:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3afdbc0-48, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:54:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb3afdbc0-48, col_values=(('qos', UUID('752cb6ea-15fa-4a9b-9ecb-68b16e4af015')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:54:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb3afdbc0-48, col_values=(('external_ids', {'iface-id': 'b3afdbc0-4840-47bb-b5f9-71944340f04b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:ef:9b', 'vm-uuid': '1f3a0b8f-1591-49c8-afb1-88437d65fb75'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:54:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:54:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:27 user nova-compute[74850]: INFO os_vif [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:ef:9b,bridge_name='br-int',has_traffic_filtering=True,id=b3afdbc0-4840-47bb-b5f9-71944340f04b,network=Network(d7fe6bb8-ec3e-4bc8-9afe-161897a805b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3afdbc0-48')
Nov 14 00:54:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:54:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] No VIF found with MAC fa:16:3e:a9:ef:9b, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:54:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:28 user nova-compute[74850]: DEBUG nova.compute.manager [req-9e52ae42-28bc-44ad-9e98-803b0f3cedfc req-06b3b709-883b-4249-b20b-9f187e54e745 service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Received event network-vif-plugged-b3afdbc0-4840-47bb-b5f9-71944340f04b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:54:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9e52ae42-28bc-44ad-9e98-803b0f3cedfc req-06b3b709-883b-4249-b20b-9f187e54e745 service nova] Acquiring lock "1f3a0b8f-1591-49c8-afb1-88437d65fb75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:54:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9e52ae42-28bc-44ad-9e98-803b0f3cedfc req-06b3b709-883b-4249-b20b-9f187e54e745 service nova] Lock "1f3a0b8f-1591-49c8-afb1-88437d65fb75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:54:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9e52ae42-28bc-44ad-9e98-803b0f3cedfc req-06b3b709-883b-4249-b20b-9f187e54e745 service nova] Lock "1f3a0b8f-1591-49c8-afb1-88437d65fb75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:54:28 user nova-compute[74850]: DEBUG nova.compute.manager [req-9e52ae42-28bc-44ad-9e98-803b0f3cedfc req-06b3b709-883b-4249-b20b-9f187e54e745 service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] No waiting events found dispatching network-vif-plugged-b3afdbc0-4840-47bb-b5f9-71944340f04b {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:54:28 user nova-compute[74850]: WARNING nova.compute.manager [req-9e52ae42-28bc-44ad-9e98-803b0f3cedfc req-06b3b709-883b-4249-b20b-9f187e54e745 service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Received unexpected event network-vif-plugged-b3afdbc0-4840-47bb-b5f9-71944340f04b for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 00:54:29 user nova-compute[74850]: DEBUG nova.compute.manager [req-65125a57-5895-4da7-9205-97992b298078 req-df05a5d7-8b45-4b3d-901e-db46cda8b535 service nova] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Received event network-changed-ca2713af-4b11-4391-93da-9b767fea0783 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:54:29 user nova-compute[74850]: DEBUG nova.compute.manager [req-65125a57-5895-4da7-9205-97992b298078 req-df05a5d7-8b45-4b3d-901e-db46cda8b535 service nova] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Refreshing instance network info cache due to event network-changed-ca2713af-4b11-4391-93da-9b767fea0783. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:54:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-65125a57-5895-4da7-9205-97992b298078 req-df05a5d7-8b45-4b3d-901e-db46cda8b535 service nova] Acquiring lock "refresh_cache-57f1e010-68bf-4047-9316-0412a2c89be2" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:54:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-65125a57-5895-4da7-9205-97992b298078 req-df05a5d7-8b45-4b3d-901e-db46cda8b535 service nova] Acquired lock "refresh_cache-57f1e010-68bf-4047-9316-0412a2c89be2" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:54:29 user nova-compute[74850]: DEBUG nova.network.neutron [req-65125a57-5895-4da7-9205-97992b298078 req-df05a5d7-8b45-4b3d-901e-db46cda8b535 service nova] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Refreshing network info cache for port ca2713af-4b11-4391-93da-9b767fea0783 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:54:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:29 user nova-compute[74850]: DEBUG nova.network.neutron [req-65125a57-5895-4da7-9205-97992b298078 req-df05a5d7-8b45-4b3d-901e-db46cda8b535 service nova] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Updated VIF entry in instance network info cache for port ca2713af-4b11-4391-93da-9b767fea0783. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:54:29 user nova-compute[74850]: DEBUG nova.network.neutron [req-65125a57-5895-4da7-9205-97992b298078 req-df05a5d7-8b45-4b3d-901e-db46cda8b535 service nova] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Updating instance_info_cache with network_info: [{"id": "ca2713af-4b11-4391-93da-9b767fea0783", "address": "fa:16:3e:34:bf:d7", "network": {"id": "5f593e54-bb69-4d38-ba7d-496a4c0f581b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-342901959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dbc81e4bfc2438bbecb30c46089cd20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca2713af-4b", "ovs_interfaceid": "ca2713af-4b11-4391-93da-9b767fea0783", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:54:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-65125a57-5895-4da7-9205-97992b298078 req-df05a5d7-8b45-4b3d-901e-db46cda8b535 service nova] Releasing lock "refresh_cache-57f1e010-68bf-4047-9316-0412a2c89be2" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:54:30 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:30 user nova-compute[74850]: DEBUG nova.compute.manager [req-2ded8f45-9445-47af-b5db-87bff73c3261 req-a7b37897-36dc-4da7-ab65-91b2cc84b799 service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Received event network-vif-plugged-b3afdbc0-4840-47bb-b5f9-71944340f04b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:54:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-2ded8f45-9445-47af-b5db-87bff73c3261 req-a7b37897-36dc-4da7-ab65-91b2cc84b799 service nova] Acquiring lock "1f3a0b8f-1591-49c8-afb1-88437d65fb75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:54:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-2ded8f45-9445-47af-b5db-87bff73c3261 req-a7b37897-36dc-4da7-ab65-91b2cc84b799 service nova] Lock "1f3a0b8f-1591-49c8-afb1-88437d65fb75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:54:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-2ded8f45-9445-47af-b5db-87bff73c3261 req-a7b37897-36dc-4da7-ab65-91b2cc84b799 service nova] Lock "1f3a0b8f-1591-49c8-afb1-88437d65fb75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:54:30 user nova-compute[74850]: DEBUG nova.compute.manager [req-2ded8f45-9445-47af-b5db-87bff73c3261 req-a7b37897-36dc-4da7-ab65-91b2cc84b799 service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] No waiting events found dispatching network-vif-plugged-b3afdbc0-4840-47bb-b5f9-71944340f04b {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:54:30 user nova-compute[74850]: WARNING nova.compute.manager [req-2ded8f45-9445-47af-b5db-87bff73c3261 req-a7b37897-36dc-4da7-ab65-91b2cc84b799 service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Received unexpected event network-vif-plugged-b3afdbc0-4840-47bb-b5f9-71944340f04b for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 00:54:30 user nova-compute[74850]: DEBUG nova.compute.manager [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:54:30 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 00:54:31 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Instance spawned successfully.
Nov 14 00:54:31 user nova-compute[74850]: DEBUG nova.compute.manager [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:54:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bed02856-0171-4cf5-b2e5-8d9c09e76147 tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lock "1f3a0b8f-1591-49c8-afb1-88437d65fb75" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.568s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:54:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Acquiring lock "57f1e010-68bf-4047-9316-0412a2c89be2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:54:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Lock "57f1e010-68bf-4047-9316-0412a2c89be2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:54:31 user nova-compute[74850]: DEBUG nova.objects.instance [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Lazy-loading 'flavor' on Instance uuid 57f1e010-68bf-4047-9316-0412a2c89be2 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:54:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Lock "57f1e010-68bf-4047-9316-0412a2c89be2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:54:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Acquiring lock "57f1e010-68bf-4047-9316-0412a2c89be2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:54:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Lock "57f1e010-68bf-4047-9316-0412a2c89be2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:54:31 user nova-compute[74850]: INFO nova.compute.manager [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Attaching volume a3985a0d-eefa-4754-9d40-c2de91bacfc2 to /dev/vdb
Nov 14 00:54:31 user nova-compute[74850]: DEBUG os_brick.utils [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:54:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:31 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f21760-c460-4ddc-891d-3ebddb878637]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:31 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbecc38-59a3-4d82-9132-31cae0491b54]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:31 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b62346-a286-49b4-a7ff-cf77328e5ad8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:31 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0060aba2-6111-4177-a576-637bc0ecb811]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:54:31 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 00:54:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:54:31 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 00:54:31 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[656fac04-2ad6-4c59-8fe6-d4b4a0eca4ab]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:31 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 00:54:31 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 00:54:31 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 00:54:31 user nova-compute[74850]: DEBUG os_brick.utils [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:54:31 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Updating existing volume attachment record: 1b707482-a8ee-4eda-a8a0-8c922bc31eaa {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 00:54:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:35 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 00:54:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jrOsYfdI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:54:35 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:54:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:54:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:54:35 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:54:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:54:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:54:35 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 00:54:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2 -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7a5c34-0ef1-4140-a8dc-93b32826e252]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 00:54:35 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:54:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[13565d74-9e4c-4417-b4f6-e5fb9c024b2b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2] added
Nov 14 00:54:35 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:54:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e35c5a-eef5-4264-a073-8dff0e442ffe]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:54:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1437bf6e-796b-40dd-b6b9-37fe695564b8]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jrOsYfdI {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG nova.network.neutron [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Port 745756ea-b360-423f-8258-5339a80658b5 binding to destination host user is already ACTIVE {{(pid=74850) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Acquiring lock "refresh_cache-4f1102c5-f5ef-48d5-b271-6e25bee5cc70" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Acquired lock "refresh_cache-4f1102c5-f5ef-48d5-b271-6e25bee5cc70" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG nova.network.neutron [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jrOsYfdI" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[33af6084-5dc8-4f71-a71e-d01c8e9cd7d7]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jrOsYfdI'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7118d12a-d5bd-4bfa-a006-bb56ffc07664]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[936a1328-1e9a-49ce-af5c-37df021c9bdc]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:54:36 user nova-compute[74850]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:54:36 user nova-compute[74850]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:54:36 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:54:36 user nova-compute[74850]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:54:36 user nova-compute[74850]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:54:36 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2 -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ca29f4-92af-44b8-a02e-00952fa188f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2, portal: 172.16.0.220,3260]
Nov 14 00:54:36 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2, portal: 172.16.0.220,3260] successful.
Nov 14 00:54:36 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd50deb1-8dea-4dc7-a5c7-ce008258f277]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ea1dc9-11ad-45c9-9693-34f3169a16ca]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:54:36 user nova-compute[74850]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:54:36 user nova-compute[74850]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:54:36 user nova-compute[74850]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2 (non-flash)
Nov 14 00:54:36 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:54:36 user nova-compute[74850]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:54:36 user nova-compute[74850]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:54:36 user nova-compute[74850]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2 (non-flash)
Nov 14 00:54:36 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] HCTL ('36', '-', '-', 0) found on session 26 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f139803-cc28-4b19-8db7-860376cc1648]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jrOsYfdI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG nova.network.neutron [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Updating instance_info_cache with network_info: [{"id": "745756ea-b360-423f-8258-5339a80658b5", "address": "fa:16:3e:1e:5a:e7", "network": {"id": "0e3f4d71-4998-448f-b706-8ae0f6d0d960", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-245892937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af65f5e7dcc3404292714adcecdd9939", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745756ea-b3", "ovs_interfaceid": "745756ea-b360-423f-8258-5339a80658b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Releasing lock "refresh_cache-4f1102c5-f5ef-48d5-b271-6e25bee5cc70" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:54:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Creating tmpfile /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/tmp6xeoxq4g to verify with other compute node that the instance is on the same shared storage. {{(pid=74850) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 14 00:54:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:37 user nova-compute[74850]: DEBUG nova.compute.manager [req-99ce52c9-b9d6-4353-9c5e-404878a7cade req-6c08545f-2707-4ec0-8327-41ca18377f37 service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Received event network-vif-unplugged-745756ea-b360-423f-8258-5339a80658b5 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:54:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-99ce52c9-b9d6-4353-9c5e-404878a7cade req-6c08545f-2707-4ec0-8327-41ca18377f37 service nova] Acquiring lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:54:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-99ce52c9-b9d6-4353-9c5e-404878a7cade req-6c08545f-2707-4ec0-8327-41ca18377f37 service nova] Lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:54:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-99ce52c9-b9d6-4353-9c5e-404878a7cade req-6c08545f-2707-4ec0-8327-41ca18377f37 service nova] Lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:54:37 user nova-compute[74850]: DEBUG nova.compute.manager [req-99ce52c9-b9d6-4353-9c5e-404878a7cade req-6c08545f-2707-4ec0-8327-41ca18377f37 service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] No waiting events found dispatching network-vif-unplugged-745756ea-b360-423f-8258-5339a80658b5 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:54:37 user nova-compute[74850]: WARNING nova.compute.manager [req-99ce52c9-b9d6-4353-9c5e-404878a7cade req-6c08545f-2707-4ec0-8327-41ca18377f37 service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Received unexpected event network-vif-unplugged-745756ea-b360-423f-8258-5339a80658b5 for instance with vm_state resized and task_state resize_reverting.
Nov 14 00:54:37 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:54:37 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23662623062346365', 'path': '/dev/sde'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:54:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662623062346365', 'path': '/dev/sde'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 00:54:37 user nova-compute[74850]: DEBUG nova.objects.instance [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Lazy-loading 'flavor' on Instance uuid 57f1e010-68bf-4047-9316-0412a2c89be2 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:54:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 00:54:37 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:54:37 user nova-compute[74850]:   <source dev="/dev/sde"/>
Nov 14 00:54:37 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:54:37 user nova-compute[74850]:   <serial>a3985a0d-eefa-4754-9d40-c2de91bacfc2</serial>
Nov 14 00:54:37 user nova-compute[74850]: </disk>
Nov 14 00:54:37 user nova-compute[74850]:  {{(pid=74850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 00:54:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:54:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:54:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] No VIF found with MAC fa:16:3e:34:bf:d7, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:54:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a76579fa-dfb6-4b39-bb67-90dbcf8b648c tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Lock "57f1e010-68bf-4047-9316-0412a2c89be2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.291s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:54:38 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Instance destroyed successfully.
Nov 14 00:54:38 user nova-compute[74850]: DEBUG nova.objects.instance [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lazy-loading 'resources' on Instance uuid 4f1102c5-f5ef-48d5-b271-6e25bee5cc70 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:48:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-601800786',display_name='tempest-ServerActionsTestOtherB-server-601800786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-601800786',id=16,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwPveYWJd2P0BbCb28a9iVIK1Zsz5G3BGaDez0xzoCyU4RzkEN+R7LDyKbiUXGXbhQ6BKU8E1EnTC8pc8cZ9B9nXwhdl3wP+4ydXfXlf6SKZGReFXRGfyOHNNyPoLUUDg==',key_name='tempest-keypair-802679501',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:53:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af65f5e7dcc3404292714adcecdd9939',ramdisk_id='',reservation_id='r-kr9hd7jm',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1251502845',owner_user_name='tempest-ServerActionsTestOtherB-1251502845-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:53:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2647a5318ce4cdca3154aef93651505',uuid=4f1102c5-f5ef-48d5-b271-6e25bee5cc70,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "745756ea-b360-423f-8258-5339a80658b5", "address": "fa:16:3e:1e:5a:e7", "network": {"id": "0e3f4d71-4998-448f-b706-8ae0f6d0d960", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-245892937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af65f5e7dcc3404292714adcecdd9939", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745756ea-b3", "ovs_interfaceid": "745756ea-b360-423f-8258-5339a80658b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Converting VIF {"id": "745756ea-b360-423f-8258-5339a80658b5", "address": "fa:16:3e:1e:5a:e7", "network": {"id": "0e3f4d71-4998-448f-b706-8ae0f6d0d960", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-245892937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af65f5e7dcc3404292714adcecdd9939", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745756ea-b3", "ovs_interfaceid": "745756ea-b360-423f-8258-5339a80658b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:5a:e7,bridge_name='br-int',has_traffic_filtering=True,id=745756ea-b360-423f-8258-5339a80658b5,network=Network(0e3f4d71-4998-448f-b706-8ae0f6d0d960),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745756ea-b3') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG os_vif [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:5a:e7,bridge_name='br-int',has_traffic_filtering=True,id=745756ea-b360-423f-8258-5339a80658b5,network=Network(0e3f4d71-4998-448f-b706-8ae0f6d0d960),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745756ea-b3') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap745756ea-b3, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9169e7f7-0407-4f2f-b71f-a2c13606d7f0) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:38 user nova-compute[74850]: INFO os_vif [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:5a:e7,bridge_name='br-int',has_traffic_filtering=True,id=745756ea-b360-423f-8258-5339a80658b5,network=Network(0e3f4d71-4998-448f-b706-8ae0f6d0d960),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745756ea-b3')
Nov 14 00:54:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oniPaHRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:54:38 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:54:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b7a072-e810-4985-9276-37bb009f326f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 00:54:38 user nova-compute[74850]: No targets found.
Nov 14 00:54:38 user nova-compute[74850]: iSNS:
Nov 14 00:54:38 user nova-compute[74850]: No targets found.
Nov 14 00:54:38 user nova-compute[74850]: STATIC:
Nov 14 00:54:38 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2
Nov 14 00:54:38 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:54:38 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:54:38 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf
Nov 14 00:54:38 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:54:38 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:54:38 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390
Nov 14 00:54:38 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:54:38 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:54:38 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714
Nov 14 00:54:38 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:54:38 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:54:38 user nova-compute[74850]: FIRMWARE:
Nov 14 00:54:38 user nova-compute[74850]: No targets found.
Nov 14 00:54:38 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 00:54:38 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 00:54:38 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f39230b-59f4-474f-88a3-1bd7b2bbbb17]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69558ed-58fd-42f4-bad2-869de91d046a]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:54:38 user nova-compute[74850]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:54:38 user nova-compute[74850]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:54:38 user nova-compute[74850]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2 (non-flash)
Nov 14 00:54:38 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:54:38 user nova-compute[74850]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:54:38 user nova-compute[74850]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:54:38 user nova-compute[74850]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2 (non-flash)
Nov 14 00:54:38 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a1c70eef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf'): ({'sdc'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Removing single pathed devices sdc {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec29de6-e6eb-4ed5-837b-33d51420d6ca]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8be231-b95d-4b56-884a-bc8c9cd7f1ef]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Flushing IO for device /dev/sdc {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72ecd60-81a8-4176-9ee7-4c800facd69b]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8750d6-0cba-4884-8fcd-095d86991d42]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] SCSI volumes sdc have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a3c70e-85bc-400f-9d70-f56be9232fd6]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd51683c-7c4d-4e1b-9d40-1892ee1e9dc6]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf, portal: 172.16.0.220,3260]
Nov 14 00:54:38 user nova-compute[74850]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf, portal: 172.16.0.220,3260] successful.
Nov 14 00:54:38 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef115b38-5b0d-4596-b60a-f50244375b1c]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] <== disconnect_volume: return (365ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:54:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 00:54:39 user nova-compute[74850]: DEBUG nova.compute.manager [req-8b88ce7b-c885-4628-bab7-4a9a89ce291a req-15cbf148-47e5-4e35-9f1b-3e9623c1187b service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Received event network-vif-plugged-745756ea-b360-423f-8258-5339a80658b5 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:54:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-8b88ce7b-c885-4628-bab7-4a9a89ce291a req-15cbf148-47e5-4e35-9f1b-3e9623c1187b service nova] Acquiring lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:54:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-8b88ce7b-c885-4628-bab7-4a9a89ce291a req-15cbf148-47e5-4e35-9f1b-3e9623c1187b service nova] Lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:54:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-8b88ce7b-c885-4628-bab7-4a9a89ce291a req-15cbf148-47e5-4e35-9f1b-3e9623c1187b service nova] Lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:54:39 user nova-compute[74850]: DEBUG nova.compute.manager [req-8b88ce7b-c885-4628-bab7-4a9a89ce291a req-15cbf148-47e5-4e35-9f1b-3e9623c1187b service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] No waiting events found dispatching network-vif-plugged-745756ea-b360-423f-8258-5339a80658b5 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:54:39 user nova-compute[74850]: WARNING nova.compute.manager [req-8b88ce7b-c885-4628-bab7-4a9a89ce291a req-15cbf148-47e5-4e35-9f1b-3e9623c1187b service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Received unexpected event network-vif-plugged-745756ea-b360-423f-8258-5339a80658b5 for instance with vm_state resized and task_state resize_reverting.
Nov 14 00:54:39 user nova-compute[74850]: DEBUG nova.compute.manager [None req-c8d7ec7a-8a6d-47aa-a5a0-31122a29c01b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:54:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:54:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:54:39 user nova-compute[74850]: DEBUG nova.objects.instance [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lazy-loading 'migration_context' on Instance uuid 4f1102c5-f5ef-48d5-b271-6e25bee5cc70 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:54:39 user nova-compute[74850]: INFO nova.compute.manager [None req-c8d7ec7a-8a6d-47aa-a5a0-31122a29c01b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] instance snapshotting
Nov 14 00:54:39 user nova-compute[74850]: DEBUG nova.objects.base [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Object Instance<4f1102c5-f5ef-48d5-b271-6e25bee5cc70> lazy-loaded attributes: resources,migration_context {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 00:54:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-964a4d45-1387-4fa7-bf2c-2d440d27d220 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Acquiring lock "57f1e010-68bf-4047-9316-0412a2c89be2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:54:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-964a4d45-1387-4fa7-bf2c-2d440d27d220 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Lock "57f1e010-68bf-4047-9316-0412a2c89be2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:54:39 user nova-compute[74850]: INFO nova.compute.manager [None req-964a4d45-1387-4fa7-bf2c-2d440d27d220 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Detaching volume a3985a0d-eefa-4754-9d40-c2de91bacfc2
Nov 14 00:54:39 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-c8d7ec7a-8a6d-47aa-a5a0-31122a29c01b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Beginning live snapshot process
Nov 14 00:54:39 user nova-compute[74850]: INFO nova.virt.block_device [None req-964a4d45-1387-4fa7-bf2c-2d440d27d220 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Attempting to driver detach volume a3985a0d-eefa-4754-9d40-c2de91bacfc2 from mountpoint /dev/vdb
Nov 14 00:54:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-964a4d45-1387-4fa7-bf2c-2d440d27d220 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Attempting to detach device vdb from instance 57f1e010-68bf-4047-9316-0412a2c89be2 from the persistent domain config. {{(pid=74850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 00:54:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-964a4d45-1387-4fa7-bf2c-2d440d27d220 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 00:54:39 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:54:39 user nova-compute[74850]:   <source dev="/dev/sde"/>
Nov 14 00:54:39 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:54:39 user nova-compute[74850]:   <serial>a3985a0d-eefa-4754-9d40-c2de91bacfc2</serial>
Nov 14 00:54:39 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 00:54:39 user nova-compute[74850]: </disk>
Nov 14 00:54:39 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 00:54:39 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-964a4d45-1387-4fa7-bf2c-2d440d27d220 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Successfully detached device vdb from instance 57f1e010-68bf-4047-9316-0412a2c89be2 from the persistent domain config.
Nov 14 00:54:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-964a4d45-1387-4fa7-bf2c-2d440d27d220 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 57f1e010-68bf-4047-9316-0412a2c89be2 from the live domain config. {{(pid=74850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 00:54:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-964a4d45-1387-4fa7-bf2c-2d440d27d220 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 00:54:39 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:54:39 user nova-compute[74850]:   <source dev="/dev/sde"/>
Nov 14 00:54:39 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:54:39 user nova-compute[74850]:   <serial>a3985a0d-eefa-4754-9d40-c2de91bacfc2</serial>
Nov 14 00:54:39 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 00:54:39 user nova-compute[74850]: </disk>
Nov 14 00:54:39 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 00:54:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-c8d7ec7a-8a6d-47aa-a5a0-31122a29c01b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk --force-share --output=json -f qcow2 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:39 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:54:39 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:54:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-c8d7ec7a-8a6d-47aa-a5a0-31122a29c01b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk --force-share --output=json -f qcow2" returned: 0 in 0.169s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-c8d7ec7a-8a6d-47aa-a5a0-31122a29c01b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk --force-share --output=json -f qcow2 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.573s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:54:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-964a4d45-1387-4fa7-bf2c-2d440d27d220 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 57f1e010-68bf-4047-9316-0412a2c89be2 {{(pid=74850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 00:54:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-c8d7ec7a-8a6d-47aa-a5a0-31122a29c01b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk --force-share --output=json -f qcow2" returned: 0 in 0.168s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-c8d7ec7a-8a6d-47aa-a5a0-31122a29c01b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:40 user nova-compute[74850]: INFO nova.compute.manager [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Swapping old allocation on dict_keys(['fe703abb-f68c-420d-a7f0-bf5240e23c54']) held by migration 031456c4-37fc-41ea-a496-f91bcf24372d for instance
Nov 14 00:54:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:40 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Overwriting current allocation {'allocations': {'fe703abb-f68c-420d-a7f0-bf5240e23c54': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 32}}, 'project_id': 'af65f5e7dcc3404292714adcecdd9939', 'user_id': 'a2647a5318ce4cdca3154aef93651505', 'consumer_generation': 1} on consumer 4f1102c5-f5ef-48d5-b271-6e25bee5cc70 {{(pid=74850) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 14 00:54:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-c8d7ec7a-8a6d-47aa-a5a0-31122a29c01b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.175s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-c8d7ec7a-8a6d-47aa-a5a0-31122a29c01b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpomwbaybv/adadac8ad7704d1ea43a2bb09e94abce.delta 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Acquiring lock "refresh_cache-4f1102c5-f5ef-48d5-b271-6e25bee5cc70" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:54:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Acquired lock "refresh_cache-4f1102c5-f5ef-48d5-b271-6e25bee5cc70" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:54:40 user nova-compute[74850]: DEBUG nova.network.neutron [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:54:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-c8d7ec7a-8a6d-47aa-a5a0-31122a29c01b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpomwbaybv/adadac8ad7704d1ea43a2bb09e94abce.delta 1073741824" returned: 0 in 0.120s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:40 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-c8d7ec7a-8a6d-47aa-a5a0-31122a29c01b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 00:54:40 user nova-compute[74850]: DEBUG nova.network.neutron [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Updating instance_info_cache with network_info: [{"id": "745756ea-b360-423f-8258-5339a80658b5", "address": "fa:16:3e:1e:5a:e7", "network": {"id": "0e3f4d71-4998-448f-b706-8ae0f6d0d960", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-245892937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af65f5e7dcc3404292714adcecdd9939", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745756ea-b3", "ovs_interfaceid": "745756ea-b360-423f-8258-5339a80658b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:54:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Releasing lock "refresh_cache-4f1102c5-f5ef-48d5-b271-6e25bee5cc70" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:54:40 user nova-compute[74850]: DEBUG os_brick.utils [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:54:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:40 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dee2e99-0a87-4921-a3a6-af01b633de77]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:40 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a2a960-4e98-40dc-871a-31ab9c59d1cb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:40 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c03d94-9919-4e50-b7a3-2341fb46ac4a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:40 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4692ebc-2c45-4d35-b57c-062d7e623174]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:54:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 00:54:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:54:40 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 00:54:40 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4428aba-d680-404a-81a2-497556d11fd5]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 00:54:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 00:54:40 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 00:54:40 user nova-compute[74850]: DEBUG os_brick.utils [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:54:41 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-c8d7ec7a-8a6d-47aa-a5a0-31122a29c01b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 00:54:41 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-c8d7ec7a-8a6d-47aa-a5a0-31122a29c01b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] COPY block job progress, current cursor: 27721728 final cursor: 75563008 {{(pid=74850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 00:54:42 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-c8d7ec7a-8a6d-47aa-a5a0-31122a29c01b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 00:54:42 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-c8d7ec7a-8a6d-47aa-a5a0-31122a29c01b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 00:54:42 user nova-compute[74850]: DEBUG nova.privsep.utils [None req-c8d7ec7a-8a6d-47aa-a5a0-31122a29c01b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74850) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 00:54:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-c8d7ec7a-8a6d-47aa-a5a0-31122a29c01b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpomwbaybv/adadac8ad7704d1ea43a2bb09e94abce.delta /opt/stack/data/nova/instances/snapshots/tmpomwbaybv/adadac8ad7704d1ea43a2bb09e94abce {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-c8d7ec7a-8a6d-47aa-a5a0-31122a29c01b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpomwbaybv/adadac8ad7704d1ea43a2bb09e94abce.delta /opt/stack/data/nova/instances/snapshots/tmpomwbaybv/adadac8ad7704d1ea43a2bb09e94abce" returned: 0 in 0.816s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:42 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-c8d7ec7a-8a6d-47aa-a5a0-31122a29c01b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Snapshot extracted, beginning image upload
Nov 14 00:54:43 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:44 user nova-compute[74850]: INFO nova.compute.manager [None req-0d26d983-79b3-4192-b4f6-b8684ffe12cc tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Unrescuing
Nov 14 00:54:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-0d26d983-79b3-4192-b4f6-b8684ffe12cc tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Acquiring lock "refresh_cache-4b60ac08-e954-46d5-a280-a11146b3ebf4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:54:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-0d26d983-79b3-4192-b4f6-b8684ffe12cc tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Acquired lock "refresh_cache-4b60ac08-e954-46d5-a280-a11146b3ebf4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:54:44 user nova-compute[74850]: DEBUG nova.network.neutron [None req-0d26d983-79b3-4192-b4f6-b8684ffe12cc tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:54:44 user nova-compute[74850]: DEBUG nova.network.neutron [None req-0d26d983-79b3-4192-b4f6-b8684ffe12cc tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Updating instance_info_cache with network_info: [{"id": "06e3d114-d80f-4634-840a-d4e120c77a88", "address": "fa:16:3e:ef:7a:d7", "network": {"id": "a32d38d7-3a21-4c1b-886b-473c5cac50a4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-777089423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ed4742aedf24e90a866dd0a8692635e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e3d114-d8", "ovs_interfaceid": "06e3d114-d80f-4634-840a-d4e120c77a88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:54:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-0d26d983-79b3-4192-b4f6-b8684ffe12cc tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Releasing lock "refresh_cache-4b60ac08-e954-46d5-a280-a11146b3ebf4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:54:44 user nova-compute[74850]: DEBUG nova.objects.instance [None req-0d26d983-79b3-4192-b4f6-b8684ffe12cc tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lazy-loading 'flavor' on Instance uuid 4b60ac08-e954-46d5-a280-a11146b3ebf4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Starting finish_revert_migration {{(pid=74850) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Start _get_guest_xml network_info=[{"id": "745756ea-b360-423f-8258-5339a80658b5", "address": "fa:16:3e:1e:5a:e7", "network": {"id": "0e3f4d71-4998-448f-b706-8ae0f6d0d960", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-245892937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af65f5e7dcc3404292714adcecdd9939", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745756ea-b3", "ovs_interfaceid": "745756ea-b360-423f-8258-5339a80658b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3a91ded0-fd7f-4c5c-b9d7-ca1d0a7cb848', 'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oniPaHRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '4f1102c5-f5ef-48d5-b271-6e25bee5cc70', 'attached_at': '2023-11-14T00:54:45.000000', 'detached_at': '', 'volume_id': 'fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf', 'serial': 'fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf'}, 'volume_type': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:54:45 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:54:45 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:54:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG nova.objects.instance [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4f1102c5-f5ef-48d5-b271-6e25bee5cc70 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oniPaHRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:54:45 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:54:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:54:45 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:54:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:54:45 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 00:54:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[43426629-9961-4748-bd3f-b7ccc765d592]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 00:54:45 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG nova.compute.manager [req-a8169941-4c5e-4569-b221-f659d7787876 req-4b7c3732-5ae3-4f25-8a71-d4be755f8f94 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Received event network-vif-unplugged-06e3d114-d80f-4634-840a-d4e120c77a88 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a8169941-4c5e-4569-b221-f659d7787876 req-4b7c3732-5ae3-4f25-8a71-d4be755f8f94 service nova] Acquiring lock "4b60ac08-e954-46d5-a280-a11146b3ebf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a8169941-4c5e-4569-b221-f659d7787876 req-4b7c3732-5ae3-4f25-8a71-d4be755f8f94 service nova] Lock "4b60ac08-e954-46d5-a280-a11146b3ebf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a8169941-4c5e-4569-b221-f659d7787876 req-4b7c3732-5ae3-4f25-8a71-d4be755f8f94 service nova] Lock "4b60ac08-e954-46d5-a280-a11146b3ebf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG nova.compute.manager [req-a8169941-4c5e-4569-b221-f659d7787876 req-4b7c3732-5ae3-4f25-8a71-d4be755f8f94 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] No waiting events found dispatching network-vif-unplugged-06e3d114-d80f-4634-840a-d4e120c77a88 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:54:45 user nova-compute[74850]: WARNING nova.compute.manager [req-a8169941-4c5e-4569-b221-f659d7787876 req-4b7c3732-5ae3-4f25-8a71-d4be755f8f94 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Received unexpected event network-vif-unplugged-06e3d114-d80f-4634-840a-d4e120c77a88 for instance with vm_state rescued and task_state unrescuing.
Nov 14 00:54:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a55b945-6f29-4f83-bde0-3b92299d1a01]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf] added
Nov 14 00:54:45 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d51b39-26a2-4b34-b2db-c24e077b01bd]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2670ef3d-147c-46ac-a3a0-8d2a1641b6c7]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oniPaHRL {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oniPaHRL" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f14be02-7add-40c3-ae6b-48e57fb563cd]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oniPaHRL'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7733d366-6e93-47de-b598-95c170d19fed]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5573ba26-5219-4fcc-9960-47cc4af0ee7c]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:54:45 user nova-compute[74850]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:54:45 user nova-compute[74850]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2 (non-flash)
Nov 14 00:54:45 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:54:45 user nova-compute[74850]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:54:45 user nova-compute[74850]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2 (non-flash)
Nov 14 00:54:45 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c596a0f2-4ac2-480b-8c71-0ddaf40e9587]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf, portal: 172.16.0.220,3260]
Nov 14 00:54:45 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf, portal: 172.16.0.220,3260] successful.
Nov 14 00:54:45 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[154137c0-4163-4e8f-bdb4-c6f22a7bdb7d]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:45 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-c8d7ec7a-8a6d-47aa-a5a0-31122a29c01b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Snapshot image upload complete
Nov 14 00:54:45 user nova-compute[74850]: INFO nova.compute.manager [None req-c8d7ec7a-8a6d-47aa-a5a0-31122a29c01b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Took 6.23 seconds to snapshot the instance on the hypervisor.
Nov 14 00:54:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21dc991-05d5-4b0d-b350-608da56b5756]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:54:45 user nova-compute[74850]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:54:45 user nova-compute[74850]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2 (non-flash)
Nov 14 00:54:45 user nova-compute[74850]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:54:45 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:54:45 user nova-compute[74850]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:54:45 user nova-compute[74850]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2 (non-flash)
Nov 14 00:54:45 user nova-compute[74850]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:54:45 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:45 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Instance destroyed successfully.
Nov 14 00:54:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39df7fc-739f-449a-8b25-9cb350337938]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oniPaHRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 00:54:45 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:54:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:54:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23039313564393733', 'path': '/dev/sdc'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:54:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039313564393733', 'path': '/dev/sdc'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 00:54:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:48:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-601800786',display_name='tempest-ServerActionsTestOtherB-server-601800786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-601800786',id=16,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwPveYWJd2P0BbCb28a9iVIK1Zsz5G3BGaDez0xzoCyU4RzkEN+R7LDyKbiUXGXbhQ6BKU8E1EnTC8pc8cZ9B9nXwhdl3wP+4ydXfXlf6SKZGReFXRGfyOHNNyPoLUUDg==',key_name='tempest-keypair-802679501',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:53:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='af65f5e7dcc3404292714adcecdd9939',ramdisk_id='',reservation_id='r-kr9hd7jm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1251502845',owner_user_name='tempest-ServerActionsTestOtherB-1251502845-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:54:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2647a5318ce4cdca3154aef93651505',uuid=4f1102c5-f5ef-48d5-b271-6e25bee5cc70,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "745756ea-b360-423f-8258-5339a80658b5", "address": "fa:16:3e:1e:5a:e7", "network": {"id": "0e3f4d71-4998-448f-b706-8ae0f6d0d960", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-245892937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af65f5e7dcc3404292714adcecdd9939", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745756ea-b3", "ovs_interfaceid": "745756ea-b360-423f-8258-5339a80658b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:54:46 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Converting VIF {"id": "745756ea-b360-423f-8258-5339a80658b5", "address": "fa:16:3e:1e:5a:e7", "network": {"id": "0e3f4d71-4998-448f-b706-8ae0f6d0d960", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-245892937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af65f5e7dcc3404292714adcecdd9939", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745756ea-b3", "ovs_interfaceid": "745756ea-b360-423f-8258-5339a80658b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:54:46 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:5a:e7,bridge_name='br-int',has_traffic_filtering=True,id=745756ea-b360-423f-8258-5339a80658b5,network=Network(0e3f4d71-4998-448f-b706-8ae0f6d0d960),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745756ea-b3') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:54:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:54:46 user nova-compute[74850]:   <uuid>4f1102c5-f5ef-48d5-b271-6e25bee5cc70</uuid>
Nov 14 00:54:46 user nova-compute[74850]:   <name>instance-00000010</name>
Nov 14 00:54:46 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:54:46 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:54:46 user nova-compute[74850]:   <metadata>
Nov 14 00:54:46 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:54:46 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:54:46 user nova-compute[74850]:       <nova:name>tempest-ServerActionsTestOtherB-server-601800786</nova:name>
Nov 14 00:54:46 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:54:45</nova:creationTime>
Nov 14 00:54:46 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:54:46 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:54:46 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:54:46 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:54:46 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:54:46 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:54:46 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:54:46 user nova-compute[74850]:       <nova:owner>
Nov 14 00:54:46 user nova-compute[74850]:         <nova:user uuid="a2647a5318ce4cdca3154aef93651505">tempest-ServerActionsTestOtherB-1251502845-project-member</nova:user>
Nov 14 00:54:46 user nova-compute[74850]:         <nova:project uuid="af65f5e7dcc3404292714adcecdd9939">tempest-ServerActionsTestOtherB-1251502845</nova:project>
Nov 14 00:54:46 user nova-compute[74850]:       </nova:owner>
Nov 14 00:54:46 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:54:46 user nova-compute[74850]:       <nova:ports>
Nov 14 00:54:46 user nova-compute[74850]:         <nova:port uuid="745756ea-b360-423f-8258-5339a80658b5">
Nov 14 00:54:46 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 00:54:46 user nova-compute[74850]:         </nova:port>
Nov 14 00:54:46 user nova-compute[74850]:       </nova:ports>
Nov 14 00:54:46 user nova-compute[74850]:     </nova:instance>
Nov 14 00:54:46 user nova-compute[74850]:   </metadata>
Nov 14 00:54:46 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:54:46 user nova-compute[74850]:     <system>
Nov 14 00:54:46 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:54:46 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:54:46 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:54:46 user nova-compute[74850]:       <entry name="serial">4f1102c5-f5ef-48d5-b271-6e25bee5cc70</entry>
Nov 14 00:54:46 user nova-compute[74850]:       <entry name="uuid">4f1102c5-f5ef-48d5-b271-6e25bee5cc70</entry>
Nov 14 00:54:46 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:54:46 user nova-compute[74850]:     </system>
Nov 14 00:54:46 user nova-compute[74850]:   </sysinfo>
Nov 14 00:54:46 user nova-compute[74850]:   <os>
Nov 14 00:54:46 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:54:46 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 00:54:46 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:54:46 user nova-compute[74850]:   </os>
Nov 14 00:54:46 user nova-compute[74850]:   <features>
Nov 14 00:54:46 user nova-compute[74850]:     <acpi/>
Nov 14 00:54:46 user nova-compute[74850]:     <apic/>
Nov 14 00:54:46 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:54:46 user nova-compute[74850]:   </features>
Nov 14 00:54:46 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:54:46 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:54:46 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:54:46 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:54:46 user nova-compute[74850]:   </clock>
Nov 14 00:54:46 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:54:46 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:54:46 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:54:46 user nova-compute[74850]:   </cpu>
Nov 14 00:54:46 user nova-compute[74850]:   <devices>
Nov 14 00:54:46 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 00:54:46 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:54:46 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk"/>
Nov 14 00:54:46 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:54:46 user nova-compute[74850]:     </disk>
Nov 14 00:54:46 user nova-compute[74850]:     <disk type="block" device="disk">
Nov 14 00:54:46 user nova-compute[74850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:54:46 user nova-compute[74850]:       <source dev="/dev/sdc"/>
Nov 14 00:54:46 user nova-compute[74850]:       <target dev="vdb" bus="virtio"/>
Nov 14 00:54:46 user nova-compute[74850]:       <serial>fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf</serial>
Nov 14 00:54:46 user nova-compute[74850]:     </disk>
Nov 14 00:54:46 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:54:46 user nova-compute[74850]:       <mac address="fa:16:3e:1e:5a:e7"/>
Nov 14 00:54:46 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:54:46 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:54:46 user nova-compute[74850]:       <target dev="tap745756ea-b3"/>
Nov 14 00:54:46 user nova-compute[74850]:     </interface>
Nov 14 00:54:46 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:54:46 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/console.log" append="off"/>
Nov 14 00:54:46 user nova-compute[74850]:     </serial>
Nov 14 00:54:46 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:54:46 user nova-compute[74850]:     <video>
Nov 14 00:54:46 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:54:46 user nova-compute[74850]:     </video>
Nov 14 00:54:46 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:54:46 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:54:46 user nova-compute[74850]:     </rng>
Nov 14 00:54:46 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:54:46 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:54:46 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:54:46 user nova-compute[74850]:     </memballoon>
Nov 14 00:54:46 user nova-compute[74850]:   </devices>
Nov 14 00:54:46 user nova-compute[74850]: </domain>
Nov 14 00:54:46 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:54:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:48:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-601800786',display_name='tempest-ServerActionsTestOtherB-server-601800786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-601800786',id=16,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwPveYWJd2P0BbCb28a9iVIK1Zsz5G3BGaDez0xzoCyU4RzkEN+R7LDyKbiUXGXbhQ6BKU8E1EnTC8pc8cZ9B9nXwhdl3wP+4ydXfXlf6SKZGReFXRGfyOHNNyPoLUUDg==',key_name='tempest-keypair-802679501',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:53:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='af65f5e7dcc3404292714adcecdd9939',ramdisk_id='',reservation_id='r-kr9hd7jm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1251502845',owner_user_name='tempest-ServerActionsTestOtherB-1251502845-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:54:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2647a5318ce4cdca3154aef93651505',uuid=4f1102c5-f5ef-48d5-b271-6e25bee5cc70,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "745756ea-b360-423f-8258-5339a80658b5", "address": "fa:16:3e:1e:5a:e7", "network": {"id": "0e3f4d71-4998-448f-b706-8ae0f6d0d960", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-245892937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af65f5e7dcc3404292714adcecdd9939", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745756ea-b3", "ovs_interfaceid": "745756ea-b360-423f-8258-5339a80658b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:54:46 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Converting VIF {"id": "745756ea-b360-423f-8258-5339a80658b5", "address": "fa:16:3e:1e:5a:e7", "network": {"id": "0e3f4d71-4998-448f-b706-8ae0f6d0d960", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-245892937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af65f5e7dcc3404292714adcecdd9939", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745756ea-b3", "ovs_interfaceid": "745756ea-b360-423f-8258-5339a80658b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:54:46 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:5a:e7,bridge_name='br-int',has_traffic_filtering=True,id=745756ea-b360-423f-8258-5339a80658b5,network=Network(0e3f4d71-4998-448f-b706-8ae0f6d0d960),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745756ea-b3') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:54:46 user nova-compute[74850]: DEBUG os_vif [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:5a:e7,bridge_name='br-int',has_traffic_filtering=True,id=745756ea-b360-423f-8258-5339a80658b5,network=Network(0e3f4d71-4998-448f-b706-8ae0f6d0d960),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745756ea-b3') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:54:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:54:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:54:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5c741d96-38cb-574c-be22-7f2400d549d5', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:54:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:54:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap745756ea-b3, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:54:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap745756ea-b3, col_values=(('qos', UUID('2c46ab96-e747-481d-b901-83f1007d5ec1')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:54:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap745756ea-b3, col_values=(('external_ids', {'iface-id': '745756ea-b360-423f-8258-5339a80658b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:5a:e7', 'vm-uuid': '4f1102c5-f5ef-48d5-b271-6e25bee5cc70'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:54:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:54:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:46 user nova-compute[74850]: INFO os_vif [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:5a:e7,bridge_name='br-int',has_traffic_filtering=True,id=745756ea-b360-423f-8258-5339a80658b5,network=Network(0e3f4d71-4998-448f-b706-8ae0f6d0d960),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745756ea-b3')
Nov 14 00:54:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:47 user nova-compute[74850]: DEBUG nova.compute.manager [req-5706b2f0-60a5-44ba-ac79-2b96a9fa8b93 req-299b45c4-f12a-4b7d-9df5-5dbef3189ae9 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Received event network-vif-plugged-06e3d114-d80f-4634-840a-d4e120c77a88 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:54:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5706b2f0-60a5-44ba-ac79-2b96a9fa8b93 req-299b45c4-f12a-4b7d-9df5-5dbef3189ae9 service nova] Acquiring lock "4b60ac08-e954-46d5-a280-a11146b3ebf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:54:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5706b2f0-60a5-44ba-ac79-2b96a9fa8b93 req-299b45c4-f12a-4b7d-9df5-5dbef3189ae9 service nova] Lock "4b60ac08-e954-46d5-a280-a11146b3ebf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:54:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5706b2f0-60a5-44ba-ac79-2b96a9fa8b93 req-299b45c4-f12a-4b7d-9df5-5dbef3189ae9 service nova] Lock "4b60ac08-e954-46d5-a280-a11146b3ebf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:54:47 user nova-compute[74850]: DEBUG nova.compute.manager [req-5706b2f0-60a5-44ba-ac79-2b96a9fa8b93 req-299b45c4-f12a-4b7d-9df5-5dbef3189ae9 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] No waiting events found dispatching network-vif-plugged-06e3d114-d80f-4634-840a-d4e120c77a88 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:54:47 user nova-compute[74850]: WARNING nova.compute.manager [req-5706b2f0-60a5-44ba-ac79-2b96a9fa8b93 req-299b45c4-f12a-4b7d-9df5-5dbef3189ae9 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Received unexpected event network-vif-plugged-06e3d114-d80f-4634-840a-d4e120c77a88 for instance with vm_state rescued and task_state unrescuing.
Nov 14 00:54:47 user nova-compute[74850]: DEBUG nova.compute.manager [req-5706b2f0-60a5-44ba-ac79-2b96a9fa8b93 req-299b45c4-f12a-4b7d-9df5-5dbef3189ae9 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Received event network-changed-06e3d114-d80f-4634-840a-d4e120c77a88 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:54:47 user nova-compute[74850]: DEBUG nova.compute.manager [req-5706b2f0-60a5-44ba-ac79-2b96a9fa8b93 req-299b45c4-f12a-4b7d-9df5-5dbef3189ae9 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Refreshing instance network info cache due to event network-changed-06e3d114-d80f-4634-840a-d4e120c77a88. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:54:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5706b2f0-60a5-44ba-ac79-2b96a9fa8b93 req-299b45c4-f12a-4b7d-9df5-5dbef3189ae9 service nova] Acquiring lock "refresh_cache-4b60ac08-e954-46d5-a280-a11146b3ebf4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:54:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5706b2f0-60a5-44ba-ac79-2b96a9fa8b93 req-299b45c4-f12a-4b7d-9df5-5dbef3189ae9 service nova] Acquired lock "refresh_cache-4b60ac08-e954-46d5-a280-a11146b3ebf4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:54:47 user nova-compute[74850]: DEBUG nova.network.neutron [req-5706b2f0-60a5-44ba-ac79-2b96a9fa8b93 req-299b45c4-f12a-4b7d-9df5-5dbef3189ae9 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Refreshing network info cache for port 06e3d114-d80f-4634-840a-d4e120c77a88 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:54:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:47 user nova-compute[74850]: DEBUG nova.network.neutron [req-5706b2f0-60a5-44ba-ac79-2b96a9fa8b93 req-299b45c4-f12a-4b7d-9df5-5dbef3189ae9 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Updated VIF entry in instance network info cache for port 06e3d114-d80f-4634-840a-d4e120c77a88. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:54:47 user nova-compute[74850]: DEBUG nova.network.neutron [req-5706b2f0-60a5-44ba-ac79-2b96a9fa8b93 req-299b45c4-f12a-4b7d-9df5-5dbef3189ae9 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Updating instance_info_cache with network_info: [{"id": "06e3d114-d80f-4634-840a-d4e120c77a88", "address": "fa:16:3e:ef:7a:d7", "network": {"id": "a32d38d7-3a21-4c1b-886b-473c5cac50a4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-777089423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ed4742aedf24e90a866dd0a8692635e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e3d114-d8", "ovs_interfaceid": "06e3d114-d80f-4634-840a-d4e120c77a88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:54:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5706b2f0-60a5-44ba-ac79-2b96a9fa8b93 req-299b45c4-f12a-4b7d-9df5-5dbef3189ae9 service nova] Releasing lock "refresh_cache-4b60ac08-e954-46d5-a280-a11146b3ebf4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:54:48 user nova-compute[74850]: DEBUG nova.compute.manager [req-5706b2f0-60a5-44ba-ac79-2b96a9fa8b93 req-299b45c4-f12a-4b7d-9df5-5dbef3189ae9 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Received event network-changed-06e3d114-d80f-4634-840a-d4e120c77a88 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:54:48 user nova-compute[74850]: DEBUG nova.compute.manager [req-5706b2f0-60a5-44ba-ac79-2b96a9fa8b93 req-299b45c4-f12a-4b7d-9df5-5dbef3189ae9 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Refreshing instance network info cache due to event network-changed-06e3d114-d80f-4634-840a-d4e120c77a88. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:54:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5706b2f0-60a5-44ba-ac79-2b96a9fa8b93 req-299b45c4-f12a-4b7d-9df5-5dbef3189ae9 service nova] Acquiring lock "refresh_cache-4b60ac08-e954-46d5-a280-a11146b3ebf4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:54:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5706b2f0-60a5-44ba-ac79-2b96a9fa8b93 req-299b45c4-f12a-4b7d-9df5-5dbef3189ae9 service nova] Acquired lock "refresh_cache-4b60ac08-e954-46d5-a280-a11146b3ebf4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:54:48 user nova-compute[74850]: DEBUG nova.network.neutron [req-5706b2f0-60a5-44ba-ac79-2b96a9fa8b93 req-299b45c4-f12a-4b7d-9df5-5dbef3189ae9 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Refreshing network info cache for port 06e3d114-d80f-4634-840a-d4e120c77a88 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:54:48 user nova-compute[74850]: DEBUG nova.network.neutron [req-5706b2f0-60a5-44ba-ac79-2b96a9fa8b93 req-299b45c4-f12a-4b7d-9df5-5dbef3189ae9 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Updated VIF entry in instance network info cache for port 06e3d114-d80f-4634-840a-d4e120c77a88. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:54:48 user nova-compute[74850]: DEBUG nova.network.neutron [req-5706b2f0-60a5-44ba-ac79-2b96a9fa8b93 req-299b45c4-f12a-4b7d-9df5-5dbef3189ae9 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Updating instance_info_cache with network_info: [{"id": "06e3d114-d80f-4634-840a-d4e120c77a88", "address": "fa:16:3e:ef:7a:d7", "network": {"id": "a32d38d7-3a21-4c1b-886b-473c5cac50a4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-777089423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ed4742aedf24e90a866dd0a8692635e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e3d114-d8", "ovs_interfaceid": "06e3d114-d80f-4634-840a-d4e120c77a88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:54:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5706b2f0-60a5-44ba-ac79-2b96a9fa8b93 req-299b45c4-f12a-4b7d-9df5-5dbef3189ae9 service nova] Releasing lock "refresh_cache-4b60ac08-e954-46d5-a280-a11146b3ebf4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:54:48 user nova-compute[74850]: DEBUG nova.compute.manager [req-5706b2f0-60a5-44ba-ac79-2b96a9fa8b93 req-299b45c4-f12a-4b7d-9df5-5dbef3189ae9 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Received event network-vif-plugged-06e3d114-d80f-4634-840a-d4e120c77a88 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:54:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5706b2f0-60a5-44ba-ac79-2b96a9fa8b93 req-299b45c4-f12a-4b7d-9df5-5dbef3189ae9 service nova] Acquiring lock "4b60ac08-e954-46d5-a280-a11146b3ebf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:54:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5706b2f0-60a5-44ba-ac79-2b96a9fa8b93 req-299b45c4-f12a-4b7d-9df5-5dbef3189ae9 service nova] Lock "4b60ac08-e954-46d5-a280-a11146b3ebf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:54:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5706b2f0-60a5-44ba-ac79-2b96a9fa8b93 req-299b45c4-f12a-4b7d-9df5-5dbef3189ae9 service nova] Lock "4b60ac08-e954-46d5-a280-a11146b3ebf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:54:48 user nova-compute[74850]: DEBUG nova.compute.manager [req-5706b2f0-60a5-44ba-ac79-2b96a9fa8b93 req-299b45c4-f12a-4b7d-9df5-5dbef3189ae9 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] No waiting events found dispatching network-vif-plugged-06e3d114-d80f-4634-840a-d4e120c77a88 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:54:48 user nova-compute[74850]: WARNING nova.compute.manager [req-5706b2f0-60a5-44ba-ac79-2b96a9fa8b93 req-299b45c4-f12a-4b7d-9df5-5dbef3189ae9 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Received unexpected event network-vif-plugged-06e3d114-d80f-4634-840a-d4e120c77a88 for instance with vm_state rescued and task_state unrescuing.
Nov 14 00:54:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Acquiring lock "c5f97ca6-ee09-4180-9beb-da65c2aead9b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:54:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "c5f97ca6-ee09-4180-9beb-da65c2aead9b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:54:48 user nova-compute[74850]: DEBUG nova.compute.manager [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 00:54:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:54:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:54:48 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 00:54:48 user nova-compute[74850]: INFO nova.compute.claims [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Claim successful on node user
Nov 14 00:54:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:48 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:54:49 user nova-compute[74850]: DEBUG nova.compute.manager [req-0e5adf11-0b3e-4928-8cfd-362be070a418 req-e89d451f-5f79-4c22-81b9-a1e802d1f807 service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Received event network-vif-plugged-745756ea-b360-423f-8258-5339a80658b5 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:54:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-0e5adf11-0b3e-4928-8cfd-362be070a418 req-e89d451f-5f79-4c22-81b9-a1e802d1f807 service nova] Acquiring lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:54:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-0e5adf11-0b3e-4928-8cfd-362be070a418 req-e89d451f-5f79-4c22-81b9-a1e802d1f807 service nova] Lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:54:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-0e5adf11-0b3e-4928-8cfd-362be070a418 req-e89d451f-5f79-4c22-81b9-a1e802d1f807 service nova] Lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:54:49 user nova-compute[74850]: DEBUG nova.compute.manager [req-0e5adf11-0b3e-4928-8cfd-362be070a418 req-e89d451f-5f79-4c22-81b9-a1e802d1f807 service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] No waiting events found dispatching network-vif-plugged-745756ea-b360-423f-8258-5339a80658b5 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:54:49 user nova-compute[74850]: WARNING nova.compute.manager [req-0e5adf11-0b3e-4928-8cfd-362be070a418 req-e89d451f-5f79-4c22-81b9-a1e802d1f807 service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Received unexpected event network-vif-plugged-745756ea-b360-423f-8258-5339a80658b5 for instance with vm_state resized and task_state resize_reverting.
Nov 14 00:54:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:49 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:54:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:49 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:54:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.722s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:54:49 user nova-compute[74850]: DEBUG nova.compute.manager [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 00:54:49 user nova-compute[74850]: DEBUG nova.compute.manager [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 00:54:49 user nova-compute[74850]: DEBUG nova.network.neutron [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 00:54:49 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 00:54:49 user nova-compute[74850]: DEBUG nova.compute.manager [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 00:54:49 user nova-compute[74850]: DEBUG nova.compute.manager [req-ba665c4d-2b1f-45f3-a060-cab7f2edbef8 req-98f3a265-63cb-4907-8d8e-b155f6a86d92 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Received event network-vif-plugged-06e3d114-d80f-4634-840a-d4e120c77a88 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:54:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ba665c4d-2b1f-45f3-a060-cab7f2edbef8 req-98f3a265-63cb-4907-8d8e-b155f6a86d92 service nova] Acquiring lock "4b60ac08-e954-46d5-a280-a11146b3ebf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:54:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ba665c4d-2b1f-45f3-a060-cab7f2edbef8 req-98f3a265-63cb-4907-8d8e-b155f6a86d92 service nova] Lock "4b60ac08-e954-46d5-a280-a11146b3ebf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:54:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ba665c4d-2b1f-45f3-a060-cab7f2edbef8 req-98f3a265-63cb-4907-8d8e-b155f6a86d92 service nova] Lock "4b60ac08-e954-46d5-a280-a11146b3ebf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:54:49 user nova-compute[74850]: DEBUG nova.compute.manager [req-ba665c4d-2b1f-45f3-a060-cab7f2edbef8 req-98f3a265-63cb-4907-8d8e-b155f6a86d92 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] No waiting events found dispatching network-vif-plugged-06e3d114-d80f-4634-840a-d4e120c77a88 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:54:49 user nova-compute[74850]: WARNING nova.compute.manager [req-ba665c4d-2b1f-45f3-a060-cab7f2edbef8 req-98f3a265-63cb-4907-8d8e-b155f6a86d92 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Received unexpected event network-vif-plugged-06e3d114-d80f-4634-840a-d4e120c77a88 for instance with vm_state rescued and task_state unrescuing.
Nov 14 00:54:49 user nova-compute[74850]: DEBUG nova.policy [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '208acda449ad436c85bdbebff0560e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e17bbd82f843fdaa3c48d8cb64a2c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 00:54:49 user nova-compute[74850]: DEBUG nova.compute.manager [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 00:54:49 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 00:54:49 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Creating image(s)
Nov 14 00:54:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Acquiring lock "/opt/stack/data/nova/instances/c5f97ca6-ee09-4180-9beb-da65c2aead9b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:54:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "/opt/stack/data/nova/instances/c5f97ca6-ee09-4180-9beb-da65c2aead9b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:54:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "/opt/stack/data/nova/instances/c5f97ca6-ee09-4180-9beb-da65c2aead9b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:54:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Acquiring lock "03d6354405546a094db4b497352f336030c90306" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:54:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "03d6354405546a094db4b497352f336030c90306" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:54:50 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:54:50 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:54:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03d6354405546a094db4b497352f336030c90306.part --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:50 user nova-compute[74850]: DEBUG nova.network.neutron [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Successfully created port: 1f60b107-fed3-4884-be05-f9c39313b71d {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:54:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:50 user nova-compute[74850]: DEBUG nova.compute.manager [None req-0d26d983-79b3-4192-b4f6-b8684ffe12cc tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:54:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03d6354405546a094db4b497352f336030c90306.part --force-share --output=json" returned: 0 in 0.171s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:50 user nova-compute[74850]: DEBUG nova.virt.images [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] 0db64770-aa6b-4c5d-97ef-85e5c6405aff was qcow2, converting to raw {{(pid=74850) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 00:54:50 user nova-compute[74850]: DEBUG nova.privsep.utils [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74850) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 00:54:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/03d6354405546a094db4b497352f336030c90306.part /opt/stack/data/nova/instances/_base/03d6354405546a094db4b497352f336030c90306.converted {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:54:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.004s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:54:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:54:50 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 00:54:51 user nova-compute[74850]: DEBUG nova.compute.manager [req-deefa71f-2de2-4651-aaa3-6f4d51091971 req-a70c12a6-9c9f-4d9f-aae8-f37a3a634a7e service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Received event network-vif-plugged-745756ea-b360-423f-8258-5339a80658b5 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:54:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-deefa71f-2de2-4651-aaa3-6f4d51091971 req-a70c12a6-9c9f-4d9f-aae8-f37a3a634a7e service nova] Acquiring lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:54:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-deefa71f-2de2-4651-aaa3-6f4d51091971 req-a70c12a6-9c9f-4d9f-aae8-f37a3a634a7e service nova] Lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:54:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-deefa71f-2de2-4651-aaa3-6f4d51091971 req-a70c12a6-9c9f-4d9f-aae8-f37a3a634a7e service nova] Lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:54:51 user nova-compute[74850]: DEBUG nova.compute.manager [req-deefa71f-2de2-4651-aaa3-6f4d51091971 req-a70c12a6-9c9f-4d9f-aae8-f37a3a634a7e service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] No waiting events found dispatching network-vif-plugged-745756ea-b360-423f-8258-5339a80658b5 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:54:51 user nova-compute[74850]: WARNING nova.compute.manager [req-deefa71f-2de2-4651-aaa3-6f4d51091971 req-a70c12a6-9c9f-4d9f-aae8-f37a3a634a7e service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Received unexpected event network-vif-plugged-745756ea-b360-423f-8258-5339a80658b5 for instance with vm_state resized and task_state resize_reverting.
Nov 14 00:54:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:51 user nova-compute[74850]: DEBUG nova.compute.manager [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:54:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/03d6354405546a094db4b497352f336030c90306.part /opt/stack/data/nova/instances/_base/03d6354405546a094db4b497352f336030c90306.converted" returned: 0 in 0.552s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03d6354405546a094db4b497352f336030c90306.converted --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:51 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Instance running successfully.
Nov 14 00:54:51 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] finish_revert_migration finished successfully. {{(pid=74850) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 14 00:54:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57f1e010-68bf-4047-9316-0412a2c89be2/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:51 user nova-compute[74850]: DEBUG nova.network.neutron [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Successfully updated port: 1f60b107-fed3-4884-be05-f9c39313b71d {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:54:51 user nova-compute[74850]: DEBUG nova.compute.manager [req-3f5df9fc-b09a-44a1-8df2-edaf335a7b51 req-b6c8f6fa-c327-4c60-9a42-30a5fa152574 service nova] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Received event network-changed-1f60b107-fed3-4884-be05-f9c39313b71d {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:54:51 user nova-compute[74850]: DEBUG nova.compute.manager [req-3f5df9fc-b09a-44a1-8df2-edaf335a7b51 req-b6c8f6fa-c327-4c60-9a42-30a5fa152574 service nova] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Refreshing instance network info cache due to event network-changed-1f60b107-fed3-4884-be05-f9c39313b71d. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:54:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3f5df9fc-b09a-44a1-8df2-edaf335a7b51 req-b6c8f6fa-c327-4c60-9a42-30a5fa152574 service nova] Acquiring lock "refresh_cache-c5f97ca6-ee09-4180-9beb-da65c2aead9b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:54:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3f5df9fc-b09a-44a1-8df2-edaf335a7b51 req-b6c8f6fa-c327-4c60-9a42-30a5fa152574 service nova] Acquired lock "refresh_cache-c5f97ca6-ee09-4180-9beb-da65c2aead9b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:54:51 user nova-compute[74850]: DEBUG nova.network.neutron [req-3f5df9fc-b09a-44a1-8df2-edaf335a7b51 req-b6c8f6fa-c327-4c60-9a42-30a5fa152574 service nova] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Refreshing network info cache for port 1f60b107-fed3-4884-be05-f9c39313b71d {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:54:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03d6354405546a094db4b497352f336030c90306.converted --force-share --output=json" returned: 0 in 0.237s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Acquiring lock "refresh_cache-c5f97ca6-ee09-4180-9beb-da65c2aead9b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:54:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "03d6354405546a094db4b497352f336030c90306" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.124s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:54:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03d6354405546a094db4b497352f336030c90306 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:51 user nova-compute[74850]: INFO nova.compute.manager [None req-1228dd86-c865-4358-894d-efd0fe6551ba tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Updating instance to original state: 'active'
Nov 14 00:54:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57f1e010-68bf-4047-9316-0412a2c89be2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57f1e010-68bf-4047-9316-0412a2c89be2/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:51 user nova-compute[74850]: DEBUG nova.network.neutron [req-3f5df9fc-b09a-44a1-8df2-edaf335a7b51 req-b6c8f6fa-c327-4c60-9a42-30a5fa152574 service nova] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:54:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03d6354405546a094db4b497352f336030c90306 --force-share --output=json" returned: 0 in 0.176s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Acquiring lock "03d6354405546a094db4b497352f336030c90306" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:54:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "03d6354405546a094db4b497352f336030c90306" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:54:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03d6354405546a094db4b497352f336030c90306 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57f1e010-68bf-4047-9316-0412a2c89be2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03d6354405546a094db4b497352f336030c90306 --force-share --output=json" returned: 0 in 0.197s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/03d6354405546a094db4b497352f336030c90306,backing_fmt=raw /opt/stack/data/nova/instances/c5f97ca6-ee09-4180-9beb-da65c2aead9b/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/03d6354405546a094db4b497352f336030c90306,backing_fmt=raw /opt/stack/data/nova/instances/c5f97ca6-ee09-4180-9beb-da65c2aead9b/disk 1073741824" returned: 0 in 0.059s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "03d6354405546a094db4b497352f336030c90306" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03d6354405546a094db4b497352f336030c90306 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG nova.network.neutron [req-3f5df9fc-b09a-44a1-8df2-edaf335a7b51 req-b6c8f6fa-c327-4c60-9a42-30a5fa152574 service nova] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3f5df9fc-b09a-44a1-8df2-edaf335a7b51 req-b6c8f6fa-c327-4c60-9a42-30a5fa152574 service nova] Releasing lock "refresh_cache-c5f97ca6-ee09-4180-9beb-da65c2aead9b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Acquired lock "refresh_cache-c5f97ca6-ee09-4180-9beb-da65c2aead9b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG nova.network.neutron [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG nova.network.neutron [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03d6354405546a094db4b497352f336030c90306 --force-share --output=json" returned: 0 in 0.199s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Ensure instance console log exists: /opt/stack/data/nova/instances/c5f97ca6-ee09-4180-9beb-da65c2aead9b/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG nova.network.neutron [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Updating instance_info_cache with network_info: [{"id": "1f60b107-fed3-4884-be05-f9c39313b71d", "address": "fa:16:3e:27:57:ed", "network": {"id": "b096d728-1246-4eaa-9222-ed8eee74870c", "bridge": "br-int", "label": "tempest-TestStampPattern-1207618832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e17bbd82f843fdaa3c48d8cb64a2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f60b107-fe", "ovs_interfaceid": "1f60b107-fed3-4884-be05-f9c39313b71d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Releasing lock "refresh_cache-c5f97ca6-ee09-4180-9beb-da65c2aead9b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG nova.compute.manager [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Instance network_info: |[{"id": "1f60b107-fed3-4884-be05-f9c39313b71d", "address": "fa:16:3e:27:57:ed", "network": {"id": "b096d728-1246-4eaa-9222-ed8eee74870c", "bridge": "br-int", "label": "tempest-TestStampPattern-1207618832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e17bbd82f843fdaa3c48d8cb64a2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f60b107-fe", "ovs_interfaceid": "1f60b107-fed3-4884-be05-f9c39313b71d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Start _get_guest_xml network_info=[{"id": "1f60b107-fed3-4884-be05-f9c39313b71d", "address": "fa:16:3e:27:57:ed", "network": {"id": "b096d728-1246-4eaa-9222-ed8eee74870c", "bridge": "br-int", "label": "tempest-TestStampPattern-1207618832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e17bbd82f843fdaa3c48d8cb64a2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f60b107-fe", "ovs_interfaceid": "1f60b107-fed3-4884-be05-f9c39313b71d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='421cba0b39dd7220296aff9956c55e17',container_format='bare',created_at=2023-11-14T00:54:39Z,direct_url=<?>,disk_format='qcow2',id=0db64770-aa6b-4c5d-97ef-85e5c6405aff,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-573812960',owner='82e17bbd82f843fdaa3c48d8cb64a2c9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T00:54:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '0db64770-aa6b-4c5d-97ef-85e5c6405aff'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:54:52 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:54:52 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:54:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='421cba0b39dd7220296aff9956c55e17',container_format='bare',created_at=2023-11-14T00:54:39Z,direct_url=<?>,disk_format='qcow2',id=0db64770-aa6b-4c5d-97ef-85e5c6405aff,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-573812960',owner='82e17bbd82f843fdaa3c48d8cb64a2c9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T00:54:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:54:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-752559758',display_name='tempest-TestStampPattern-server-752559758',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-752559758',id=28,image_ref='0db64770-aa6b-4c5d-97ef-85e5c6405aff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrZlgeE9/Eb/dSvSLuh1rHNCQMOaoa95CjuZ377Ld81ZeZuC/2z69Zf0ms8CG6YuI4ZXEqqItRYp52TjDRYLlQoYwNXCNYDhSdvz3DpnModEihmBQQVehRcSLXR08S+jQ==',key_name='tempest-TestStampPattern-158458074',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82e17bbd82f843fdaa3c48d8cb64a2c9',ramdisk_id='',reservation_id='r-wjpey9fv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='4474ad0e-8eee-4db4-9896-50c049d45d26',image_min_disk='1',image_min_ram='0',image_owner_id='82e17bbd82f843fdaa3c48d8cb64a2c9',image_owner_project_name='tempest-TestStampPattern-1231523385',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1231523385-project-member',image_user_id='208acda449ad436c85bdbebff0560e63',network_allocated='True',owner_project_name='tempest-TestStampPattern-1231523385',owner_user_name='tempest-TestStampPattern-1231523385-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:54:50Z,user_data=None,user_id='208acda449ad436c85bdbebff0560e63',uuid=c5f97ca6-ee09-4180-9beb-da65c2aead9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f60b107-fed3-4884-be05-f9c39313b71d", "address": "fa:16:3e:27:57:ed", "network": {"id": "b096d728-1246-4eaa-9222-ed8eee74870c", "bridge": "br-int", "label": "tempest-TestStampPattern-1207618832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e17bbd82f843fdaa3c48d8cb64a2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f60b107-fe", "ovs_interfaceid": "1f60b107-fed3-4884-be05-f9c39313b71d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Converting VIF {"id": "1f60b107-fed3-4884-be05-f9c39313b71d", "address": "fa:16:3e:27:57:ed", "network": {"id": "b096d728-1246-4eaa-9222-ed8eee74870c", "bridge": "br-int", "label": "tempest-TestStampPattern-1207618832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e17bbd82f843fdaa3c48d8cb64a2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f60b107-fe", "ovs_interfaceid": "1f60b107-fed3-4884-be05-f9c39313b71d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:57:ed,bridge_name='br-int',has_traffic_filtering=True,id=1f60b107-fed3-4884-be05-f9c39313b71d,network=Network(b096d728-1246-4eaa-9222-ed8eee74870c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f60b107-fe') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG nova.objects.instance [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lazy-loading 'pci_devices' on Instance uuid c5f97ca6-ee09-4180-9beb-da65c2aead9b {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:54:52 user nova-compute[74850]:   <uuid>c5f97ca6-ee09-4180-9beb-da65c2aead9b</uuid>
Nov 14 00:54:52 user nova-compute[74850]:   <name>instance-0000001c</name>
Nov 14 00:54:52 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:54:52 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:54:52 user nova-compute[74850]:   <metadata>
Nov 14 00:54:52 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:54:52 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:54:52 user nova-compute[74850]:       <nova:name>tempest-TestStampPattern-server-752559758</nova:name>
Nov 14 00:54:52 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:54:52</nova:creationTime>
Nov 14 00:54:52 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:54:52 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:54:52 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:54:52 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:54:52 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:54:52 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:54:52 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:54:52 user nova-compute[74850]:       <nova:owner>
Nov 14 00:54:52 user nova-compute[74850]:         <nova:user uuid="208acda449ad436c85bdbebff0560e63">tempest-TestStampPattern-1231523385-project-member</nova:user>
Nov 14 00:54:52 user nova-compute[74850]:         <nova:project uuid="82e17bbd82f843fdaa3c48d8cb64a2c9">tempest-TestStampPattern-1231523385</nova:project>
Nov 14 00:54:52 user nova-compute[74850]:       </nova:owner>
Nov 14 00:54:52 user nova-compute[74850]:       <nova:root type="image" uuid="0db64770-aa6b-4c5d-97ef-85e5c6405aff"/>
Nov 14 00:54:52 user nova-compute[74850]:       <nova:ports>
Nov 14 00:54:52 user nova-compute[74850]:         <nova:port uuid="1f60b107-fed3-4884-be05-f9c39313b71d">
Nov 14 00:54:52 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 00:54:52 user nova-compute[74850]:         </nova:port>
Nov 14 00:54:52 user nova-compute[74850]:       </nova:ports>
Nov 14 00:54:52 user nova-compute[74850]:     </nova:instance>
Nov 14 00:54:52 user nova-compute[74850]:   </metadata>
Nov 14 00:54:52 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:54:52 user nova-compute[74850]:     <system>
Nov 14 00:54:52 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:54:52 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:54:52 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:54:52 user nova-compute[74850]:       <entry name="serial">c5f97ca6-ee09-4180-9beb-da65c2aead9b</entry>
Nov 14 00:54:52 user nova-compute[74850]:       <entry name="uuid">c5f97ca6-ee09-4180-9beb-da65c2aead9b</entry>
Nov 14 00:54:52 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:54:52 user nova-compute[74850]:     </system>
Nov 14 00:54:52 user nova-compute[74850]:   </sysinfo>
Nov 14 00:54:52 user nova-compute[74850]:   <os>
Nov 14 00:54:52 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:54:52 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 00:54:52 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:54:52 user nova-compute[74850]:   </os>
Nov 14 00:54:52 user nova-compute[74850]:   <features>
Nov 14 00:54:52 user nova-compute[74850]:     <acpi/>
Nov 14 00:54:52 user nova-compute[74850]:     <apic/>
Nov 14 00:54:52 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:54:52 user nova-compute[74850]:   </features>
Nov 14 00:54:52 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:54:52 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:54:52 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:54:52 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:54:52 user nova-compute[74850]:   </clock>
Nov 14 00:54:52 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:54:52 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:54:52 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:54:52 user nova-compute[74850]:   </cpu>
Nov 14 00:54:52 user nova-compute[74850]:   <devices>
Nov 14 00:54:52 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 00:54:52 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:54:52 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/c5f97ca6-ee09-4180-9beb-da65c2aead9b/disk"/>
Nov 14 00:54:52 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:54:52 user nova-compute[74850]:     </disk>
Nov 14 00:54:52 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:54:52 user nova-compute[74850]:       <mac address="fa:16:3e:27:57:ed"/>
Nov 14 00:54:52 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:54:52 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:54:52 user nova-compute[74850]:       <target dev="tap1f60b107-fe"/>
Nov 14 00:54:52 user nova-compute[74850]:     </interface>
Nov 14 00:54:52 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:54:52 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/c5f97ca6-ee09-4180-9beb-da65c2aead9b/console.log" append="off"/>
Nov 14 00:54:52 user nova-compute[74850]:     </serial>
Nov 14 00:54:52 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:54:52 user nova-compute[74850]:     <video>
Nov 14 00:54:52 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:54:52 user nova-compute[74850]:     </video>
Nov 14 00:54:52 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:54:52 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:54:52 user nova-compute[74850]:     </rng>
Nov 14 00:54:52 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:54:52 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:54:52 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:54:52 user nova-compute[74850]:     </memballoon>
Nov 14 00:54:52 user nova-compute[74850]:   </devices>
Nov 14 00:54:52 user nova-compute[74850]: </domain>
Nov 14 00:54:52 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:54:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-752559758',display_name='tempest-TestStampPattern-server-752559758',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-752559758',id=28,image_ref='0db64770-aa6b-4c5d-97ef-85e5c6405aff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrZlgeE9/Eb/dSvSLuh1rHNCQMOaoa95CjuZ377Ld81ZeZuC/2z69Zf0ms8CG6YuI4ZXEqqItRYp52TjDRYLlQoYwNXCNYDhSdvz3DpnModEihmBQQVehRcSLXR08S+jQ==',key_name='tempest-TestStampPattern-158458074',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82e17bbd82f843fdaa3c48d8cb64a2c9',ramdisk_id='',reservation_id='r-wjpey9fv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='4474ad0e-8eee-4db4-9896-50c049d45d26',image_min_disk='1',image_min_ram='0',image_owner_id='82e17bbd82f843fdaa3c48d8cb64a2c9',image_owner_project_name='tempest-TestStampPattern-1231523385',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1231523385-project-member',image_user_id='208acda449ad436c85bdbebff0560e63',network_allocated='True',owner_project_name='tempest-TestStampPattern-1231523385',owner_user_name='tempest-TestStampPattern-1231523385-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:54:50Z,user_data=None,user_id='208acda449ad436c85bdbebff0560e63',uuid=c5f97ca6-ee09-4180-9beb-da65c2aead9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f60b107-fed3-4884-be05-f9c39313b71d", "address": "fa:16:3e:27:57:ed", "network": {"id": "b096d728-1246-4eaa-9222-ed8eee74870c", "bridge": "br-int", "label": "tempest-TestStampPattern-1207618832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e17bbd82f843fdaa3c48d8cb64a2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f60b107-fe", "ovs_interfaceid": "1f60b107-fed3-4884-be05-f9c39313b71d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Converting VIF {"id": "1f60b107-fed3-4884-be05-f9c39313b71d", "address": "fa:16:3e:27:57:ed", "network": {"id": "b096d728-1246-4eaa-9222-ed8eee74870c", "bridge": "br-int", "label": "tempest-TestStampPattern-1207618832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e17bbd82f843fdaa3c48d8cb64a2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f60b107-fe", "ovs_interfaceid": "1f60b107-fed3-4884-be05-f9c39313b71d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:57:ed,bridge_name='br-int',has_traffic_filtering=True,id=1f60b107-fed3-4884-be05-f9c39313b71d,network=Network(b096d728-1246-4eaa-9222-ed8eee74870c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f60b107-fe') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG os_vif [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:57:ed,bridge_name='br-int',has_traffic_filtering=True,id=1f60b107-fed3-4884-be05-f9c39313b71d,network=Network(b096d728-1246-4eaa-9222-ed8eee74870c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f60b107-fe') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8c4dcede-e863-575e-a791-65849fbf5602', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f60b107-fe, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f60b107-fe, col_values=(('qos', UUID('ba5c5b1a-0d7d-4bc0-aa45-c7ea1c9f93d0')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f60b107-fe, col_values=(('external_ids', {'iface-id': '1f60b107-fed3-4884-be05-f9c39313b71d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:57:ed', 'vm-uuid': 'c5f97ca6-ee09-4180-9beb-da65c2aead9b'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:52 user nova-compute[74850]: INFO os_vif [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:57:ed,bridge_name='br-int',has_traffic_filtering=True,id=1f60b107-fed3-4884-be05-f9c39313b71d,network=Network(b096d728-1246-4eaa-9222-ed8eee74870c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f60b107-fe')
Nov 14 00:54:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:54:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] No VIF found with MAC fa:16:3e:27:57:ed, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:54:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:54:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:54 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:54 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:54 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:54 user nova-compute[74850]: DEBUG nova.compute.manager [req-b54b5500-973a-47c1-91a9-1a904f56e14c req-278fc198-2e19-461c-80c9-731794901378 service nova] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Received event network-vif-plugged-1f60b107-fed3-4884-be05-f9c39313b71d {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:54:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b54b5500-973a-47c1-91a9-1a904f56e14c req-278fc198-2e19-461c-80c9-731794901378 service nova] Acquiring lock "c5f97ca6-ee09-4180-9beb-da65c2aead9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:54:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b54b5500-973a-47c1-91a9-1a904f56e14c req-278fc198-2e19-461c-80c9-731794901378 service nova] Lock "c5f97ca6-ee09-4180-9beb-da65c2aead9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:54:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b54b5500-973a-47c1-91a9-1a904f56e14c req-278fc198-2e19-461c-80c9-731794901378 service nova] Lock "c5f97ca6-ee09-4180-9beb-da65c2aead9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:54:54 user nova-compute[74850]: DEBUG nova.compute.manager [req-b54b5500-973a-47c1-91a9-1a904f56e14c req-278fc198-2e19-461c-80c9-731794901378 service nova] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] No waiting events found dispatching network-vif-plugged-1f60b107-fed3-4884-be05-f9c39313b71d {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:54:54 user nova-compute[74850]: WARNING nova.compute.manager [req-b54b5500-973a-47c1-91a9-1a904f56e14c req-278fc198-2e19-461c-80c9-731794901378 service nova] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Received unexpected event network-vif-plugged-1f60b107-fed3-4884-be05-f9c39313b71d for instance with vm_state building and task_state spawning.
Nov 14 00:54:54 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:54 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:54:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:55 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:55 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:55 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:54:55 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:55 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:55 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:55 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:55 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:55 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:55 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:54:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:54:56 user nova-compute[74850]: DEBUG nova.compute.manager [req-35532b1f-0798-4bed-a21b-0248c88a8952 req-e208d92b-2b7e-407d-9d6e-1e89569f9573 service nova] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Received event network-vif-plugged-1f60b107-fed3-4884-be05-f9c39313b71d {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:54:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-35532b1f-0798-4bed-a21b-0248c88a8952 req-e208d92b-2b7e-407d-9d6e-1e89569f9573 service nova] Acquiring lock "c5f97ca6-ee09-4180-9beb-da65c2aead9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:54:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-35532b1f-0798-4bed-a21b-0248c88a8952 req-e208d92b-2b7e-407d-9d6e-1e89569f9573 service nova] Lock "c5f97ca6-ee09-4180-9beb-da65c2aead9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:54:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-35532b1f-0798-4bed-a21b-0248c88a8952 req-e208d92b-2b7e-407d-9d6e-1e89569f9573 service nova] Lock "c5f97ca6-ee09-4180-9beb-da65c2aead9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:54:56 user nova-compute[74850]: DEBUG nova.compute.manager [req-35532b1f-0798-4bed-a21b-0248c88a8952 req-e208d92b-2b7e-407d-9d6e-1e89569f9573 service nova] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] No waiting events found dispatching network-vif-plugged-1f60b107-fed3-4884-be05-f9c39313b71d {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:54:56 user nova-compute[74850]: WARNING nova.compute.manager [req-35532b1f-0798-4bed-a21b-0248c88a8952 req-e208d92b-2b7e-407d-9d6e-1e89569f9573 service nova] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Received unexpected event network-vif-plugged-1f60b107-fed3-4884-be05-f9c39313b71d for instance with vm_state building and task_state spawning.
Nov 14 00:54:56 user nova-compute[74850]: DEBUG nova.compute.manager [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:54:56 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 00:54:56 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:54:56 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:54:56 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=7405MB free_disk=24.98453140258789GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 00:54:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:54:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:54:56 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Instance spawned successfully.
Nov 14 00:54:56 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 00:54:56 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:54:56 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:54:56 user nova-compute[74850]: INFO nova.compute.manager [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Took 7.34 seconds to spawn the instance on the hypervisor.
Nov 14 00:54:56 user nova-compute[74850]: DEBUG nova.compute.manager [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:54:57 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance a70d0196-f90e-47c4-be67-bf7ef4c3d8c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:54:57 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 1879be4c-9226-4c8c-a56c-f8e37398851b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:54:57 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 4b60ac08-e954-46d5-a280-a11146b3ebf4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:54:57 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance a62a2eab-2502-4275-948b-3f18c3fcff36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:54:57 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 748d0da7-bbb9-4e86-aae3-e48b1fa04c14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:54:57 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 4474ad0e-8eee-4db4-9896-50c049d45d26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:54:57 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 57f1e010-68bf-4047-9316-0412a2c89be2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:54:57 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 4f1102c5-f5ef-48d5-b271-6e25bee5cc70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:54:57 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 211c1477-8a76-4ecd-a7c8-dc0b5903d38c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:54:57 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance c7952bff-87d6-46c1-a6d4-7729dc4893ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:54:57 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:54:57 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 1f3a0b8f-1591-49c8-afb1-88437d65fb75 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:54:57 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance c5f97ca6-ee09-4180-9beb-da65c2aead9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:54:57 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 00:54:57 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 00:54:57 user nova-compute[74850]: INFO nova.compute.manager [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Took 8.46 seconds to build instance.
Nov 14 00:54:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e77987bb-63d3-423a-9b55-ff13c157e0e6 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "c5f97ca6-ee09-4180-9beb-da65c2aead9b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.557s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:54:57 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:54:57 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:54:57 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 00:54:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.584s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:54:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:54:58 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:54:58 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:54:58 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:54:58 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 00:54:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "refresh_cache-a62a2eab-2502-4275-948b-3f18c3fcff36" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:54:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquired lock "refresh_cache-a62a2eab-2502-4275-948b-3f18c3fcff36" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:54:58 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Forcefully refreshing network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 00:54:58 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Updating instance_info_cache with network_info: [{"id": "12f841ee-4cd7-42bc-b5c7-4881419e2e26", "address": "fa:16:3e:14:c5:ac", "network": {"id": "70b59622-f2a8-4dfc-9f03-828f4824be1e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1478695014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf004672a7b54f718937d1a0db6cec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12f841ee-4c", "ovs_interfaceid": "12f841ee-4cd7-42bc-b5c7-4881419e2e26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:54:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Releasing lock "refresh_cache-a62a2eab-2502-4275-948b-3f18c3fcff36" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:54:58 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Updated the network info_cache for instance {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 00:54:58 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:54:58 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:54:58 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:54:58 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 00:55:00 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-964a4d45-1387-4fa7-bf2c-2d440d27d220 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 57f1e010-68bf-4047-9316-0412a2c89be2 is timed out.
Nov 14 00:55:00 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-964a4d45-1387-4fa7-bf2c-2d440d27d220 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Successfully detached device vdb from instance 57f1e010-68bf-4047-9316-0412a2c89be2 from the live domain config.
Nov 14 00:55:00 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-964a4d45-1387-4fa7-bf2c-2d440d27d220 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-964a4d45-1387-4fa7-bf2c-2d440d27d220 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jrOsYfdI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:55:00 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-964a4d45-1387-4fa7-bf2c-2d440d27d220 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:55:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-964a4d45-1387-4fa7-bf2c-2d440d27d220 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-964a4d45-1387-4fa7-bf2c-2d440d27d220 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.014s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7af3932-9ca7-4d28-80c8-dbda232fcec0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-964a4d45-1387-4fa7-bf2c-2d440d27d220 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 00:55:00 user nova-compute[74850]: No targets found.
Nov 14 00:55:00 user nova-compute[74850]: iSNS:
Nov 14 00:55:00 user nova-compute[74850]: No targets found.
Nov 14 00:55:00 user nova-compute[74850]: STATIC:
Nov 14 00:55:00 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2
Nov 14 00:55:00 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:55:00 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:55:00 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf
Nov 14 00:55:00 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:55:00 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:55:00 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390
Nov 14 00:55:00 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:55:00 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:55:00 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714
Nov 14 00:55:00 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:55:00 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:55:00 user nova-compute[74850]: FIRMWARE:
Nov 14 00:55:00 user nova-compute[74850]: No targets found.
Nov 14 00:55:00 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-964a4d45-1387-4fa7-bf2c-2d440d27d220 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 00:55:00 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 00:55:00 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-964a4d45-1387-4fa7-bf2c-2d440d27d220 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4c8659-06ac-444e-8de2-53a2f01560c5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c12c40-c1e4-4c98-95fc-a3938d8844d9]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-964a4d45-1387-4fa7-bf2c-2d440d27d220 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:55:00 user nova-compute[74850]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:55:00 user nova-compute[74850]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2 (non-flash)
Nov 14 00:55:00 user nova-compute[74850]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:55:00 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-964a4d45-1387-4fa7-bf2c-2d440d27d220 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:55:00 user nova-compute[74850]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:55:00 user nova-compute[74850]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2 (non-flash)
Nov 14 00:55:00 user nova-compute[74850]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:55:00 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-964a4d45-1387-4fa7-bf2c-2d440d27d220 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a1c7f0940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2'): ({'sde'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-964a4d45-1387-4fa7-bf2c-2d440d27d220 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Removing single pathed devices sde {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1950db67-47b9-4440-b774-77c9013f186c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a20917-9518-456e-a055-4f9a31e104b5]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-964a4d45-1387-4fa7-bf2c-2d440d27d220 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Flushing IO for device /dev/sde {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[722ccc85-e391-423b-80fb-8243db5124f3]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-964a4d45-1387-4fa7-bf2c-2d440d27d220 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1b71f3-91cd-41c9-a33b-aaca00452266]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-964a4d45-1387-4fa7-bf2c-2d440d27d220 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-964a4d45-1387-4fa7-bf2c-2d440d27d220 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] SCSI volumes sde have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-964a4d45-1387-4fa7-bf2c-2d440d27d220 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d026255d-ec5e-4800-b89a-8a02d14983cc]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-964a4d45-1387-4fa7-bf2c-2d440d27d220 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2 -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66ef93a-70dc-43fb-930f-2a43c8e39ab3]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-964a4d45-1387-4fa7-bf2c-2d440d27d220 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2, portal: 172.16.0.220,3260]
Nov 14 00:55:00 user nova-compute[74850]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2, portal: 172.16.0.220,3260] successful.
Nov 14 00:55:00 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2 -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3985a0d-eefa-4754-9d40-c2de91bacfc2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f411c972-7fdc-4a81-9ab0-b51b28dce7c7]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-964a4d45-1387-4fa7-bf2c-2d440d27d220 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-964a4d45-1387-4fa7-bf2c-2d440d27d220 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-964a4d45-1387-4fa7-bf2c-2d440d27d220 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] <== disconnect_volume: return (333ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:55:00 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-964a4d45-1387-4fa7-bf2c-2d440d27d220 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 00:55:01 user nova-compute[74850]: DEBUG nova.objects.instance [None req-964a4d45-1387-4fa7-bf2c-2d440d27d220 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Lazy-loading 'flavor' on Instance uuid 57f1e010-68bf-4047-9316-0412a2c89be2 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:55:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-964a4d45-1387-4fa7-bf2c-2d440d27d220 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Lock "57f1e010-68bf-4047-9316-0412a2c89be2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.826s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:55:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:07 user nova-compute[74850]: DEBUG nova.compute.manager [req-7bac3ae1-a8c4-45d1-9e23-9897c0875bb4 req-0e07fdfe-fb00-4bb3-88b5-a31373bd1750 service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Received event network-changed-5a111053-6390-4a23-97c2-9171e744c3c7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:55:07 user nova-compute[74850]: DEBUG nova.compute.manager [req-7bac3ae1-a8c4-45d1-9e23-9897c0875bb4 req-0e07fdfe-fb00-4bb3-88b5-a31373bd1750 service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Refreshing instance network info cache due to event network-changed-5a111053-6390-4a23-97c2-9171e744c3c7. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:55:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7bac3ae1-a8c4-45d1-9e23-9897c0875bb4 req-0e07fdfe-fb00-4bb3-88b5-a31373bd1750 service nova] Acquiring lock "refresh_cache-211c1477-8a76-4ecd-a7c8-dc0b5903d38c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:55:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7bac3ae1-a8c4-45d1-9e23-9897c0875bb4 req-0e07fdfe-fb00-4bb3-88b5-a31373bd1750 service nova] Acquired lock "refresh_cache-211c1477-8a76-4ecd-a7c8-dc0b5903d38c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:55:07 user nova-compute[74850]: DEBUG nova.network.neutron [req-7bac3ae1-a8c4-45d1-9e23-9897c0875bb4 req-0e07fdfe-fb00-4bb3-88b5-a31373bd1750 service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Refreshing network info cache for port 5a111053-6390-4a23-97c2-9171e744c3c7 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:55:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:55:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:55:07 user nova-compute[74850]: DEBUG nova.objects.instance [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lazy-loading 'flavor' on Instance uuid 211c1477-8a76-4ecd-a7c8-dc0b5903d38c {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:55:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:55:07 user nova-compute[74850]: DEBUG nova.network.neutron [req-7bac3ae1-a8c4-45d1-9e23-9897c0875bb4 req-0e07fdfe-fb00-4bb3-88b5-a31373bd1750 service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Updated VIF entry in instance network info cache for port 5a111053-6390-4a23-97c2-9171e744c3c7. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:55:07 user nova-compute[74850]: DEBUG nova.network.neutron [req-7bac3ae1-a8c4-45d1-9e23-9897c0875bb4 req-0e07fdfe-fb00-4bb3-88b5-a31373bd1750 service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Updating instance_info_cache with network_info: [{"id": "5a111053-6390-4a23-97c2-9171e744c3c7", "address": "fa:16:3e:52:fd:39", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a111053-63", "ovs_interfaceid": "5a111053-6390-4a23-97c2-9171e744c3c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:55:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:55:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:55:07 user nova-compute[74850]: INFO nova.compute.manager [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Attaching volume e5967bf1-73b3-46b7-ab8b-f48f9198036a to /dev/vdb
Nov 14 00:55:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7bac3ae1-a8c4-45d1-9e23-9897c0875bb4 req-0e07fdfe-fb00-4bb3-88b5-a31373bd1750 service nova] Releasing lock "refresh_cache-211c1477-8a76-4ecd-a7c8-dc0b5903d38c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:55:08 user nova-compute[74850]: DEBUG os_brick.utils [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:55:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5fb96b-14de-41e9-b984-bc58b0e661b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[686a474d-b146-49eb-b6d5-1b9a562990b1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[460d9ef7-6321-4dd7-a8c1-868f590598cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6bd0e2-8ceb-4d1c-b92b-a6c057deb4d5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:55:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 00:55:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:55:08 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 00:55:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a713728e-cc98-47ef-ad01-abd3bf2d3241]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 00:55:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 00:55:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 00:55:08 user nova-compute[74850]: DEBUG os_brick.utils [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:55:08 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Updating existing volume attachment record: 4f7d8577-da5c-4c0e-9006-c48d02ab5064 {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 00:55:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jAZHPWDS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:55:12 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:55:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:55:12 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:55:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:55:12 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 00:55:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefc246e-9c58-462c-a8f5-85c37a31218c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 00:55:12 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e8d353-aab0-4f01-a6b3-77ca1f11d26f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a] added
Nov 14 00:55:12 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cead5f7-5799-4610-9275-172f0f757ad8]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f739e4-34c8-4ef6-ab0a-7bd9cd339947]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jAZHPWDS {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jAZHPWDS" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc87317-b3f2-4b2b-a328-069535416c75]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jAZHPWDS'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.135s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca68bd02-64c3-4d09-86e1-52126a469fa7]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36be1bd-9224-4cd7-ab29-6dd254507f88]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:55:12 user nova-compute[74850]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:55:12 user nova-compute[74850]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:55:12 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:55:12 user nova-compute[74850]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:55:12 user nova-compute[74850]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:55:12 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b509c3e-ceab-456c-b39c-642135058f79]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a, portal: 172.16.0.220,3260]
Nov 14 00:55:12 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a, portal: 172.16.0.220,3260] successful.
Nov 14 00:55:12 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdfa228-b694-48c2-aae3-2ed9ecd275ea]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47aa441-9b9f-4c60-9847-6b55b388a397]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:55:12 user nova-compute[74850]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:55:12 user nova-compute[74850]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:55:12 user nova-compute[74850]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:55:12 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:55:12 user nova-compute[74850]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:55:12 user nova-compute[74850]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:55:12 user nova-compute[74850]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:55:12 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] HCTL ('36', '-', '-', 0) found on session 28 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[99407db7-fd6f-459a-95a3-f09cc354bca8]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: None {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:55:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:13 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:55:13 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jAZHPWDS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 00:55:13 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:55:13 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '23438323361653232', 'path': '/dev/sde'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:55:13 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438323361653232', 'path': '/dev/sde'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 00:55:13 user nova-compute[74850]: DEBUG nova.objects.instance [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lazy-loading 'flavor' on Instance uuid 211c1477-8a76-4ecd-a7c8-dc0b5903d38c {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:55:13 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 00:55:13 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:55:13 user nova-compute[74850]:   <source dev="/dev/sde"/>
Nov 14 00:55:13 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:55:13 user nova-compute[74850]:   <serial>e5967bf1-73b3-46b7-ab8b-f48f9198036a</serial>
Nov 14 00:55:13 user nova-compute[74850]: </disk>
Nov 14 00:55:13 user nova-compute[74850]:  {{(pid=74850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 00:55:14 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:55:14 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:55:14 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] No VIF found with MAC fa:16:3e:52:fd:39, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:55:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-8a5ae762-dab3-4a66-9ba7-83e41f91c03d tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.486s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:55:15 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:15 user nova-compute[74850]: INFO nova.compute.manager [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Rescuing
Nov 14 00:55:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "refresh_cache-211c1477-8a76-4ecd-a7c8-dc0b5903d38c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:55:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquired lock "refresh_cache-211c1477-8a76-4ecd-a7c8-dc0b5903d38c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:55:15 user nova-compute[74850]: DEBUG nova.network.neutron [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:55:15 user nova-compute[74850]: DEBUG nova.network.neutron [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Updating instance_info_cache with network_info: [{"id": "5a111053-6390-4a23-97c2-9171e744c3c7", "address": "fa:16:3e:52:fd:39", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a111053-63", "ovs_interfaceid": "5a111053-6390-4a23-97c2-9171e744c3c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:55:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Releasing lock "refresh_cache-211c1477-8a76-4ecd-a7c8-dc0b5903d38c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:55:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:16 user nova-compute[74850]: DEBUG nova.compute.manager [req-cb2143c2-bb98-4bbb-8467-e3dddba8997a req-fda7b3c4-5e59-495e-9bba-a61fb7f1cdd0 service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Received event network-vif-unplugged-5a111053-6390-4a23-97c2-9171e744c3c7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:55:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-cb2143c2-bb98-4bbb-8467-e3dddba8997a req-fda7b3c4-5e59-495e-9bba-a61fb7f1cdd0 service nova] Acquiring lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:55:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-cb2143c2-bb98-4bbb-8467-e3dddba8997a req-fda7b3c4-5e59-495e-9bba-a61fb7f1cdd0 service nova] Lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:55:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-cb2143c2-bb98-4bbb-8467-e3dddba8997a req-fda7b3c4-5e59-495e-9bba-a61fb7f1cdd0 service nova] Lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:55:16 user nova-compute[74850]: DEBUG nova.compute.manager [req-cb2143c2-bb98-4bbb-8467-e3dddba8997a req-fda7b3c4-5e59-495e-9bba-a61fb7f1cdd0 service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] No waiting events found dispatching network-vif-unplugged-5a111053-6390-4a23-97c2-9171e744c3c7 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:55:16 user nova-compute[74850]: WARNING nova.compute.manager [req-cb2143c2-bb98-4bbb-8467-e3dddba8997a req-fda7b3c4-5e59-495e-9bba-a61fb7f1cdd0 service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Received unexpected event network-vif-unplugged-5a111053-6390-4a23-97c2-9171e744c3c7 for instance with vm_state active and task_state rescuing.
Nov 14 00:55:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:16 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Instance destroyed successfully.
Nov 14 00:55:16 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Attempting rescue
Nov 14 00:55:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74850) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 00:55:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Instance directory exists: not creating {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 00:55:16 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Creating image(s)
Nov 14 00:55:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "/opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:55:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "/opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:55:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "/opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:55:16 user nova-compute[74850]: DEBUG nova.objects.instance [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lazy-loading 'trusted_certs' on Instance uuid 211c1477-8a76-4ecd-a7c8-dc0b5903d38c {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:55:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:55:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:55:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.166s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk.rescue {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk.rescue" returned: 0 in 0.045s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG nova.objects.instance [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lazy-loading 'migration_context' on Instance uuid 211c1477-8a76-4ecd-a7c8-dc0b5903d38c {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG nova.objects.base [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Object Instance<211c1477-8a76-4ecd-a7c8-dc0b5903d38c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Start _get_guest_xml network_info=[{"id": "5a111053-6390-4a23-97c2-9171e744c3c7", "address": "fa:16:3e:52:fd:39", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "vif_mac": "fa:16:3e:52:fd:39"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a111053-63", "ovs_interfaceid": "5a111053-6390-4a23-97c2-9171e744c3c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG nova.objects.instance [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lazy-loading 'resources' on Instance uuid 211c1477-8a76-4ecd-a7c8-dc0b5903d38c {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG nova.objects.base [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Object Instance<211c1477-8a76-4ecd-a7c8-dc0b5903d38c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG nova.objects.instance [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lazy-loading 'numa_topology' on Instance uuid 211c1477-8a76-4ecd-a7c8-dc0b5903d38c {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG nova.objects.base [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Object Instance<211c1477-8a76-4ecd-a7c8-dc0b5903d38c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 00:55:17 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:55:17 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:55:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG nova.objects.instance [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lazy-loading 'vcpu_model' on Instance uuid 211c1477-8a76-4ecd-a7c8-dc0b5903d38c {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG nova.objects.base [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Object Instance<211c1477-8a76-4ecd-a7c8-dc0b5903d38c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1861720430',display_name='tempest-ServerRescueNegativeTestJSON-server-1861720430',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1861720430',id=25,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1R4v8zKtyosS53OifNAB7kqp6eZmbuqDbYYyccqJkmGYh7Qj/Z0gVko0VLZsVSZ9mFQ9vPph+SAXAMe6TVaSwOY0UjEI/J86dVqOxg1LLdfUZg+8Hx9p8XFQmsZUZe9w==',key_name='tempest-keypair-344758225',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:53:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e933e8bc63bd442d882ff59243bd7faa',ramdisk_id='',reservation_id='r-tu15g70v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-103787426',owner_user_name='tempest-ServerRescueNegativeTestJSON-103787426-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:53:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84158c07e3344e01bf82e0e25e2a7244',uuid=211c1477-8a76-4ecd-a7c8-dc0b5903d38c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a111053-6390-4a23-97c2-9171e744c3c7", "address": "fa:16:3e:52:fd:39", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "vif_mac": "fa:16:3e:52:fd:39"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a111053-63", "ovs_interfaceid": "5a111053-6390-4a23-97c2-9171e744c3c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Converting VIF {"id": "5a111053-6390-4a23-97c2-9171e744c3c7", "address": "fa:16:3e:52:fd:39", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "vif_mac": "fa:16:3e:52:fd:39"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a111053-63", "ovs_interfaceid": "5a111053-6390-4a23-97c2-9171e744c3c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:fd:39,bridge_name='br-int',has_traffic_filtering=True,id=5a111053-6390-4a23-97c2-9171e744c3c7,network=Network(4bb9b9bb-4485-4fed-bf0e-f549b29f09da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a111053-63') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG nova.objects.instance [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lazy-loading 'pci_devices' on Instance uuid 211c1477-8a76-4ecd-a7c8-dc0b5903d38c {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG nova.objects.base [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Object Instance<211c1477-8a76-4ecd-a7c8-dc0b5903d38c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:55:17 user nova-compute[74850]:   <uuid>211c1477-8a76-4ecd-a7c8-dc0b5903d38c</uuid>
Nov 14 00:55:17 user nova-compute[74850]:   <name>instance-00000019</name>
Nov 14 00:55:17 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:55:17 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:55:17 user nova-compute[74850]:   <metadata>
Nov 14 00:55:17 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:55:17 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:55:17 user nova-compute[74850]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1861720430</nova:name>
Nov 14 00:55:17 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:55:17</nova:creationTime>
Nov 14 00:55:17 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:55:17 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:55:17 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:55:17 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:55:17 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:55:17 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:55:17 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:55:17 user nova-compute[74850]:       <nova:owner>
Nov 14 00:55:17 user nova-compute[74850]:         <nova:user uuid="84158c07e3344e01bf82e0e25e2a7244">tempest-ServerRescueNegativeTestJSON-103787426-project-member</nova:user>
Nov 14 00:55:17 user nova-compute[74850]:         <nova:project uuid="e933e8bc63bd442d882ff59243bd7faa">tempest-ServerRescueNegativeTestJSON-103787426</nova:project>
Nov 14 00:55:17 user nova-compute[74850]:       </nova:owner>
Nov 14 00:55:17 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:55:17 user nova-compute[74850]:       <nova:ports>
Nov 14 00:55:17 user nova-compute[74850]:         <nova:port uuid="5a111053-6390-4a23-97c2-9171e744c3c7">
Nov 14 00:55:17 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 00:55:17 user nova-compute[74850]:         </nova:port>
Nov 14 00:55:17 user nova-compute[74850]:       </nova:ports>
Nov 14 00:55:17 user nova-compute[74850]:     </nova:instance>
Nov 14 00:55:17 user nova-compute[74850]:   </metadata>
Nov 14 00:55:17 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:55:17 user nova-compute[74850]:     <system>
Nov 14 00:55:17 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:55:17 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:55:17 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:55:17 user nova-compute[74850]:       <entry name="serial">211c1477-8a76-4ecd-a7c8-dc0b5903d38c</entry>
Nov 14 00:55:17 user nova-compute[74850]:       <entry name="uuid">211c1477-8a76-4ecd-a7c8-dc0b5903d38c</entry>
Nov 14 00:55:17 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:55:17 user nova-compute[74850]:     </system>
Nov 14 00:55:17 user nova-compute[74850]:   </sysinfo>
Nov 14 00:55:17 user nova-compute[74850]:   <os>
Nov 14 00:55:17 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:55:17 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:55:17 user nova-compute[74850]:   </os>
Nov 14 00:55:17 user nova-compute[74850]:   <features>
Nov 14 00:55:17 user nova-compute[74850]:     <acpi/>
Nov 14 00:55:17 user nova-compute[74850]:     <apic/>
Nov 14 00:55:17 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:55:17 user nova-compute[74850]:   </features>
Nov 14 00:55:17 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:55:17 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:55:17 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:55:17 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:55:17 user nova-compute[74850]:   </clock>
Nov 14 00:55:17 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:55:17 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:55:17 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:55:17 user nova-compute[74850]:   </cpu>
Nov 14 00:55:17 user nova-compute[74850]:   <devices>
Nov 14 00:55:17 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 00:55:17 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:55:17 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk.rescue"/>
Nov 14 00:55:17 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:55:17 user nova-compute[74850]:     </disk>
Nov 14 00:55:17 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 00:55:17 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:55:17 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk"/>
Nov 14 00:55:17 user nova-compute[74850]:       <target dev="vdb" bus="virtio"/>
Nov 14 00:55:17 user nova-compute[74850]:     </disk>
Nov 14 00:55:17 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:55:17 user nova-compute[74850]:       <mac address="fa:16:3e:52:fd:39"/>
Nov 14 00:55:17 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:55:17 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:55:17 user nova-compute[74850]:       <target dev="tap5a111053-63"/>
Nov 14 00:55:17 user nova-compute[74850]:     </interface>
Nov 14 00:55:17 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:55:17 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/console.log" append="off"/>
Nov 14 00:55:17 user nova-compute[74850]:     </serial>
Nov 14 00:55:17 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:55:17 user nova-compute[74850]:     <video>
Nov 14 00:55:17 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:55:17 user nova-compute[74850]:     </video>
Nov 14 00:55:17 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:55:17 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:55:17 user nova-compute[74850]:     </rng>
Nov 14 00:55:17 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:55:17 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:55:17 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:55:17 user nova-compute[74850]:     </memballoon>
Nov 14 00:55:17 user nova-compute[74850]:   </devices>
Nov 14 00:55:17 user nova-compute[74850]: </domain>
Nov 14 00:55:17 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:55:17 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Instance destroyed successfully.
Nov 14 00:55:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] No VIF found with MAC fa:16:3e:52:fd:39, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-d182503a-5ffe-45a4-b92a-af1830f21a32 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Acquiring lock "4b60ac08-e954-46d5-a280-a11146b3ebf4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-d182503a-5ffe-45a4-b92a-af1830f21a32 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lock "4b60ac08-e954-46d5-a280-a11146b3ebf4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:55:17 user nova-compute[74850]: INFO nova.compute.manager [None req-d182503a-5ffe-45a4-b92a-af1830f21a32 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Detaching volume 44fa6c77-8978-4921-b98e-3c21c1e75714
Nov 14 00:55:17 user nova-compute[74850]: INFO nova.virt.block_device [None req-d182503a-5ffe-45a4-b92a-af1830f21a32 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Attempting to driver detach volume 44fa6c77-8978-4921-b98e-3c21c1e75714 from mountpoint /dev/vdb
Nov 14 00:55:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-d182503a-5ffe-45a4-b92a-af1830f21a32 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Attempting to detach device vdb from instance 4b60ac08-e954-46d5-a280-a11146b3ebf4 from the persistent domain config. {{(pid=74850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-d182503a-5ffe-45a4-b92a-af1830f21a32 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 00:55:17 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:55:17 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 00:55:17 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:55:17 user nova-compute[74850]:   <serial>44fa6c77-8978-4921-b98e-3c21c1e75714</serial>
Nov 14 00:55:17 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 00:55:17 user nova-compute[74850]: </disk>
Nov 14 00:55:17 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 00:55:17 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-d182503a-5ffe-45a4-b92a-af1830f21a32 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Successfully detached device vdb from instance 4b60ac08-e954-46d5-a280-a11146b3ebf4 from the persistent domain config.
Nov 14 00:55:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-d182503a-5ffe-45a4-b92a-af1830f21a32 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4b60ac08-e954-46d5-a280-a11146b3ebf4 from the live domain config. {{(pid=74850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-d182503a-5ffe-45a4-b92a-af1830f21a32 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 00:55:17 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:55:17 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 00:55:17 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:55:17 user nova-compute[74850]:   <serial>44fa6c77-8978-4921-b98e-3c21c1e75714</serial>
Nov 14 00:55:17 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 00:55:17 user nova-compute[74850]: </disk>
Nov 14 00:55:17 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 00:55:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:18 user nova-compute[74850]: DEBUG nova.compute.manager [req-b96d390b-8efe-49ee-b0ce-54c738bb12d8 req-87768a29-e120-441d-85e7-aac5b968a3db service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Received event network-vif-plugged-5a111053-6390-4a23-97c2-9171e744c3c7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:55:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b96d390b-8efe-49ee-b0ce-54c738bb12d8 req-87768a29-e120-441d-85e7-aac5b968a3db service nova] Acquiring lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:55:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b96d390b-8efe-49ee-b0ce-54c738bb12d8 req-87768a29-e120-441d-85e7-aac5b968a3db service nova] Lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:55:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b96d390b-8efe-49ee-b0ce-54c738bb12d8 req-87768a29-e120-441d-85e7-aac5b968a3db service nova] Lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:55:18 user nova-compute[74850]: DEBUG nova.compute.manager [req-b96d390b-8efe-49ee-b0ce-54c738bb12d8 req-87768a29-e120-441d-85e7-aac5b968a3db service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] No waiting events found dispatching network-vif-plugged-5a111053-6390-4a23-97c2-9171e744c3c7 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:55:18 user nova-compute[74850]: WARNING nova.compute.manager [req-b96d390b-8efe-49ee-b0ce-54c738bb12d8 req-87768a29-e120-441d-85e7-aac5b968a3db service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Received unexpected event network-vif-plugged-5a111053-6390-4a23-97c2-9171e744c3c7 for instance with vm_state active and task_state rescuing.
Nov 14 00:55:18 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-d182503a-5ffe-45a4-b92a-af1830f21a32 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4b60ac08-e954-46d5-a280-a11146b3ebf4 {{(pid=74850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 00:55:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:20 user nova-compute[74850]: DEBUG nova.compute.manager [req-3c5ef82a-84e5-426b-bf68-703deca37509 req-78eb6a73-b613-4644-8340-34382077d093 service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Received event network-vif-plugged-5a111053-6390-4a23-97c2-9171e744c3c7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:55:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3c5ef82a-84e5-426b-bf68-703deca37509 req-78eb6a73-b613-4644-8340-34382077d093 service nova] Acquiring lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:55:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3c5ef82a-84e5-426b-bf68-703deca37509 req-78eb6a73-b613-4644-8340-34382077d093 service nova] Lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:55:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3c5ef82a-84e5-426b-bf68-703deca37509 req-78eb6a73-b613-4644-8340-34382077d093 service nova] Lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:55:20 user nova-compute[74850]: DEBUG nova.compute.manager [req-3c5ef82a-84e5-426b-bf68-703deca37509 req-78eb6a73-b613-4644-8340-34382077d093 service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] No waiting events found dispatching network-vif-plugged-5a111053-6390-4a23-97c2-9171e744c3c7 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:55:20 user nova-compute[74850]: WARNING nova.compute.manager [req-3c5ef82a-84e5-426b-bf68-703deca37509 req-78eb6a73-b613-4644-8340-34382077d093 service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Received unexpected event network-vif-plugged-5a111053-6390-4a23-97c2-9171e744c3c7 for instance with vm_state active and task_state rescuing.
Nov 14 00:55:20 user nova-compute[74850]: DEBUG nova.compute.manager [req-3c5ef82a-84e5-426b-bf68-703deca37509 req-78eb6a73-b613-4644-8340-34382077d093 service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Received event network-vif-plugged-5a111053-6390-4a23-97c2-9171e744c3c7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:55:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3c5ef82a-84e5-426b-bf68-703deca37509 req-78eb6a73-b613-4644-8340-34382077d093 service nova] Acquiring lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:55:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3c5ef82a-84e5-426b-bf68-703deca37509 req-78eb6a73-b613-4644-8340-34382077d093 service nova] Lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:55:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3c5ef82a-84e5-426b-bf68-703deca37509 req-78eb6a73-b613-4644-8340-34382077d093 service nova] Lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:55:20 user nova-compute[74850]: DEBUG nova.compute.manager [req-3c5ef82a-84e5-426b-bf68-703deca37509 req-78eb6a73-b613-4644-8340-34382077d093 service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] No waiting events found dispatching network-vif-plugged-5a111053-6390-4a23-97c2-9171e744c3c7 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:55:20 user nova-compute[74850]: WARNING nova.compute.manager [req-3c5ef82a-84e5-426b-bf68-703deca37509 req-78eb6a73-b613-4644-8340-34382077d093 service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Received unexpected event network-vif-plugged-5a111053-6390-4a23-97c2-9171e744c3c7 for instance with vm_state active and task_state rescuing.
Nov 14 00:55:21 user nova-compute[74850]: DEBUG nova.compute.manager [None req-59b90c81-1956-40a5-8b82-57c23c5884e0 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:55:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:24 user nova-compute[74850]: DEBUG nova.compute.manager [None req-17005759-fc5c-4c5c-b87c-f730859d09eb tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:55:24 user nova-compute[74850]: INFO nova.compute.manager [None req-17005759-fc5c-4c5c-b87c-f730859d09eb tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] instance snapshotting
Nov 14 00:55:24 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-17005759-fc5c-4c5c-b87c-f730859d09eb tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Beginning live snapshot process
Nov 14 00:55:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-17005759-fc5c-4c5c-b87c-f730859d09eb tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json -f qcow2 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:24 user nova-compute[74850]: DEBUG nova.compute.manager [req-25c9ae46-e11b-4ecf-a71c-597df8683027 req-6aca1511-664c-489a-ba75-0af601919781 service nova] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Received event network-changed-eac9af58-5f10-4ea2-a8ef-fb93b63fa661 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:55:24 user nova-compute[74850]: DEBUG nova.compute.manager [req-25c9ae46-e11b-4ecf-a71c-597df8683027 req-6aca1511-664c-489a-ba75-0af601919781 service nova] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Refreshing instance network info cache due to event network-changed-eac9af58-5f10-4ea2-a8ef-fb93b63fa661. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:55:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-25c9ae46-e11b-4ecf-a71c-597df8683027 req-6aca1511-664c-489a-ba75-0af601919781 service nova] Acquiring lock "refresh_cache-5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:55:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-25c9ae46-e11b-4ecf-a71c-597df8683027 req-6aca1511-664c-489a-ba75-0af601919781 service nova] Acquired lock "refresh_cache-5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:55:24 user nova-compute[74850]: DEBUG nova.network.neutron [req-25c9ae46-e11b-4ecf-a71c-597df8683027 req-6aca1511-664c-489a-ba75-0af601919781 service nova] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Refreshing network info cache for port eac9af58-5f10-4ea2-a8ef-fb93b63fa661 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:55:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-17005759-fc5c-4c5c-b87c-f730859d09eb tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-17005759-fc5c-4c5c-b87c-f730859d09eb tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json -f qcow2 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:55:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:55:24 user nova-compute[74850]: DEBUG nova.objects.instance [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lazy-loading 'flavor' on Instance uuid 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:55:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:55:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-17005759-fc5c-4c5c-b87c-f730859d09eb tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-17005759-fc5c-4c5c-b87c-f730859d09eb tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:55:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:55:24 user nova-compute[74850]: INFO nova.compute.manager [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Attaching volume cce03f17-6ce8-4475-b375-12c3351729c0 to /dev/vdb
Nov 14 00:55:24 user nova-compute[74850]: DEBUG os_brick.utils [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:55:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:24 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e122ca70-9bbb-48a4-8cc9-df63b099345b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:24 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b2ee2a-241a-40ba-9597-3118e6e30b1e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-17005759-fc5c-4c5c-b87c-f730859d09eb tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.217s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-17005759-fc5c-4c5c-b87c-f730859d09eb tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpb31r9zsr/2edb9a49a0e243b88a42dfbfb7d3e054.delta 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:25 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:25 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9a9135-4bca-4419-9cd2-00a15745de91]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:25 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[042946df-e76a-4d90-8023-f0546b9ea1b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:25 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:25 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:55:25 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-17005759-fc5c-4c5c-b87c-f730859d09eb tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpb31r9zsr/2edb9a49a0e243b88a42dfbfb7d3e054.delta 1073741824" returned: 0 in 0.092s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:25 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 00:55:25 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-17005759-fc5c-4c5c-b87c-f730859d09eb tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 00:55:25 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:25 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:55:25 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 00:55:25 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8756645-ec18-479c-a501-64ea37eaced8]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:25 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 00:55:25 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 00:55:25 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 00:55:25 user nova-compute[74850]: DEBUG os_brick.utils [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:55:25 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Updating existing volume attachment record: bed16ff1-5398-45d9-9d40-49d2b5baf724 {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 00:55:25 user nova-compute[74850]: DEBUG nova.network.neutron [req-25c9ae46-e11b-4ecf-a71c-597df8683027 req-6aca1511-664c-489a-ba75-0af601919781 service nova] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Updated VIF entry in instance network info cache for port eac9af58-5f10-4ea2-a8ef-fb93b63fa661. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:55:25 user nova-compute[74850]: DEBUG nova.network.neutron [req-25c9ae46-e11b-4ecf-a71c-597df8683027 req-6aca1511-664c-489a-ba75-0af601919781 service nova] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Updating instance_info_cache with network_info: [{"id": "eac9af58-5f10-4ea2-a8ef-fb93b63fa661", "address": "fa:16:3e:7d:47:f6", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac9af58-5f", "ovs_interfaceid": "eac9af58-5f10-4ea2-a8ef-fb93b63fa661", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:55:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-25c9ae46-e11b-4ecf-a71c-597df8683027 req-6aca1511-664c-489a-ba75-0af601919781 service nova] Releasing lock "refresh_cache-5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:55:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-17005759-fc5c-4c5c-b87c-f730859d09eb tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 00:55:26 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-17005759-fc5c-4c5c-b87c-f730859d09eb tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] COPY block job progress, current cursor: 26738688 final cursor: 75497472 {{(pid=74850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 00:55:26 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-17005759-fc5c-4c5c-b87c-f730859d09eb tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 00:55:26 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-17005759-fc5c-4c5c-b87c-f730859d09eb tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 00:55:26 user nova-compute[74850]: DEBUG nova.privsep.utils [None req-17005759-fc5c-4c5c-b87c-f730859d09eb tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74850) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 00:55:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-17005759-fc5c-4c5c-b87c-f730859d09eb tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpb31r9zsr/2edb9a49a0e243b88a42dfbfb7d3e054.delta /opt/stack/data/nova/instances/snapshots/tmpb31r9zsr/2edb9a49a0e243b88a42dfbfb7d3e054 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-17005759-fc5c-4c5c-b87c-f730859d09eb tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpb31r9zsr/2edb9a49a0e243b88a42dfbfb7d3e054.delta /opt/stack/data/nova/instances/snapshots/tmpb31r9zsr/2edb9a49a0e243b88a42dfbfb7d3e054" returned: 0 in 0.505s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:27 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-17005759-fc5c-4c5c-b87c-f730859d09eb tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Snapshot extracted, beginning image upload
Nov 14 00:55:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ePlbYuKM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:55:29 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:55:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:55:29 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:55:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:55:29 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 00:55:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4118ed97-6224-49cb-b4b2-9655d1672c42]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 00:55:29 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e997e9c9-0181-41d6-871b-1cd3ef8f0da9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0] added
Nov 14 00:55:29 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71c26c0-1070-4c0d-9349-34afb976c3d3]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a11c36-0230-4a7a-a9ff-5e0a5ed78515]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ePlbYuKM {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ePlbYuKM" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71bd17a-b513-43cd-bc05-d641e6eee7f5]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ePlbYuKM'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9500454-96bc-4db6-8429-c5f641f50ac5]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0971015-8b56-4985-9b6e-9c7e135fb82e]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:55:29 user nova-compute[74850]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:55:29 user nova-compute[74850]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:55:29 user nova-compute[74850]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:55:29 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:55:29 user nova-compute[74850]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:55:29 user nova-compute[74850]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:55:29 user nova-compute[74850]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:55:29 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:55:29 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-17005759-fc5c-4c5c-b87c-f730859d09eb tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Snapshot image upload complete
Nov 14 00:55:29 user nova-compute[74850]: INFO nova.compute.manager [None req-17005759-fc5c-4c5c-b87c-f730859d09eb tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Took 5.56 seconds to snapshot the instance on the hypervisor.
Nov 14 00:55:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cab4cfa-80a6-420a-870f-5cd0617bfcf4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0, portal: 172.16.0.220,3260]
Nov 14 00:55:29 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0, portal: 172.16.0.220,3260] successful.
Nov 14 00:55:29 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20a87dd-a5f7-44d4-ba37-83a84e9ca49f]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d370f90e-f4d1-4cd8-a401-80cd7dc1f48e]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:55:29 user nova-compute[74850]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:55:29 user nova-compute[74850]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:55:29 user nova-compute[74850]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:55:29 user nova-compute[74850]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 (non-flash)
Nov 14 00:55:29 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:55:29 user nova-compute[74850]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:55:29 user nova-compute[74850]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:55:29 user nova-compute[74850]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:55:29 user nova-compute[74850]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 (non-flash)
Nov 14 00:55:29 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] HCTL ('37', '-', '-', 0) found on session 29 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc565480-617f-4829-9828-2f2d4fdb8244]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Searching for a device in session 29 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:55:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ePlbYuKM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 00:55:30 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:30 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:55:30 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '26532613231346431', 'path': '/dev/sdf'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:55:30 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532613231346431', 'path': '/dev/sdf'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 00:55:30 user nova-compute[74850]: DEBUG nova.objects.instance [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lazy-loading 'flavor' on Instance uuid 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:55:30 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 00:55:30 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:55:30 user nova-compute[74850]:   <source dev="/dev/sdf"/>
Nov 14 00:55:30 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:55:30 user nova-compute[74850]:   <serial>cce03f17-6ce8-4475-b375-12c3351729c0</serial>
Nov 14 00:55:30 user nova-compute[74850]: </disk>
Nov 14 00:55:30 user nova-compute[74850]:  {{(pid=74850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 00:55:31 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:55:31 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:55:31 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] No VIF found with MAC fa:16:3e:7d:47:f6, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:55:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-03e76585-7f95-4ec0-a1b5-94f7fd36ad4c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.626s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:55:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-411cfbe1-6b5d-4394-8381-434f4cb07d68 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Acquiring lock "57f1e010-68bf-4047-9316-0412a2c89be2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:55:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-411cfbe1-6b5d-4394-8381-434f4cb07d68 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Lock "57f1e010-68bf-4047-9316-0412a2c89be2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:55:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-411cfbe1-6b5d-4394-8381-434f4cb07d68 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Acquiring lock "57f1e010-68bf-4047-9316-0412a2c89be2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:55:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-411cfbe1-6b5d-4394-8381-434f4cb07d68 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Lock "57f1e010-68bf-4047-9316-0412a2c89be2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:55:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-411cfbe1-6b5d-4394-8381-434f4cb07d68 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Lock "57f1e010-68bf-4047-9316-0412a2c89be2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:55:32 user nova-compute[74850]: INFO nova.compute.manager [None req-411cfbe1-6b5d-4394-8381-434f4cb07d68 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Terminating instance
Nov 14 00:55:32 user nova-compute[74850]: DEBUG nova.compute.manager [None req-411cfbe1-6b5d-4394-8381-434f4cb07d68 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 00:55:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:32 user nova-compute[74850]: DEBUG nova.compute.manager [req-fd5621cf-e87e-477d-8279-d89a9f563d58 req-2182b883-7358-45a9-8395-a6da45e8c6c8 service nova] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Received event network-vif-unplugged-ca2713af-4b11-4391-93da-9b767fea0783 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:55:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fd5621cf-e87e-477d-8279-d89a9f563d58 req-2182b883-7358-45a9-8395-a6da45e8c6c8 service nova] Acquiring lock "57f1e010-68bf-4047-9316-0412a2c89be2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:55:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fd5621cf-e87e-477d-8279-d89a9f563d58 req-2182b883-7358-45a9-8395-a6da45e8c6c8 service nova] Lock "57f1e010-68bf-4047-9316-0412a2c89be2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:55:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fd5621cf-e87e-477d-8279-d89a9f563d58 req-2182b883-7358-45a9-8395-a6da45e8c6c8 service nova] Lock "57f1e010-68bf-4047-9316-0412a2c89be2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:55:32 user nova-compute[74850]: DEBUG nova.compute.manager [req-fd5621cf-e87e-477d-8279-d89a9f563d58 req-2182b883-7358-45a9-8395-a6da45e8c6c8 service nova] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] No waiting events found dispatching network-vif-unplugged-ca2713af-4b11-4391-93da-9b767fea0783 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:55:32 user nova-compute[74850]: DEBUG nova.compute.manager [req-fd5621cf-e87e-477d-8279-d89a9f563d58 req-2182b883-7358-45a9-8395-a6da45e8c6c8 service nova] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Received event network-vif-unplugged-ca2713af-4b11-4391-93da-9b767fea0783 for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 00:55:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:32 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Instance destroyed successfully.
Nov 14 00:55:32 user nova-compute[74850]: DEBUG nova.objects.instance [None req-411cfbe1-6b5d-4394-8381-434f4cb07d68 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Lazy-loading 'resources' on Instance uuid 57f1e010-68bf-4047-9316-0412a2c89be2 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:55:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-411cfbe1-6b5d-4394-8381-434f4cb07d68 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:52:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1436939986',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1436939986',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1436939',id=24,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGsiKxtlTR6t2g/D8qhps8uXiJgUz2Bv/aYMQB7anB4UVZokfehc3BRcM1HjHxWQTuRELTWaDeGx+SrOEleQurvRKMMHEDWmc2ooOG0aGeW00cY5OvSRc/ZdZg6ZdllFA==',key_name='tempest-keypair-457639716',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:52:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5dbc81e4bfc2438bbecb30c46089cd20',ramdisk_id='',reservation_id='r-0wf2kbaj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-869872645',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:52:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fff45c6350248c2bdcaeeb703e20d13',uuid=57f1e010-68bf-4047-9316-0412a2c89be2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca2713af-4b11-4391-93da-9b767fea0783", "address": "fa:16:3e:34:bf:d7", "network": {"id": "5f593e54-bb69-4d38-ba7d-496a4c0f581b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-342901959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dbc81e4bfc2438bbecb30c46089cd20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca2713af-4b", "ovs_interfaceid": "ca2713af-4b11-4391-93da-9b767fea0783", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:55:32 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-411cfbe1-6b5d-4394-8381-434f4cb07d68 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Converting VIF {"id": "ca2713af-4b11-4391-93da-9b767fea0783", "address": "fa:16:3e:34:bf:d7", "network": {"id": "5f593e54-bb69-4d38-ba7d-496a4c0f581b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-342901959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dbc81e4bfc2438bbecb30c46089cd20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca2713af-4b", "ovs_interfaceid": "ca2713af-4b11-4391-93da-9b767fea0783", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:55:32 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-411cfbe1-6b5d-4394-8381-434f4cb07d68 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:bf:d7,bridge_name='br-int',has_traffic_filtering=True,id=ca2713af-4b11-4391-93da-9b767fea0783,network=Network(5f593e54-bb69-4d38-ba7d-496a4c0f581b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca2713af-4b') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:55:32 user nova-compute[74850]: DEBUG os_vif [None req-411cfbe1-6b5d-4394-8381-434f4cb07d68 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:bf:d7,bridge_name='br-int',has_traffic_filtering=True,id=ca2713af-4b11-4391-93da-9b767fea0783,network=Network(5f593e54-bb69-4d38-ba7d-496a4c0f581b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca2713af-4b') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:55:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca2713af-4b, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:55:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:55:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6094244f-c499-47e7-a5b6-3cbfefd22f1c) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:55:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:55:32 user nova-compute[74850]: INFO os_vif [None req-411cfbe1-6b5d-4394-8381-434f4cb07d68 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:bf:d7,bridge_name='br-int',has_traffic_filtering=True,id=ca2713af-4b11-4391-93da-9b767fea0783,network=Network(5f593e54-bb69-4d38-ba7d-496a4c0f581b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca2713af-4b')
Nov 14 00:55:32 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-411cfbe1-6b5d-4394-8381-434f4cb07d68 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Deleting instance files /opt/stack/data/nova/instances/57f1e010-68bf-4047-9316-0412a2c89be2_del
Nov 14 00:55:32 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-411cfbe1-6b5d-4394-8381-434f4cb07d68 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Deletion of /opt/stack/data/nova/instances/57f1e010-68bf-4047-9316-0412a2c89be2_del complete
Nov 14 00:55:33 user nova-compute[74850]: INFO nova.compute.manager [None req-411cfbe1-6b5d-4394-8381-434f4cb07d68 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 14 00:55:33 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-411cfbe1-6b5d-4394-8381-434f4cb07d68 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 00:55:33 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 00:55:33 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 00:55:33 user nova-compute[74850]: INFO nova.compute.manager [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Rebuilding instance
Nov 14 00:55:33 user nova-compute[74850]: DEBUG nova.compute.manager [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:55:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:33 user nova-compute[74850]: DEBUG nova.compute.manager [req-79b0a762-aac4-4891-8a72-d2444c78548a req-e9f9c5ad-e733-4618-bcb4-39ce77a03e7c service nova] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Received event network-vif-unplugged-eac9af58-5f10-4ea2-a8ef-fb93b63fa661 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:55:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-79b0a762-aac4-4891-8a72-d2444c78548a req-e9f9c5ad-e733-4618-bcb4-39ce77a03e7c service nova] Acquiring lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:55:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-79b0a762-aac4-4891-8a72-d2444c78548a req-e9f9c5ad-e733-4618-bcb4-39ce77a03e7c service nova] Lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:55:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-79b0a762-aac4-4891-8a72-d2444c78548a req-e9f9c5ad-e733-4618-bcb4-39ce77a03e7c service nova] Lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:55:33 user nova-compute[74850]: DEBUG nova.compute.manager [req-79b0a762-aac4-4891-8a72-d2444c78548a req-e9f9c5ad-e733-4618-bcb4-39ce77a03e7c service nova] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] No waiting events found dispatching network-vif-unplugged-eac9af58-5f10-4ea2-a8ef-fb93b63fa661 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:55:33 user nova-compute[74850]: WARNING nova.compute.manager [req-79b0a762-aac4-4891-8a72-d2444c78548a req-e9f9c5ad-e733-4618-bcb4-39ce77a03e7c service nova] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Received unexpected event network-vif-unplugged-eac9af58-5f10-4ea2-a8ef-fb93b63fa661 for instance with vm_state active and task_state rebuilding.
Nov 14 00:55:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:33 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:55:33 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Took 0.94 seconds to deallocate network for instance.
Nov 14 00:55:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-411cfbe1-6b5d-4394-8381-434f4cb07d68 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-411cfbe1-6b5d-4394-8381-434f4cb07d68 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG nova.compute.manager [req-f7adc00a-27a0-4c8f-80c6-462e39ad16d3 req-32ceb0d6-2a6d-4088-811b-6c1fe6e06eb2 service nova] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Received event network-vif-deleted-ca2713af-4b11-4391-93da-9b767fea0783 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:55:34 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Instance destroyed successfully.
Nov 14 00:55:34 user nova-compute[74850]: INFO nova.compute.manager [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Detaching volume cce03f17-6ce8-4475-b375-12c3351729c0
Nov 14 00:55:34 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-411cfbe1-6b5d-4394-8381-434f4cb07d68 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-411cfbe1-6b5d-4394-8381-434f4cb07d68 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:55:34 user nova-compute[74850]: INFO nova.virt.block_device [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Attempting to driver detach volume cce03f17-6ce8-4475-b375-12c3351729c0 from mountpoint /dev/vdb
Nov 14 00:55:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-411cfbe1-6b5d-4394-8381-434f4cb07d68 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.435s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG nova.compute.manager [req-fadd0b9e-4cf9-468c-a82a-172fcf3b31f4 req-f1fe701c-151a-45a8-9011-9924da8d157b service nova] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Received event network-vif-plugged-ca2713af-4b11-4391-93da-9b767fea0783 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fadd0b9e-4cf9-468c-a82a-172fcf3b31f4 req-f1fe701c-151a-45a8-9011-9924da8d157b service nova] Acquiring lock "57f1e010-68bf-4047-9316-0412a2c89be2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fadd0b9e-4cf9-468c-a82a-172fcf3b31f4 req-f1fe701c-151a-45a8-9011-9924da8d157b service nova] Lock "57f1e010-68bf-4047-9316-0412a2c89be2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fadd0b9e-4cf9-468c-a82a-172fcf3b31f4 req-f1fe701c-151a-45a8-9011-9924da8d157b service nova] Lock "57f1e010-68bf-4047-9316-0412a2c89be2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG nova.compute.manager [req-fadd0b9e-4cf9-468c-a82a-172fcf3b31f4 req-f1fe701c-151a-45a8-9011-9924da8d157b service nova] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] No waiting events found dispatching network-vif-plugged-ca2713af-4b11-4391-93da-9b767fea0783 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:55:34 user nova-compute[74850]: WARNING nova.compute.manager [req-fadd0b9e-4cf9-468c-a82a-172fcf3b31f4 req-f1fe701c-151a-45a8-9011-9924da8d157b service nova] [instance: 57f1e010-68bf-4047-9316-0412a2c89be2] Received unexpected event network-vif-plugged-ca2713af-4b11-4391-93da-9b767fea0783 for instance with vm_state deleted and task_state None.
Nov 14 00:55:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Attempting to detach device vdb from instance 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf from the persistent domain config. {{(pid=74850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 00:55:34 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:55:34 user nova-compute[74850]:   <source dev="/dev/sdf"/>
Nov 14 00:55:34 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:55:34 user nova-compute[74850]:   <serial>cce03f17-6ce8-4475-b375-12c3351729c0</serial>
Nov 14 00:55:34 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 00:55:34 user nova-compute[74850]: </disk>
Nov 14 00:55:34 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 00:55:34 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-411cfbe1-6b5d-4394-8381-434f4cb07d68 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Deleted allocations for instance 57f1e010-68bf-4047-9316-0412a2c89be2
Nov 14 00:55:34 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Successfully detached device vdb from instance 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf from the persistent domain config.
Nov 14 00:55:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ePlbYuKM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:55:34 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 00:55:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0eef4a-2309-4be8-ae4d-11df2c7d4d7a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 00:55:34 user nova-compute[74850]: No targets found.
Nov 14 00:55:34 user nova-compute[74850]: iSNS:
Nov 14 00:55:34 user nova-compute[74850]: No targets found.
Nov 14 00:55:34 user nova-compute[74850]: STATIC:
Nov 14 00:55:34 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a
Nov 14 00:55:34 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:55:34 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:55:34 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf
Nov 14 00:55:34 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:55:34 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:55:34 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390
Nov 14 00:55:34 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:55:34 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:55:34 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714
Nov 14 00:55:34 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:55:34 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:55:34 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0
Nov 14 00:55:34 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:55:34 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:55:34 user nova-compute[74850]: FIRMWARE:
Nov 14 00:55:34 user nova-compute[74850]: No targets found.
Nov 14 00:55:34 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 00:55:34 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 00:55:34 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa987d9-26bf-4757-8ab3-ad1594c3cbb8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-411cfbe1-6b5d-4394-8381-434f4cb07d68 tempest-TestServerVolumeAttachScenarioOldVersion-869872645 tempest-TestServerVolumeAttachScenarioOldVersion-869872645-project-member] Lock "57f1e010-68bf-4047-9316-0412a2c89be2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.446s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a681d15-3fa4-45ec-b39c-b1b2eacee1fc]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:55:34 user nova-compute[74850]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:55:34 user nova-compute[74850]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:55:34 user nova-compute[74850]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:55:34 user nova-compute[74850]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 (non-flash)
Nov 14 00:55:34 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:55:34 user nova-compute[74850]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:55:34 user nova-compute[74850]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:55:34 user nova-compute[74850]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:55:34 user nova-compute[74850]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 (non-flash)
Nov 14 00:55:34 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a5c253ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0'): ({'sdf'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Removing single pathed devices sdf {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de60193-451f-4930-be51-475d460fccb4]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bea03a-96f2-4444-8ab3-57706d23335c]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Flushing IO for device /dev/sdf {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c5c295-93f1-43c2-8dd1-41a6dccfc263]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[083bb6b8-31bf-4e62-9695-325a3d00b6f6]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] SCSI volumes sdf have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c705fe-873c-4319-ba21-362f650b7498]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d1f732-858a-4349-9a5f-716643f594d2]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0, portal: 172.16.0.220,3260]
Nov 14 00:55:34 user nova-compute[74850]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0, portal: 172.16.0.220,3260] successful.
Nov 14 00:55:34 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e981bad0-9868-40c9-bf2a-cc7657610d5b]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] <== disconnect_volume: return (339ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:55:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:35 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Instance destroyed successfully.
Nov 14 00:55:35 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:53:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1625476669',display_name='tempest-ServerActionsTestOtherA-server-2143394548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1625476669',id=27,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDV2rMj6ypVN79NzZquMwuzVGFzBjsYheQsnYgiaIuxZDRWAmZIAl29ZfE9ZXIZPbNiV6W1etqaTbE7SdUIDyBWr5Q7XZ0JyP5fqpcxD+e7pdwSJyDS2tj+RVfGVMn8zvg==',key_name='tempest-keypair-1763585720',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:53:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='67d09cd8d15a4b058988fa348d7fdc2e',ramdisk_id='',reservation_id='r-6aqonybt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1680693726',owner_user_name='tempest-ServerActionsTestOtherA-1680693726-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:55:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dab7bcadfc32457e8bfa6fa81cba2702',uuid=5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eac9af58-5f10-4ea2-a8ef-fb93b63fa661", "address": "fa:16:3e:7d:47:f6", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac9af58-5f", "ovs_interfaceid": "eac9af58-5f10-4ea2-a8ef-fb93b63fa661", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Converting VIF {"id": "eac9af58-5f10-4ea2-a8ef-fb93b63fa661", "address": "fa:16:3e:7d:47:f6", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac9af58-5f", "ovs_interfaceid": "eac9af58-5f10-4ea2-a8ef-fb93b63fa661", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:47:f6,bridge_name='br-int',has_traffic_filtering=True,id=eac9af58-5f10-4ea2-a8ef-fb93b63fa661,network=Network(6e563565-dc0c-4f19-9030-742bf28811d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac9af58-5f') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG os_vif [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:47:f6,bridge_name='br-int',has_traffic_filtering=True,id=eac9af58-5f10-4ea2-a8ef-fb93b63fa661,network=Network(6e563565-dc0c-4f19-9030-742bf28811d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac9af58-5f') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeac9af58-5f, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d106a59-9c09-46be-bb20-8bfe0851a77a) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:35 user nova-compute[74850]: INFO os_vif [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:47:f6,bridge_name='br-int',has_traffic_filtering=True,id=eac9af58-5f10-4ea2-a8ef-fb93b63fa661,network=Network(6e563565-dc0c-4f19-9030-742bf28811d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac9af58-5f')
Nov 14 00:55:35 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ePlbYuKM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:55:35 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 00:55:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf1b83b-3045-4120-87bf-d3d3ccfc0002]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 00:55:35 user nova-compute[74850]: No targets found.
Nov 14 00:55:35 user nova-compute[74850]: iSNS:
Nov 14 00:55:35 user nova-compute[74850]: No targets found.
Nov 14 00:55:35 user nova-compute[74850]: STATIC:
Nov 14 00:55:35 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a
Nov 14 00:55:35 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:55:35 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:55:35 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf
Nov 14 00:55:35 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:55:35 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:55:35 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390
Nov 14 00:55:35 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:55:35 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:55:35 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714
Nov 14 00:55:35 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:55:35 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:55:35 user nova-compute[74850]: FIRMWARE:
Nov 14 00:55:35 user nova-compute[74850]: No targets found.
Nov 14 00:55:35 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 00:55:35 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 00:55:35 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aae8ce1-6e8c-4c6e-af56-69648665c80d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[15df1d62-3165-4105-8b27-4e884920f2f7]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:55:35 user nova-compute[74850]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:55:35 user nova-compute[74850]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:55:35 user nova-compute[74850]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:55:35 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:55:35 user nova-compute[74850]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:55:35 user nova-compute[74850]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:55:35 user nova-compute[74850]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:55:35 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a1c7f2a70>, {}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Disconnecting from: [] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.071s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] <== disconnect_volume: return (72ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 00:55:35 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Deleting instance files /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf_del
Nov 14 00:55:35 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Deletion of /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf_del complete
Nov 14 00:55:35 user nova-compute[74850]: DEBUG nova.compute.manager [req-0c89626b-0cbd-4034-9305-14cefc4cd232 req-6c8c581d-f133-4d16-8edc-8555b60e2d05 service nova] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Received event network-vif-plugged-eac9af58-5f10-4ea2-a8ef-fb93b63fa661 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-0c89626b-0cbd-4034-9305-14cefc4cd232 req-6c8c581d-f133-4d16-8edc-8555b60e2d05 service nova] Acquiring lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-0c89626b-0cbd-4034-9305-14cefc4cd232 req-6c8c581d-f133-4d16-8edc-8555b60e2d05 service nova] Lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-0c89626b-0cbd-4034-9305-14cefc4cd232 req-6c8c581d-f133-4d16-8edc-8555b60e2d05 service nova] Lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG nova.compute.manager [req-0c89626b-0cbd-4034-9305-14cefc4cd232 req-6c8c581d-f133-4d16-8edc-8555b60e2d05 service nova] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] No waiting events found dispatching network-vif-plugged-eac9af58-5f10-4ea2-a8ef-fb93b63fa661 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:55:35 user nova-compute[74850]: WARNING nova.compute.manager [req-0c89626b-0cbd-4034-9305-14cefc4cd232 req-6c8c581d-f133-4d16-8edc-8555b60e2d05 service nova] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Received unexpected event network-vif-plugged-eac9af58-5f10-4ea2-a8ef-fb93b63fa661 for instance with vm_state active and task_state rebuilding.
Nov 14 00:55:35 user nova-compute[74850]: INFO nova.virt.block_device [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Booting with volume cce03f17-6ce8-4475-b375-12c3351729c0 at /dev/vdb
Nov 14 00:55:35 user nova-compute[74850]: DEBUG os_brick.utils [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8564da-99fe-4251-bf79-e07be65affea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff29f17-8c5b-454e-beaf-2758dc086b57]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dd678e-1981-4253-9149-8b0eab307ed4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed738bdf-1b06-4971-a42a-71e57f0a8772]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:55:35 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 00:55:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aedd5fb-30c7-4e56-96f5-26dffb924186]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG os_brick.utils [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:55:35 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Updating existing volume attachment record: 74c97bfc-669f-4b93-83a2-167416908094 {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 00:55:38 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-d182503a-5ffe-45a4-b92a-af1830f21a32 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4b60ac08-e954-46d5-a280-a11146b3ebf4 is timed out.
Nov 14 00:55:38 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-d182503a-5ffe-45a4-b92a-af1830f21a32 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Successfully detached device vdb from instance 4b60ac08-e954-46d5-a280-a11146b3ebf4 from the live domain config.
Nov 14 00:55:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d182503a-5ffe-45a4-b92a-af1830f21a32 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d182503a-5ffe-45a4-b92a-af1830f21a32 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'edVGtwrJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:55:38 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-d182503a-5ffe-45a4-b92a-af1830f21a32 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:55:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-d182503a-5ffe-45a4-b92a-af1830f21a32 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-d182503a-5ffe-45a4-b92a-af1830f21a32 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a622eea-c8ff-4176-b72d-39e7b53d3f2a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d182503a-5ffe-45a4-b92a-af1830f21a32 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 00:55:38 user nova-compute[74850]: No targets found.
Nov 14 00:55:38 user nova-compute[74850]: iSNS:
Nov 14 00:55:38 user nova-compute[74850]: No targets found.
Nov 14 00:55:38 user nova-compute[74850]: STATIC:
Nov 14 00:55:38 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a
Nov 14 00:55:38 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:55:38 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:55:38 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf
Nov 14 00:55:38 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:55:38 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:55:38 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390
Nov 14 00:55:38 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:55:38 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:55:38 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714
Nov 14 00:55:38 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:55:38 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:55:38 user nova-compute[74850]: FIRMWARE:
Nov 14 00:55:38 user nova-compute[74850]: No targets found.
Nov 14 00:55:38 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d182503a-5ffe-45a4-b92a-af1830f21a32 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 00:55:38 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 00:55:38 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d182503a-5ffe-45a4-b92a-af1830f21a32 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[726d14b0-b11c-4884-82f8-a6c3ce210fcb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d877c317-8cc4-4c59-9c57-b33a8e1e5ca9]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d182503a-5ffe-45a4-b92a-af1830f21a32 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:55:38 user nova-compute[74850]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:55:38 user nova-compute[74850]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:55:38 user nova-compute[74850]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:55:38 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d182503a-5ffe-45a4-b92a-af1830f21a32 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 (non-flash)
Nov 14 00:55:38 user nova-compute[74850]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:55:38 user nova-compute[74850]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:55:38 user nova-compute[74850]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:55:38 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d182503a-5ffe-45a4-b92a-af1830f21a32 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a1c70e7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714'): ({'sdb'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-d182503a-5ffe-45a4-b92a-af1830f21a32 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Removing single pathed devices sdb {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecc5f67-bd0a-49b7-909f-9a80d1cea3b7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedea68f-41af-471f-b4b3-678edaea7375]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-d182503a-5ffe-45a4-b92a-af1830f21a32 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Flushing IO for device /dev/sdb {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec22102-28f2-4ca2-a7b4-02352f4777e8]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-d182503a-5ffe-45a4-b92a-af1830f21a32 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec7a12d-c52c-441c-9bc9-2c22ff88aac2]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-d182503a-5ffe-45a4-b92a-af1830f21a32 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-d182503a-5ffe-45a4-b92a-af1830f21a32 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d182503a-5ffe-45a4-b92a-af1830f21a32 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2ade53-7a90-4709-9e95-237cd978fd69]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d182503a-5ffe-45a4-b92a-af1830f21a32 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e330fdfc-d15e-4922-8091-15d5ff85d8ee]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d182503a-5ffe-45a4-b92a-af1830f21a32 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714, portal: 172.16.0.220,3260]
Nov 14 00:55:38 user nova-compute[74850]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714, portal: 172.16.0.220,3260] successful.
Nov 14 00:55:38 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44fa6c77-8978-4921-b98e-3c21c1e75714 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d233d72-5cb9-4330-a7f0-4f193f369214]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d182503a-5ffe-45a4-b92a-af1830f21a32 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-d182503a-5ffe-45a4-b92a-af1830f21a32 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d182503a-5ffe-45a4-b92a-af1830f21a32 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] <== disconnect_volume: return (304ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:55:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d182503a-5ffe-45a4-b92a-af1830f21a32 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 00:55:39 user nova-compute[74850]: DEBUG nova.objects.instance [None req-d182503a-5ffe-45a4-b92a-af1830f21a32 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lazy-loading 'flavor' on Instance uuid 4b60ac08-e954-46d5-a280-a11146b3ebf4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:55:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-d182503a-5ffe-45a4-b92a-af1830f21a32 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lock "4b60ac08-e954-46d5-a280-a11146b3ebf4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.962s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 00:55:40 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Creating image(s)
Nov 14 00:55:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "/opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "/opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "/opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.170s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.188s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk 1073741824" returned: 0 in 0.048s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.184s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Cannot resize image /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Ensure instance console log exists: /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Start _get_guest_xml network_info=[{"id": "eac9af58-5f10-4ea2-a8ef-fb93b63fa661", "address": "fa:16:3e:7d:47:f6", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac9af58-5f", "ovs_interfaceid": "eac9af58-5f10-4ea2-a8ef-fb93b63fa661", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '74c97bfc-669f-4b93-83a2-167416908094', 'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ePlbYuKM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf', 'attached_at': '', 'detached_at': '', 'volume_id': 'cce03f17-6ce8-4475-b375-12c3351729c0', 'serial': 'cce03f17-6ce8-4475-b375-12c3351729c0'}, 'volume_type': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:55:40 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 00:55:40 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 00:55:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:55:40 user nova-compute[74850]: DEBUG nova.objects.instance [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ePlbYuKM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:55:41 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 00:55:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:55:41 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 00:55:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:55:41 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 00:55:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb03b56-9b2c-4511-90f7-eb436cdf6a41]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 00:55:41 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1b9153-49c4-4716-a05b-c1b7bc91350b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0] added
Nov 14 00:55:41 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[560814d2-c39a-48f3-9eff-60bffc1d1bba]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9adc6f97-3939-4565-88a2-92978b368979]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ePlbYuKM {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ePlbYuKM" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[19210c11-8cd0-4fb1-996a-62c458e3097d]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ePlbYuKM'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[245b5aaa-3396-4015-b554-67000c6e6126]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8d3a6c-6380-409b-81cd-aa70e7d9fd21]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:55:41 user nova-compute[74850]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:55:41 user nova-compute[74850]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:55:41 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:55:41 user nova-compute[74850]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:55:41 user nova-compute[74850]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:55:41 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a1f457-c03a-4db9-8268-2aa0e854dfa0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0, portal: 172.16.0.220,3260]
Nov 14 00:55:41 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0, portal: 172.16.0.220,3260] successful.
Nov 14 00:55:41 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37aab3b-6de6-49c8-8f48-22bfe36046d2]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff80c0b-8ba5-4582-b7fc-4c5728657505]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:55:41 user nova-compute[74850]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:55:41 user nova-compute[74850]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:55:41 user nova-compute[74850]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 (non-flash)
Nov 14 00:55:41 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:55:41 user nova-compute[74850]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:55:41 user nova-compute[74850]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:55:41 user nova-compute[74850]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 (non-flash)
Nov 14 00:55:41 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2be11d9-a02d-4bfe-a27f-02b85061685b]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:55:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ePlbYuKM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 00:55:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:55:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26532613231346431', 'path': '/dev/sdb'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:55:42 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532613231346431', 'path': '/dev/sdb'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 00:55:42 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T00:53:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1625476669',display_name='tempest-ServerActionsTestOtherA-server-2143394548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1625476669',id=27,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDV2rMj6ypVN79NzZquMwuzVGFzBjsYheQsnYgiaIuxZDRWAmZIAl29ZfE9ZXIZPbNiV6W1etqaTbE7SdUIDyBWr5Q7XZ0JyP5fqpcxD+e7pdwSJyDS2tj+RVfGVMn8zvg==',key_name='tempest-keypair-1763585720',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:53:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='67d09cd8d15a4b058988fa348d7fdc2e',ramdisk_id='',reservation_id='r-6aqonybt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1680693726',owner_user_name='tempest-ServerActionsTestOtherA-1680693726-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:55:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dab7bcadfc32457e8bfa6fa81cba2702',uuid=5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eac9af58-5f10-4ea2-a8ef-fb93b63fa661", "address": "fa:16:3e:7d:47:f6", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac9af58-5f", "ovs_interfaceid": "eac9af58-5f10-4ea2-a8ef-fb93b63fa661", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:55:42 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Converting VIF {"id": "eac9af58-5f10-4ea2-a8ef-fb93b63fa661", "address": "fa:16:3e:7d:47:f6", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac9af58-5f", "ovs_interfaceid": "eac9af58-5f10-4ea2-a8ef-fb93b63fa661", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:55:42 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:47:f6,bridge_name='br-int',has_traffic_filtering=True,id=eac9af58-5f10-4ea2-a8ef-fb93b63fa661,network=Network(6e563565-dc0c-4f19-9030-742bf28811d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac9af58-5f') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:55:42 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:55:42 user nova-compute[74850]:   <uuid>5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf</uuid>
Nov 14 00:55:42 user nova-compute[74850]:   <name>instance-0000001b</name>
Nov 14 00:55:42 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:55:42 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:55:42 user nova-compute[74850]:   <metadata>
Nov 14 00:55:42 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:55:42 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:55:42 user nova-compute[74850]:       <nova:name>tempest-ServerActionsTestOtherA-server-2143394548</nova:name>
Nov 14 00:55:42 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:55:40</nova:creationTime>
Nov 14 00:55:42 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:55:42 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:55:42 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:55:42 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:55:42 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:55:42 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:55:42 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:55:42 user nova-compute[74850]:       <nova:owner>
Nov 14 00:55:42 user nova-compute[74850]:         <nova:user uuid="dab7bcadfc32457e8bfa6fa81cba2702">tempest-ServerActionsTestOtherA-1680693726-project-member</nova:user>
Nov 14 00:55:42 user nova-compute[74850]:         <nova:project uuid="67d09cd8d15a4b058988fa348d7fdc2e">tempest-ServerActionsTestOtherA-1680693726</nova:project>
Nov 14 00:55:42 user nova-compute[74850]:       </nova:owner>
Nov 14 00:55:42 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:55:42 user nova-compute[74850]:       <nova:ports>
Nov 14 00:55:42 user nova-compute[74850]:         <nova:port uuid="eac9af58-5f10-4ea2-a8ef-fb93b63fa661">
Nov 14 00:55:42 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 00:55:42 user nova-compute[74850]:         </nova:port>
Nov 14 00:55:42 user nova-compute[74850]:       </nova:ports>
Nov 14 00:55:42 user nova-compute[74850]:     </nova:instance>
Nov 14 00:55:42 user nova-compute[74850]:   </metadata>
Nov 14 00:55:42 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:55:42 user nova-compute[74850]:     <system>
Nov 14 00:55:42 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:55:42 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:55:42 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:55:42 user nova-compute[74850]:       <entry name="serial">5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf</entry>
Nov 14 00:55:42 user nova-compute[74850]:       <entry name="uuid">5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf</entry>
Nov 14 00:55:42 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:55:42 user nova-compute[74850]:     </system>
Nov 14 00:55:42 user nova-compute[74850]:   </sysinfo>
Nov 14 00:55:42 user nova-compute[74850]:   <os>
Nov 14 00:55:42 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:55:42 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 00:55:42 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:55:42 user nova-compute[74850]:   </os>
Nov 14 00:55:42 user nova-compute[74850]:   <features>
Nov 14 00:55:42 user nova-compute[74850]:     <acpi/>
Nov 14 00:55:42 user nova-compute[74850]:     <apic/>
Nov 14 00:55:42 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:55:42 user nova-compute[74850]:   </features>
Nov 14 00:55:42 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:55:42 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:55:42 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:55:42 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:55:42 user nova-compute[74850]:   </clock>
Nov 14 00:55:42 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:55:42 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:55:42 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:55:42 user nova-compute[74850]:   </cpu>
Nov 14 00:55:42 user nova-compute[74850]:   <devices>
Nov 14 00:55:42 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 00:55:42 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:55:42 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk"/>
Nov 14 00:55:42 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:55:42 user nova-compute[74850]:     </disk>
Nov 14 00:55:42 user nova-compute[74850]:     <disk type="block" device="disk">
Nov 14 00:55:42 user nova-compute[74850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:55:42 user nova-compute[74850]:       <source dev="/dev/sdb"/>
Nov 14 00:55:42 user nova-compute[74850]:       <target dev="vdb" bus="virtio"/>
Nov 14 00:55:42 user nova-compute[74850]:       <serial>cce03f17-6ce8-4475-b375-12c3351729c0</serial>
Nov 14 00:55:42 user nova-compute[74850]:     </disk>
Nov 14 00:55:42 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:55:42 user nova-compute[74850]:       <mac address="fa:16:3e:7d:47:f6"/>
Nov 14 00:55:42 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:55:42 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:55:42 user nova-compute[74850]:       <target dev="tapeac9af58-5f"/>
Nov 14 00:55:42 user nova-compute[74850]:     </interface>
Nov 14 00:55:42 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:55:42 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/console.log" append="off"/>
Nov 14 00:55:42 user nova-compute[74850]:     </serial>
Nov 14 00:55:42 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:55:42 user nova-compute[74850]:     <video>
Nov 14 00:55:42 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:55:42 user nova-compute[74850]:     </video>
Nov 14 00:55:42 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:55:42 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:55:42 user nova-compute[74850]:     </rng>
Nov 14 00:55:42 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:55:42 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:55:42 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:55:42 user nova-compute[74850]:     </memballoon>
Nov 14 00:55:42 user nova-compute[74850]:   </devices>
Nov 14 00:55:42 user nova-compute[74850]: </domain>
Nov 14 00:55:42 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:55:42 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T00:53:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1625476669',display_name='tempest-ServerActionsTestOtherA-server-2143394548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1625476669',id=27,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDV2rMj6ypVN79NzZquMwuzVGFzBjsYheQsnYgiaIuxZDRWAmZIAl29ZfE9ZXIZPbNiV6W1etqaTbE7SdUIDyBWr5Q7XZ0JyP5fqpcxD+e7pdwSJyDS2tj+RVfGVMn8zvg==',key_name='tempest-keypair-1763585720',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:53:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='67d09cd8d15a4b058988fa348d7fdc2e',ramdisk_id='',reservation_id='r-6aqonybt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1680693726',owner_user_name='tempest-ServerActionsTestOtherA-1680693726-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:55:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dab7bcadfc32457e8bfa6fa81cba2702',uuid=5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eac9af58-5f10-4ea2-a8ef-fb93b63fa661", "address": "fa:16:3e:7d:47:f6", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac9af58-5f", "ovs_interfaceid": "eac9af58-5f10-4ea2-a8ef-fb93b63fa661", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:55:42 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Converting VIF {"id": "eac9af58-5f10-4ea2-a8ef-fb93b63fa661", "address": "fa:16:3e:7d:47:f6", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac9af58-5f", "ovs_interfaceid": "eac9af58-5f10-4ea2-a8ef-fb93b63fa661", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:55:42 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:47:f6,bridge_name='br-int',has_traffic_filtering=True,id=eac9af58-5f10-4ea2-a8ef-fb93b63fa661,network=Network(6e563565-dc0c-4f19-9030-742bf28811d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac9af58-5f') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:55:42 user nova-compute[74850]: DEBUG os_vif [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:47:f6,bridge_name='br-int',has_traffic_filtering=True,id=eac9af58-5f10-4ea2-a8ef-fb93b63fa661,network=Network(6e563565-dc0c-4f19-9030-742bf28811d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac9af58-5f') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:55:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:55:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:55:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f2567595-9cc8-5de7-9fee-339db337223c', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:55:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:55:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeac9af58-5f, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:55:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeac9af58-5f, col_values=(('qos', UUID('49095c6c-212d-4d3c-8f33-402a6fb9acee')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:55:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeac9af58-5f, col_values=(('external_ids', {'iface-id': 'eac9af58-5f10-4ea2-a8ef-fb93b63fa661', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:47:f6', 'vm-uuid': '5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:55:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:55:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:42 user nova-compute[74850]: INFO os_vif [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:47:f6,bridge_name='br-int',has_traffic_filtering=True,id=eac9af58-5f10-4ea2-a8ef-fb93b63fa661,network=Network(6e563565-dc0c-4f19-9030-742bf28811d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac9af58-5f')
Nov 14 00:55:42 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:55:42 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:55:42 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] No VIF found with MAC fa:16:3e:7d:47:f6, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:55:42 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:55:42 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74850) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 00:55:43 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:43 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:43 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:43 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:44 user nova-compute[74850]: DEBUG nova.compute.manager [req-f562149e-c98d-4e0f-8403-b9efa7758c3f req-1a142c74-1f48-45cf-a83b-48176f21e309 service nova] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Received event network-vif-plugged-eac9af58-5f10-4ea2-a8ef-fb93b63fa661 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:55:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f562149e-c98d-4e0f-8403-b9efa7758c3f req-1a142c74-1f48-45cf-a83b-48176f21e309 service nova] Acquiring lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:55:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f562149e-c98d-4e0f-8403-b9efa7758c3f req-1a142c74-1f48-45cf-a83b-48176f21e309 service nova] Lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:55:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f562149e-c98d-4e0f-8403-b9efa7758c3f req-1a142c74-1f48-45cf-a83b-48176f21e309 service nova] Lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:55:44 user nova-compute[74850]: DEBUG nova.compute.manager [req-f562149e-c98d-4e0f-8403-b9efa7758c3f req-1a142c74-1f48-45cf-a83b-48176f21e309 service nova] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] No waiting events found dispatching network-vif-plugged-eac9af58-5f10-4ea2-a8ef-fb93b63fa661 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:55:44 user nova-compute[74850]: WARNING nova.compute.manager [req-f562149e-c98d-4e0f-8403-b9efa7758c3f req-1a142c74-1f48-45cf-a83b-48176f21e309 service nova] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Received unexpected event network-vif-plugged-eac9af58-5f10-4ea2-a8ef-fb93b63fa661 for instance with vm_state active and task_state rebuild_spawning.
Nov 14 00:55:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:45 user nova-compute[74850]: DEBUG nova.compute.manager [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:55:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 00:55:45 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Instance spawned successfully.
Nov 14 00:55:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 00:55:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:55:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:55:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:55:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:55:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:55:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:55:45 user nova-compute[74850]: DEBUG nova.compute.manager [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:55:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:55:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:55:46 user nova-compute[74850]: DEBUG nova.objects.instance [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74850) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 14 00:55:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ce6ba847-f51d-400d-bef2-c26336c07431 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.083s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:55:46 user nova-compute[74850]: DEBUG nova.compute.manager [req-3760d09d-e1c2-474c-be80-500df27fe930 req-493a7ab5-37b5-4769-8878-35a555f9d23f service nova] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Received event network-vif-plugged-eac9af58-5f10-4ea2-a8ef-fb93b63fa661 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:55:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3760d09d-e1c2-474c-be80-500df27fe930 req-493a7ab5-37b5-4769-8878-35a555f9d23f service nova] Acquiring lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:55:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3760d09d-e1c2-474c-be80-500df27fe930 req-493a7ab5-37b5-4769-8878-35a555f9d23f service nova] Lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:55:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3760d09d-e1c2-474c-be80-500df27fe930 req-493a7ab5-37b5-4769-8878-35a555f9d23f service nova] Lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:55:46 user nova-compute[74850]: DEBUG nova.compute.manager [req-3760d09d-e1c2-474c-be80-500df27fe930 req-493a7ab5-37b5-4769-8878-35a555f9d23f service nova] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] No waiting events found dispatching network-vif-plugged-eac9af58-5f10-4ea2-a8ef-fb93b63fa661 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:55:46 user nova-compute[74850]: WARNING nova.compute.manager [req-3760d09d-e1c2-474c-be80-500df27fe930 req-493a7ab5-37b5-4769-8878-35a555f9d23f service nova] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Received unexpected event network-vif-plugged-eac9af58-5f10-4ea2-a8ef-fb93b63fa661 for instance with vm_state active and task_state None.
Nov 14 00:55:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:47 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:55:49 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:55:49 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:55:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:55:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:55:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:55:49 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 00:55:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk (vdb) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:55:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:51 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:55:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:55:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json" returned: 0 in 0.452s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5f97ca6-ee09-4180-9beb-da65c2aead9b/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5f97ca6-ee09-4180-9beb-da65c2aead9b/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5f97ca6-ee09-4180-9beb-da65c2aead9b/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5f97ca6-ee09-4180-9beb-da65c2aead9b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:54 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:55:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:55:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:55:55 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:55:55 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:55:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=7355MB free_disk=24.981460571289062GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 00:55:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:55:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:55:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:55:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance a70d0196-f90e-47c4-be67-bf7ef4c3d8c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:55:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 1879be4c-9226-4c8c-a56c-f8e37398851b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:55:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 4b60ac08-e954-46d5-a280-a11146b3ebf4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:55:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance a62a2eab-2502-4275-948b-3f18c3fcff36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:55:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 748d0da7-bbb9-4e86-aae3-e48b1fa04c14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:55:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 4474ad0e-8eee-4db4-9896-50c049d45d26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:55:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 4f1102c5-f5ef-48d5-b271-6e25bee5cc70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:55:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 211c1477-8a76-4ecd-a7c8-dc0b5903d38c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:55:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance c7952bff-87d6-46c1-a6d4-7729dc4893ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:55:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:55:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 1f3a0b8f-1591-49c8-afb1-88437d65fb75 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:55:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance c5f97ca6-ee09-4180-9beb-da65c2aead9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:55:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 00:55:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 00:55:55 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:55:55 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:55:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 00:55:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.599s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:55:55 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:55:56 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:55:56 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:55:56 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 00:55:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "refresh_cache-748d0da7-bbb9-4e86-aae3-e48b1fa04c14" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:55:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquired lock "refresh_cache-748d0da7-bbb9-4e86-aae3-e48b1fa04c14" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:55:56 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Forcefully refreshing network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 00:55:57 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Updating instance_info_cache with network_info: [{"id": "11d8d21f-e53e-4277-a1d1-36e99c3bcd62", "address": "fa:16:3e:f2:d6:a0", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d8d21f-e5", "ovs_interfaceid": "11d8d21f-e53e-4277-a1d1-36e99c3bcd62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:55:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Releasing lock "refresh_cache-748d0da7-bbb9-4e86-aae3-e48b1fa04c14" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:55:57 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Updated the network info_cache for instance {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 00:55:57 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:55:57 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:55:57 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:55:57 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:55:57 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 00:55:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:03 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:56:03 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Cleaning up deleted instances {{(pid=74850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 00:56:03 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] There are 0 instances to clean {{(pid=74850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 00:56:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-8610216b-3ff2-4679-b3ce-1afc3c48db98 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Acquiring lock "4b60ac08-e954-46d5-a280-a11146b3ebf4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:56:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-8610216b-3ff2-4679-b3ce-1afc3c48db98 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lock "4b60ac08-e954-46d5-a280-a11146b3ebf4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:56:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-8610216b-3ff2-4679-b3ce-1afc3c48db98 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Acquiring lock "4b60ac08-e954-46d5-a280-a11146b3ebf4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:56:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-8610216b-3ff2-4679-b3ce-1afc3c48db98 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lock "4b60ac08-e954-46d5-a280-a11146b3ebf4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:56:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-8610216b-3ff2-4679-b3ce-1afc3c48db98 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lock "4b60ac08-e954-46d5-a280-a11146b3ebf4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:56:08 user nova-compute[74850]: INFO nova.compute.manager [None req-8610216b-3ff2-4679-b3ce-1afc3c48db98 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Terminating instance
Nov 14 00:56:08 user nova-compute[74850]: DEBUG nova.compute.manager [None req-8610216b-3ff2-4679-b3ce-1afc3c48db98 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 00:56:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:08 user nova-compute[74850]: DEBUG nova.compute.manager [req-01779471-ee1f-4a9b-896b-082b67a2f499 req-45203c29-751b-46a4-9bea-862cf80299c2 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Received event network-vif-unplugged-06e3d114-d80f-4634-840a-d4e120c77a88 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:56:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-01779471-ee1f-4a9b-896b-082b67a2f499 req-45203c29-751b-46a4-9bea-862cf80299c2 service nova] Acquiring lock "4b60ac08-e954-46d5-a280-a11146b3ebf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:56:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-01779471-ee1f-4a9b-896b-082b67a2f499 req-45203c29-751b-46a4-9bea-862cf80299c2 service nova] Lock "4b60ac08-e954-46d5-a280-a11146b3ebf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:56:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-01779471-ee1f-4a9b-896b-082b67a2f499 req-45203c29-751b-46a4-9bea-862cf80299c2 service nova] Lock "4b60ac08-e954-46d5-a280-a11146b3ebf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:56:08 user nova-compute[74850]: DEBUG nova.compute.manager [req-01779471-ee1f-4a9b-896b-082b67a2f499 req-45203c29-751b-46a4-9bea-862cf80299c2 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] No waiting events found dispatching network-vif-unplugged-06e3d114-d80f-4634-840a-d4e120c77a88 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:56:08 user nova-compute[74850]: DEBUG nova.compute.manager [req-01779471-ee1f-4a9b-896b-082b67a2f499 req-45203c29-751b-46a4-9bea-862cf80299c2 service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Received event network-vif-unplugged-06e3d114-d80f-4634-840a-d4e120c77a88 for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 00:56:09 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Instance destroyed successfully.
Nov 14 00:56:09 user nova-compute[74850]: DEBUG nova.objects.instance [None req-8610216b-3ff2-4679-b3ce-1afc3c48db98 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lazy-loading 'resources' on Instance uuid 4b60ac08-e954-46d5-a280-a11146b3ebf4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:56:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-8610216b-3ff2-4679-b3ce-1afc3c48db98 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-502986324',display_name='tempest-ServerStableDeviceRescueTest-server-502986324',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-502986324',id=18,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7DltpeR7TImMhiz+vzatLidyU5MCPKFXrwJ76ilV9bswy73VBpt9fNiyC6+uDzkOHbbKXSHJv4ktbAISFjmBLQtaWHTbA8NxX8MGw55IlShPGquLMCYgZgWN/gER1IGQ==',key_name='tempest-keypair-1374070990',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:53:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ed4742aedf24e90a866dd0a8692635e',ramdisk_id='',reservation_id='r-hyy4v5xs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1482343790',owner_user_name='tempest-ServerStableDeviceRescueTest-1482343790-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:54:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e945e1f8b6a4b269d54e0e8293b59e7',uuid=4b60ac08-e954-46d5-a280-a11146b3ebf4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06e3d114-d80f-4634-840a-d4e120c77a88", "address": "fa:16:3e:ef:7a:d7", "network": {"id": "a32d38d7-3a21-4c1b-886b-473c5cac50a4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-777089423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ed4742aedf24e90a866dd0a8692635e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e3d114-d8", "ovs_interfaceid": "06e3d114-d80f-4634-840a-d4e120c77a88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:56:09 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-8610216b-3ff2-4679-b3ce-1afc3c48db98 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Converting VIF {"id": "06e3d114-d80f-4634-840a-d4e120c77a88", "address": "fa:16:3e:ef:7a:d7", "network": {"id": "a32d38d7-3a21-4c1b-886b-473c5cac50a4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-777089423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ed4742aedf24e90a866dd0a8692635e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e3d114-d8", "ovs_interfaceid": "06e3d114-d80f-4634-840a-d4e120c77a88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:56:09 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-8610216b-3ff2-4679-b3ce-1afc3c48db98 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:7a:d7,bridge_name='br-int',has_traffic_filtering=True,id=06e3d114-d80f-4634-840a-d4e120c77a88,network=Network(a32d38d7-3a21-4c1b-886b-473c5cac50a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06e3d114-d8') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:56:09 user nova-compute[74850]: DEBUG os_vif [None req-8610216b-3ff2-4679-b3ce-1afc3c48db98 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:7a:d7,bridge_name='br-int',has_traffic_filtering=True,id=06e3d114-d80f-4634-840a-d4e120c77a88,network=Network(a32d38d7-3a21-4c1b-886b-473c5cac50a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06e3d114-d8') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:56:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06e3d114-d8, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:56:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:56:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0f2d5234-80f7-4d63-8e17-66b44bcd9b7b) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:56:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:09 user nova-compute[74850]: INFO os_vif [None req-8610216b-3ff2-4679-b3ce-1afc3c48db98 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:7a:d7,bridge_name='br-int',has_traffic_filtering=True,id=06e3d114-d80f-4634-840a-d4e120c77a88,network=Network(a32d38d7-3a21-4c1b-886b-473c5cac50a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06e3d114-d8')
Nov 14 00:56:09 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-8610216b-3ff2-4679-b3ce-1afc3c48db98 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Deleting instance files /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4_del
Nov 14 00:56:09 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-8610216b-3ff2-4679-b3ce-1afc3c48db98 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Deletion of /opt/stack/data/nova/instances/4b60ac08-e954-46d5-a280-a11146b3ebf4_del complete
Nov 14 00:56:09 user nova-compute[74850]: INFO nova.compute.manager [None req-8610216b-3ff2-4679-b3ce-1afc3c48db98 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 00:56:09 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-8610216b-3ff2-4679-b3ce-1afc3c48db98 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 00:56:09 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 00:56:09 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 00:56:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Acquiring lock "1f3a0b8f-1591-49c8-afb1-88437d65fb75" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:56:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lock "1f3a0b8f-1591-49c8-afb1-88437d65fb75" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:56:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Acquiring lock "1f3a0b8f-1591-49c8-afb1-88437d65fb75-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:56:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lock "1f3a0b8f-1591-49c8-afb1-88437d65fb75-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:56:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lock "1f3a0b8f-1591-49c8-afb1-88437d65fb75-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:56:10 user nova-compute[74850]: INFO nova.compute.manager [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Terminating instance
Nov 14 00:56:10 user nova-compute[74850]: DEBUG nova.compute.manager [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 00:56:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:10 user nova-compute[74850]: DEBUG nova.compute.manager [req-da06d0b6-6486-4246-a680-79a08daf4221 req-7034a899-d1d5-433b-8270-7c0b0952f05e service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Received event network-vif-plugged-06e3d114-d80f-4634-840a-d4e120c77a88 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:56:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-da06d0b6-6486-4246-a680-79a08daf4221 req-7034a899-d1d5-433b-8270-7c0b0952f05e service nova] Acquiring lock "4b60ac08-e954-46d5-a280-a11146b3ebf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:56:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-da06d0b6-6486-4246-a680-79a08daf4221 req-7034a899-d1d5-433b-8270-7c0b0952f05e service nova] Lock "4b60ac08-e954-46d5-a280-a11146b3ebf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:56:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-da06d0b6-6486-4246-a680-79a08daf4221 req-7034a899-d1d5-433b-8270-7c0b0952f05e service nova] Lock "4b60ac08-e954-46d5-a280-a11146b3ebf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:56:10 user nova-compute[74850]: DEBUG nova.compute.manager [req-da06d0b6-6486-4246-a680-79a08daf4221 req-7034a899-d1d5-433b-8270-7c0b0952f05e service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] No waiting events found dispatching network-vif-plugged-06e3d114-d80f-4634-840a-d4e120c77a88 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:56:10 user nova-compute[74850]: WARNING nova.compute.manager [req-da06d0b6-6486-4246-a680-79a08daf4221 req-7034a899-d1d5-433b-8270-7c0b0952f05e service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Received unexpected event network-vif-plugged-06e3d114-d80f-4634-840a-d4e120c77a88 for instance with vm_state active and task_state deleting.
Nov 14 00:56:10 user nova-compute[74850]: DEBUG nova.compute.manager [req-da06d0b6-6486-4246-a680-79a08daf4221 req-7034a899-d1d5-433b-8270-7c0b0952f05e service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Received event network-changed-b3afdbc0-4840-47bb-b5f9-71944340f04b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:56:10 user nova-compute[74850]: DEBUG nova.compute.manager [req-da06d0b6-6486-4246-a680-79a08daf4221 req-7034a899-d1d5-433b-8270-7c0b0952f05e service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Refreshing instance network info cache due to event network-changed-b3afdbc0-4840-47bb-b5f9-71944340f04b. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:56:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-da06d0b6-6486-4246-a680-79a08daf4221 req-7034a899-d1d5-433b-8270-7c0b0952f05e service nova] Acquiring lock "refresh_cache-1f3a0b8f-1591-49c8-afb1-88437d65fb75" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:56:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-da06d0b6-6486-4246-a680-79a08daf4221 req-7034a899-d1d5-433b-8270-7c0b0952f05e service nova] Acquired lock "refresh_cache-1f3a0b8f-1591-49c8-afb1-88437d65fb75" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:56:10 user nova-compute[74850]: DEBUG nova.network.neutron [req-da06d0b6-6486-4246-a680-79a08daf4221 req-7034a899-d1d5-433b-8270-7c0b0952f05e service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Refreshing network info cache for port b3afdbc0-4840-47bb-b5f9-71944340f04b {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:56:10 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:56:10 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Took 1.55 seconds to deallocate network for instance.
Nov 14 00:56:10 user nova-compute[74850]: DEBUG nova.compute.manager [req-4dc0f8ce-6f26-40f4-8125-151f513989c6 req-f8ed0bee-db03-4376-8869-8a91348961af service nova] [instance: 4b60ac08-e954-46d5-a280-a11146b3ebf4] Received event network-vif-deleted-06e3d114-d80f-4634-840a-d4e120c77a88 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:56:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-8610216b-3ff2-4679-b3ce-1afc3c48db98 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:56:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-8610216b-3ff2-4679-b3ce-1afc3c48db98 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-8610216b-3ff2-4679-b3ce-1afc3c48db98 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-8610216b-3ff2-4679-b3ce-1afc3c48db98 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG nova.network.neutron [req-da06d0b6-6486-4246-a680-79a08daf4221 req-7034a899-d1d5-433b-8270-7c0b0952f05e service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Updated VIF entry in instance network info cache for port b3afdbc0-4840-47bb-b5f9-71944340f04b. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG nova.network.neutron [req-da06d0b6-6486-4246-a680-79a08daf4221 req-7034a899-d1d5-433b-8270-7c0b0952f05e service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Updating instance_info_cache with network_info: [{"id": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "address": "fa:16:3e:a9:ef:9b", "network": {"id": "d7fe6bb8-ec3e-4bc8-9afe-161897a805b0", "bridge": "br-int", "label": "tempest-TestShelveInstance-236791102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d04a48df2b1c42f4a0a8826c66357f28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3afdbc0-48", "ovs_interfaceid": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-da06d0b6-6486-4246-a680-79a08daf4221 req-7034a899-d1d5-433b-8270-7c0b0952f05e service nova] Releasing lock "refresh_cache-1f3a0b8f-1591-49c8-afb1-88437d65fb75" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-8610216b-3ff2-4679-b3ce-1afc3c48db98 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.386s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:56:11 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Instance destroyed successfully.
Nov 14 00:56:11 user nova-compute[74850]: DEBUG nova.objects.instance [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lazy-loading 'resources' on Instance uuid 1f3a0b8f-1591-49c8-afb1-88437d65fb75 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:56:11 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-8610216b-3ff2-4679-b3ce-1afc3c48db98 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Deleted allocations for instance 4b60ac08-e954-46d5-a280-a11146b3ebf4
Nov 14 00:56:11 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T00:50:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-999057832',display_name='tempest-TestShelveInstance-server-999057832',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-999057832',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPe2MCunpaIWCOf138MPN4AN0ndS8NEmSmQgzRt5Y5fsb9WbIXubhh1yAaf/vbnkIZksktAFNFaWcv6Px9mLlE23DucapJ22iB3KR+pjspwx/iLSs3EpKTn1M7OrESAuKg==',key_name='tempest-TestShelveInstance-2033278270',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:54:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d04a48df2b1c42f4a0a8826c66357f28',ramdisk_id='',reservation_id='r-cuownc8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1921981995',owner_user_name='tempest-TestShelveInstance-1921981995-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:54:31Z,user_data=None,user_id='5a8ca83acba64f15bd10d275fd053475',uuid=1f3a0b8f-1591-49c8-afb1-88437d65fb75,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "address": "fa:16:3e:a9:ef:9b", "network": {"id": "d7fe6bb8-ec3e-4bc8-9afe-161897a805b0", "bridge": "br-int", "label": "tempest-TestShelveInstance-236791102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d04a48df2b1c42f4a0a8826c66357f28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3afdbc0-48", "ovs_interfaceid": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Converting VIF {"id": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "address": "fa:16:3e:a9:ef:9b", "network": {"id": "d7fe6bb8-ec3e-4bc8-9afe-161897a805b0", "bridge": "br-int", "label": "tempest-TestShelveInstance-236791102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d04a48df2b1c42f4a0a8826c66357f28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3afdbc0-48", "ovs_interfaceid": "b3afdbc0-4840-47bb-b5f9-71944340f04b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:ef:9b,bridge_name='br-int',has_traffic_filtering=True,id=b3afdbc0-4840-47bb-b5f9-71944340f04b,network=Network(d7fe6bb8-ec3e-4bc8-9afe-161897a805b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3afdbc0-48') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG os_vif [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:ef:9b,bridge_name='br-int',has_traffic_filtering=True,id=b3afdbc0-4840-47bb-b5f9-71944340f04b,network=Network(d7fe6bb8-ec3e-4bc8-9afe-161897a805b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3afdbc0-48') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3afdbc0-48, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=752cb6ea-15fa-4a9b-9ecb-68b16e4af015) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:56:11 user nova-compute[74850]: INFO os_vif [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:ef:9b,bridge_name='br-int',has_traffic_filtering=True,id=b3afdbc0-4840-47bb-b5f9-71944340f04b,network=Network(d7fe6bb8-ec3e-4bc8-9afe-161897a805b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3afdbc0-48')
Nov 14 00:56:11 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pEVTGKrm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:56:11 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:56:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2750c29-a3b6-4bfd-b0ae-70552928cf49]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 00:56:11 user nova-compute[74850]: No targets found.
Nov 14 00:56:11 user nova-compute[74850]: iSNS:
Nov 14 00:56:11 user nova-compute[74850]: No targets found.
Nov 14 00:56:11 user nova-compute[74850]: STATIC:
Nov 14 00:56:11 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a
Nov 14 00:56:11 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:56:11 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:56:11 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf
Nov 14 00:56:11 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:56:11 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:56:11 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390
Nov 14 00:56:11 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:56:11 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:56:11 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0
Nov 14 00:56:11 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:56:11 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:56:11 user nova-compute[74850]: FIRMWARE:
Nov 14 00:56:11 user nova-compute[74850]: No targets found.
Nov 14 00:56:11 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 00:56:11 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 00:56:11 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2562e93c-ec3d-483d-9911-bd8336c3fd20]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-8610216b-3ff2-4679-b3ce-1afc3c48db98 tempest-ServerStableDeviceRescueTest-1482343790 tempest-ServerStableDeviceRescueTest-1482343790-project-member] Lock "4b60ac08-e954-46d5-a280-a11146b3ebf4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.019s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb644b9-3c5c-4b5d-ac4b-17dcf18b695a]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:56:11 user nova-compute[74850]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:56:11 user nova-compute[74850]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:56:11 user nova-compute[74850]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 (non-flash)
Nov 14 00:56:11 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 (non-flash)
Nov 14 00:56:11 user nova-compute[74850]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:56:11 user nova-compute[74850]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:56:11 user nova-compute[74850]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 (non-flash)
Nov 14 00:56:11 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a5c3ab010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390'): ({'sdd'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Removing single pathed devices sdd {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0264774f-e083-402e-bd00-06dbf644126b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b576ba-ddf6-4c14-a519-d27041e376f5]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Flushing IO for device /dev/sdd {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[07575ec0-9b30-4718-9027-40c8720f9fb8]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de4a295-f26f-47dd-9c24-3af7b71d95f6]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] SCSI volumes sdd have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_7022f512', '/dev/disk/by-id/scsi-1SCST_BIO7022f512-ea56a2efcefdd0bd', '/dev/disk/by-id/scsi-26561353661326566') {{(pid=84948) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[043f468b-6258-4eff-9287-ecff4629f6ee]: (4, None) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9e6bce-bdd0-43d5-9a7d-5fe0d2931e9b]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[011d9ff7-bb02-4030-8b4d-5f12801ba26e]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390, portal: 172.16.0.220,3260]
Nov 14 00:56:11 user nova-compute[74850]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390, portal: 172.16.0.220,3260] successful.
Nov 14 00:56:11 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e558166b-85d2-4742-ac34-c2ee02202390 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b76dfd8-9a32-47b3-a473-99a5b6320227]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] <== disconnect_volume: return (325ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 00:56:11 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Deleting instance files /opt/stack/data/nova/instances/1f3a0b8f-1591-49c8-afb1-88437d65fb75_del
Nov 14 00:56:11 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Deletion of /opt/stack/data/nova/instances/1f3a0b8f-1591-49c8-afb1-88437d65fb75_del complete
Nov 14 00:56:11 user nova-compute[74850]: INFO nova.compute.manager [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 14 00:56:11 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 00:56:11 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 00:56:12 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:56:12 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Took 0.45 seconds to deallocate network for instance.
Nov 14 00:56:12 user nova-compute[74850]: DEBUG nova.compute.manager [req-6d00a658-458a-4265-9b4b-cc45a14c080c req-5aa0af34-5883-4b98-8b59-b099b893704b service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Received event network-vif-unplugged-b3afdbc0-4840-47bb-b5f9-71944340f04b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:56:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6d00a658-458a-4265-9b4b-cc45a14c080c req-5aa0af34-5883-4b98-8b59-b099b893704b service nova] Acquiring lock "1f3a0b8f-1591-49c8-afb1-88437d65fb75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:56:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6d00a658-458a-4265-9b4b-cc45a14c080c req-5aa0af34-5883-4b98-8b59-b099b893704b service nova] Lock "1f3a0b8f-1591-49c8-afb1-88437d65fb75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:56:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6d00a658-458a-4265-9b4b-cc45a14c080c req-5aa0af34-5883-4b98-8b59-b099b893704b service nova] Lock "1f3a0b8f-1591-49c8-afb1-88437d65fb75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:56:12 user nova-compute[74850]: DEBUG nova.compute.manager [req-6d00a658-458a-4265-9b4b-cc45a14c080c req-5aa0af34-5883-4b98-8b59-b099b893704b service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] No waiting events found dispatching network-vif-unplugged-b3afdbc0-4840-47bb-b5f9-71944340f04b {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:56:12 user nova-compute[74850]: DEBUG nova.compute.manager [req-6d00a658-458a-4265-9b4b-cc45a14c080c req-5aa0af34-5883-4b98-8b59-b099b893704b service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Received event network-vif-unplugged-b3afdbc0-4840-47bb-b5f9-71944340f04b for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 00:56:12 user nova-compute[74850]: DEBUG nova.compute.manager [req-6d00a658-458a-4265-9b4b-cc45a14c080c req-5aa0af34-5883-4b98-8b59-b099b893704b service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Received event network-vif-plugged-b3afdbc0-4840-47bb-b5f9-71944340f04b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:56:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6d00a658-458a-4265-9b4b-cc45a14c080c req-5aa0af34-5883-4b98-8b59-b099b893704b service nova] Acquiring lock "1f3a0b8f-1591-49c8-afb1-88437d65fb75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:56:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6d00a658-458a-4265-9b4b-cc45a14c080c req-5aa0af34-5883-4b98-8b59-b099b893704b service nova] Lock "1f3a0b8f-1591-49c8-afb1-88437d65fb75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:56:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6d00a658-458a-4265-9b4b-cc45a14c080c req-5aa0af34-5883-4b98-8b59-b099b893704b service nova] Lock "1f3a0b8f-1591-49c8-afb1-88437d65fb75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:56:12 user nova-compute[74850]: DEBUG nova.compute.manager [req-6d00a658-458a-4265-9b4b-cc45a14c080c req-5aa0af34-5883-4b98-8b59-b099b893704b service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] No waiting events found dispatching network-vif-plugged-b3afdbc0-4840-47bb-b5f9-71944340f04b {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:56:12 user nova-compute[74850]: WARNING nova.compute.manager [req-6d00a658-458a-4265-9b4b-cc45a14c080c req-5aa0af34-5883-4b98-8b59-b099b893704b service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Received unexpected event network-vif-plugged-b3afdbc0-4840-47bb-b5f9-71944340f04b for instance with vm_state active and task_state deleting.
Nov 14 00:56:12 user nova-compute[74850]: DEBUG nova.compute.manager [req-d25d7942-9c92-4bc4-adfe-8bdb0f45f5db req-a7ad3f4d-9b1e-46c0-9662-a7d633fa075d service nova] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Received event network-vif-deleted-b3afdbc0-4840-47bb-b5f9-71944340f04b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:56:12 user nova-compute[74850]: INFO nova.compute.manager [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Took 0.72 seconds to detach 1 volumes for instance.
Nov 14 00:56:12 user nova-compute[74850]: DEBUG nova.compute.manager [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] [instance: 1f3a0b8f-1591-49c8-afb1-88437d65fb75] Deleting volume: e558166b-85d2-4742-ac34-c2ee02202390 {{(pid=74850) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 00:56:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:56:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:56:13 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:56:13 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:56:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.459s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:56:13 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Deleted allocations for instance 1f3a0b8f-1591-49c8-afb1-88437d65fb75
Nov 14 00:56:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-3943818a-2c4d-4cb7-bd84-0de7eb2a220c tempest-TestShelveInstance-1921981995 tempest-TestShelveInstance-1921981995-project-member] Lock "1f3a0b8f-1591-49c8-afb1-88437d65fb75" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.157s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:56:15 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:56:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "702746f7-305f-4eac-a71a-6c08b7cbccd8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:56:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "702746f7-305f-4eac-a71a-6c08b7cbccd8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:56:31 user nova-compute[74850]: DEBUG nova.compute.manager [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 00:56:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:56:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:56:32 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 00:56:32 user nova-compute[74850]: INFO nova.compute.claims [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Claim successful on node user
Nov 14 00:56:32 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:56:32 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:56:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.428s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:56:32 user nova-compute[74850]: DEBUG nova.compute.manager [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 00:56:32 user nova-compute[74850]: DEBUG nova.compute.manager [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 00:56:32 user nova-compute[74850]: DEBUG nova.network.neutron [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 00:56:32 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 00:56:32 user nova-compute[74850]: DEBUG nova.compute.manager [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 00:56:32 user nova-compute[74850]: INFO nova.virt.block_device [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Booting with blank volume at /dev/vda
Nov 14 00:56:32 user nova-compute[74850]: DEBUG nova.policy [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a5bb5d788a3b4871ae41f57d06f785f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491aa2a4f38140788cb0de9762a8baf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 00:56:33 user nova-compute[74850]: DEBUG nova.network.neutron [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Successfully created port: 39232b36-eca6-4dac-880c-43aafa9f1719 {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:56:33 user nova-compute[74850]: DEBUG nova.network.neutron [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Successfully updated port: 39232b36-eca6-4dac-880c-43aafa9f1719 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:56:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "refresh_cache-702746f7-305f-4eac-a71a-6c08b7cbccd8" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:56:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquired lock "refresh_cache-702746f7-305f-4eac-a71a-6c08b7cbccd8" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:56:33 user nova-compute[74850]: DEBUG nova.network.neutron [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:56:33 user nova-compute[74850]: DEBUG nova.compute.manager [req-783f7bbd-d38f-462d-bef8-8d83dd3652be req-ed926880-f735-47ea-851c-967088aff79f service nova] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Received event network-changed-39232b36-eca6-4dac-880c-43aafa9f1719 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:56:33 user nova-compute[74850]: DEBUG nova.compute.manager [req-783f7bbd-d38f-462d-bef8-8d83dd3652be req-ed926880-f735-47ea-851c-967088aff79f service nova] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Refreshing instance network info cache due to event network-changed-39232b36-eca6-4dac-880c-43aafa9f1719. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:56:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-783f7bbd-d38f-462d-bef8-8d83dd3652be req-ed926880-f735-47ea-851c-967088aff79f service nova] Acquiring lock "refresh_cache-702746f7-305f-4eac-a71a-6c08b7cbccd8" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:56:33 user nova-compute[74850]: DEBUG nova.network.neutron [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:56:34 user nova-compute[74850]: DEBUG nova.network.neutron [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Updating instance_info_cache with network_info: [{"id": "39232b36-eca6-4dac-880c-43aafa9f1719", "address": "fa:16:3e:ac:57:e7", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39232b36-ec", "ovs_interfaceid": "39232b36-eca6-4dac-880c-43aafa9f1719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:56:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Releasing lock "refresh_cache-702746f7-305f-4eac-a71a-6c08b7cbccd8" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:56:34 user nova-compute[74850]: DEBUG nova.compute.manager [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Instance network_info: |[{"id": "39232b36-eca6-4dac-880c-43aafa9f1719", "address": "fa:16:3e:ac:57:e7", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39232b36-ec", "ovs_interfaceid": "39232b36-eca6-4dac-880c-43aafa9f1719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 00:56:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-783f7bbd-d38f-462d-bef8-8d83dd3652be req-ed926880-f735-47ea-851c-967088aff79f service nova] Acquired lock "refresh_cache-702746f7-305f-4eac-a71a-6c08b7cbccd8" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:56:34 user nova-compute[74850]: DEBUG nova.network.neutron [req-783f7bbd-d38f-462d-bef8-8d83dd3652be req-ed926880-f735-47ea-851c-967088aff79f service nova] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Refreshing network info cache for port 39232b36-eca6-4dac-880c-43aafa9f1719 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:56:34 user nova-compute[74850]: DEBUG nova.network.neutron [req-783f7bbd-d38f-462d-bef8-8d83dd3652be req-ed926880-f735-47ea-851c-967088aff79f service nova] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Updated VIF entry in instance network info cache for port 39232b36-eca6-4dac-880c-43aafa9f1719. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:56:34 user nova-compute[74850]: DEBUG nova.network.neutron [req-783f7bbd-d38f-462d-bef8-8d83dd3652be req-ed926880-f735-47ea-851c-967088aff79f service nova] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Updating instance_info_cache with network_info: [{"id": "39232b36-eca6-4dac-880c-43aafa9f1719", "address": "fa:16:3e:ac:57:e7", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39232b36-ec", "ovs_interfaceid": "39232b36-eca6-4dac-880c-43aafa9f1719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:56:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-783f7bbd-d38f-462d-bef8-8d83dd3652be req-ed926880-f735-47ea-851c-967088aff79f service nova] Releasing lock "refresh_cache-702746f7-305f-4eac-a71a-6c08b7cbccd8" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:56:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:56:38 user nova-compute[74850]: DEBUG os_brick.utils [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:56:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91ced95-3315-4bce-9acc-d2011cd394c4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ca57c4-1cc4-4336-af91-ed21f53cb691]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9378fc-0124-413f-90d7-d0f63a77857a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[418f64b8-f51a-441c-a2a9-57724f5f581a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:56:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 00:56:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:56:38 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 00:56:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e73c51-ebcc-4e67-9240-4bb4c3ac9297]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 00:56:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 00:56:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 00:56:38 user nova-compute[74850]: DEBUG os_brick.utils [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:56:38 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Updating existing volume attachment record: c26b97ea-bc13-4e2b-a65f-ebacf4d44ddc {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 00:56:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:40 user nova-compute[74850]: DEBUG nova.compute.manager [req-63d495ee-78e5-48cf-87b3-3a8745915f9e req-23aa8a38-09eb-4e90-a373-bba346c435f6 service nova] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Received event network-changed-1f60b107-fed3-4884-be05-f9c39313b71d {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:56:40 user nova-compute[74850]: DEBUG nova.compute.manager [req-63d495ee-78e5-48cf-87b3-3a8745915f9e req-23aa8a38-09eb-4e90-a373-bba346c435f6 service nova] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Refreshing instance network info cache due to event network-changed-1f60b107-fed3-4884-be05-f9c39313b71d. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:56:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-63d495ee-78e5-48cf-87b3-3a8745915f9e req-23aa8a38-09eb-4e90-a373-bba346c435f6 service nova] Acquiring lock "refresh_cache-c5f97ca6-ee09-4180-9beb-da65c2aead9b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:56:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-63d495ee-78e5-48cf-87b3-3a8745915f9e req-23aa8a38-09eb-4e90-a373-bba346c435f6 service nova] Acquired lock "refresh_cache-c5f97ca6-ee09-4180-9beb-da65c2aead9b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:56:40 user nova-compute[74850]: DEBUG nova.network.neutron [req-63d495ee-78e5-48cf-87b3-3a8745915f9e req-23aa8a38-09eb-4e90-a373-bba346c435f6 service nova] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Refreshing network info cache for port 1f60b107-fed3-4884-be05-f9c39313b71d {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:56:40 user nova-compute[74850]: DEBUG nova.network.neutron [req-63d495ee-78e5-48cf-87b3-3a8745915f9e req-23aa8a38-09eb-4e90-a373-bba346c435f6 service nova] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Updated VIF entry in instance network info cache for port 1f60b107-fed3-4884-be05-f9c39313b71d. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:56:40 user nova-compute[74850]: DEBUG nova.network.neutron [req-63d495ee-78e5-48cf-87b3-3a8745915f9e req-23aa8a38-09eb-4e90-a373-bba346c435f6 service nova] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Updating instance_info_cache with network_info: [{"id": "1f60b107-fed3-4884-be05-f9c39313b71d", "address": "fa:16:3e:27:57:ed", "network": {"id": "b096d728-1246-4eaa-9222-ed8eee74870c", "bridge": "br-int", "label": "tempest-TestStampPattern-1207618832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e17bbd82f843fdaa3c48d8cb64a2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f60b107-fe", "ovs_interfaceid": "1f60b107-fed3-4884-be05-f9c39313b71d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:56:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-63d495ee-78e5-48cf-87b3-3a8745915f9e req-23aa8a38-09eb-4e90-a373-bba346c435f6 service nova] Releasing lock "refresh_cache-c5f97ca6-ee09-4180-9beb-da65c2aead9b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:56:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Acquiring lock "c5f97ca6-ee09-4180-9beb-da65c2aead9b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:56:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "c5f97ca6-ee09-4180-9beb-da65c2aead9b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:56:41 user nova-compute[74850]: DEBUG nova.objects.instance [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lazy-loading 'flavor' on Instance uuid c5f97ca6-ee09-4180-9beb-da65c2aead9b {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:56:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "c5f97ca6-ee09-4180-9beb-da65c2aead9b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:56:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Acquiring lock "c5f97ca6-ee09-4180-9beb-da65c2aead9b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:56:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "c5f97ca6-ee09-4180-9beb-da65c2aead9b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:56:41 user nova-compute[74850]: INFO nova.compute.manager [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Attaching volume 86d7d196-db62-44f0-ba1a-8031f61db2d9 to /dev/vdb
Nov 14 00:56:41 user nova-compute[74850]: DEBUG os_brick.utils [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:56:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:41 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1deb4d32-4eee-4e0e-ad45-975ab1ebc399]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:41 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9669844d-3290-430c-b643-91c41cf28406]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:41 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2184805-1063-45b9-80fb-98d2e902d2d8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:41 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46c770e-96c3-4bd3-b4f4-3fff6da468e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:56:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 00:56:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:56:41 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 00:56:41 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7785074c-003c-4ffc-843b-0bd000abceb3]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 00:56:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 00:56:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 00:56:41 user nova-compute[74850]: DEBUG os_brick.utils [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:56:41 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Updating existing volume attachment record: ff136a30-15ec-49f8-abda-7a8097e61df9 {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 00:56:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TAuqnlba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:56:46 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:56:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:56:46 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:56:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:56:46 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 00:56:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9 -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[969b6ed9-6780-4829-88bb-d990099458cd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 00:56:46 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b81a8f-b997-461c-95a9-8e1190cc28d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9] added
Nov 14 00:56:46 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ee81df-b6ce-40b3-96de-c53a1be97ca3]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25a367d-57d9-440e-9223-e92825325368]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TAuqnlba {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG nova.compute.manager [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 00:56:46 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Creating image(s)
Nov 14 00:56:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Did not create local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Ensure instance console log exists: /opt/stack/data/nova/instances/702746f7-305f-4eac-a71a-6c08b7cbccd8/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Start _get_guest_xml network_info=[{"id": "39232b36-eca6-4dac-880c-43aafa9f1719", "address": "fa:16:3e:ac:57:e7", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39232b36-ec", "ovs_interfaceid": "39232b36-eca6-4dac-880c-43aafa9f1719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c26b97ea-bc13-4e2b-a65f-ebacf4d44ddc', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VeutpWAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '702746f7-305f-4eac-a71a-6c08b7cbccd8', 'attached_at': '', 'detached_at': '', 'volume_id': '83caba72-44f3-43f9-a484-d9f730b0b65d', 'serial': '83caba72-44f3-43f9-a484-d9f730b0b65d'}, 'volume_type': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TAuqnlba" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd4b2ee-6aa5-4ae9-9aef-d625c25de4a5]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TAuqnlba'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:46 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:56:46 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:56:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VeutpWAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:56:46 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:56:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05ff5ab-3114-4bea-8b15-4225d9174d22]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[598b40a6-c982-4122-b6bf-2a6f90645a81]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:56:46 user nova-compute[74850]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:56:46 user nova-compute[74850]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 (non-flash)
Nov 14 00:56:46 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:56:46 user nova-compute[74850]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:56:46 user nova-compute[74850]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 (non-flash)
Nov 14 00:56:46 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:56:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9 -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:47 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[064be4bc-0183-4e57-ba40-a56e6630de25]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:47 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9, portal: 172.16.0.220,3260]
Nov 14 00:56:47 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9, portal: 172.16.0.220,3260] successful.
Nov 14 00:56:47 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:56:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:47 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03a992a-6c9f-43f0-a600-05956f26cbf2]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:47 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:56:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:47 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14a67fc-819f-4e4b-afce-0a6b961fb5f4]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:47 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:56:47 user nova-compute[74850]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:56:47 user nova-compute[74850]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 (non-flash)
Nov 14 00:56:47 user nova-compute[74850]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9 (non-flash)
Nov 14 00:56:47 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:56:47 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:56:47 user nova-compute[74850]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:56:47 user nova-compute[74850]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 (non-flash)
Nov 14 00:56:47 user nova-compute[74850]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9 (non-flash)
Nov 14 00:56:47 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:56:47 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:56:47 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 00:56:47 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 00:56:47 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 00:56:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:47 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1927d6d9-8757-42cf-8be1-f917f30f08b0]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:47 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:56:47 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TAuqnlba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 00:56:47 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23936396137363863', 'path': '/dev/sdd'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936396137363863', 'path': '/dev/sdd'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.171s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:56:48 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:56:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:56:48 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 00:56:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG nova.objects.instance [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lazy-loading 'flavor' on Instance uuid c5f97ca6-ee09-4180-9beb-da65c2aead9b {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[912dd9c6-c05c-4011-8b35-1a2f03f91f31]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 00:56:48 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 00:56:48 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:56:48 user nova-compute[74850]:   <source dev="/dev/sdd"/>
Nov 14 00:56:48 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:56:48 user nova-compute[74850]:   <serial>86d7d196-db62-44f0-ba1a-8031f61db2d9</serial>
Nov 14 00:56:48 user nova-compute[74850]: </disk>
Nov 14 00:56:48 user nova-compute[74850]:  {{(pid=74850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ffbcaa-8c55-4365-8b6d-458cfb183639]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d] added
Nov 14 00:56:48 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c62881-98b4-4c71-bfd7-d4dac29f35b5]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa4353a-e57a-43a6-a563-1a70c719c864]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VeutpWAx {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VeutpWAx" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae4ddff-6a86-4cb2-8328-042da6fbdf57]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VeutpWAx'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[921ca39f-54cd-43a1-a2f1-147a964b94b2]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f26458-3d5a-40da-b2a0-c66a521b8482]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:56:48 user nova-compute[74850]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:56:48 user nova-compute[74850]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 (non-flash)
Nov 14 00:56:48 user nova-compute[74850]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9 (non-flash)
Nov 14 00:56:48 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:56:48 user nova-compute[74850]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:56:48 user nova-compute[74850]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 (non-flash)
Nov 14 00:56:48 user nova-compute[74850]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9 (non-flash)
Nov 14 00:56:48 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd230a3-1750-4537-87bc-6c1dda595ddc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d, portal: 172.16.0.220,3260]
Nov 14 00:56:48 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d, portal: 172.16.0.220,3260] successful.
Nov 14 00:56:48 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[625c0ae0-d39c-4463-bf74-9c734ab73d29]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14258c7-7b70-4aec-b464-30c309128df5]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:56:48 user nova-compute[74850]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:56:48 user nova-compute[74850]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 (non-flash)
Nov 14 00:56:48 user nova-compute[74850]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9 (non-flash)
Nov 14 00:56:48 user nova-compute[74850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 00:56:48 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:56:48 user nova-compute[74850]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:56:48 user nova-compute[74850]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 (non-flash)
Nov 14 00:56:48 user nova-compute[74850]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9 (non-flash)
Nov 14 00:56:48 user nova-compute[74850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 00:56:48 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] HCTL ('37', '-', '-', 0) found on session 32 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8093ed40-98fa-4783-a242-80aec75e933c]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: None {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] No VIF found with MAC fa:16:3e:27:57:ed, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:56:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b8575ca3-d074-451e-89e2-6c9c60b8a03f tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "c5f97ca6-ee09-4180-9beb-da65c2aead9b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.451s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:56:49 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:56:49 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VeutpWAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 00:56:49 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:56:49 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] <== connect_volume: return (2477ms) {'type': 'block', 'scsi_wwn': '23739386536623036', 'path': '/dev/sdf'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:56:49 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739386536623036', 'path': '/dev/sdf'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 00:56:49 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:56:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-829621186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-829621186',id=29,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='491aa2a4f38140788cb0de9762a8baf4',ramdisk_id='',reservation_id='r-tiybmuy9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-726213232',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:56:33Z,user_data=None,user_id='a5bb5d788a3b4871ae41f57d06f785f2',uuid=702746f7-305f-4eac-a71a-6c08b7cbccd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39232b36-eca6-4dac-880c-43aafa9f1719", "address": "fa:16:3e:ac:57:e7", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39232b36-ec", "ovs_interfaceid": "39232b36-eca6-4dac-880c-43aafa9f1719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:56:49 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Converting VIF {"id": "39232b36-eca6-4dac-880c-43aafa9f1719", "address": "fa:16:3e:ac:57:e7", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39232b36-ec", "ovs_interfaceid": "39232b36-eca6-4dac-880c-43aafa9f1719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:56:49 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:57:e7,bridge_name='br-int',has_traffic_filtering=True,id=39232b36-eca6-4dac-880c-43aafa9f1719,network=Network(6f8f66ca-e2e8-4565-a05c-df75a16699ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39232b36-ec') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:56:49 user nova-compute[74850]: DEBUG nova.objects.instance [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lazy-loading 'pci_devices' on Instance uuid 702746f7-305f-4eac-a71a-6c08b7cbccd8 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:56:49 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:56:49 user nova-compute[74850]:   <uuid>702746f7-305f-4eac-a71a-6c08b7cbccd8</uuid>
Nov 14 00:56:49 user nova-compute[74850]:   <name>instance-0000001d</name>
Nov 14 00:56:49 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:56:49 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:56:49 user nova-compute[74850]:   <metadata>
Nov 14 00:56:49 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:56:49 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:56:49 user nova-compute[74850]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-829621186</nova:name>
Nov 14 00:56:49 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:56:46</nova:creationTime>
Nov 14 00:56:49 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:56:49 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:56:49 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:56:49 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:56:49 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:56:49 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:56:49 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:56:49 user nova-compute[74850]:       <nova:owner>
Nov 14 00:56:49 user nova-compute[74850]:         <nova:user uuid="a5bb5d788a3b4871ae41f57d06f785f2">tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member</nova:user>
Nov 14 00:56:49 user nova-compute[74850]:         <nova:project uuid="491aa2a4f38140788cb0de9762a8baf4">tempest-ServerBootFromVolumeStableRescueTest-726213232</nova:project>
Nov 14 00:56:49 user nova-compute[74850]:       </nova:owner>
Nov 14 00:56:49 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:56:49 user nova-compute[74850]:       <nova:ports>
Nov 14 00:56:49 user nova-compute[74850]:         <nova:port uuid="39232b36-eca6-4dac-880c-43aafa9f1719">
Nov 14 00:56:49 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 00:56:49 user nova-compute[74850]:         </nova:port>
Nov 14 00:56:49 user nova-compute[74850]:       </nova:ports>
Nov 14 00:56:49 user nova-compute[74850]:     </nova:instance>
Nov 14 00:56:49 user nova-compute[74850]:   </metadata>
Nov 14 00:56:49 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:56:49 user nova-compute[74850]:     <system>
Nov 14 00:56:49 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:56:49 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:56:49 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:56:49 user nova-compute[74850]:       <entry name="serial">702746f7-305f-4eac-a71a-6c08b7cbccd8</entry>
Nov 14 00:56:49 user nova-compute[74850]:       <entry name="uuid">702746f7-305f-4eac-a71a-6c08b7cbccd8</entry>
Nov 14 00:56:49 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:56:49 user nova-compute[74850]:     </system>
Nov 14 00:56:49 user nova-compute[74850]:   </sysinfo>
Nov 14 00:56:49 user nova-compute[74850]:   <os>
Nov 14 00:56:49 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:56:49 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 00:56:49 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:56:49 user nova-compute[74850]:   </os>
Nov 14 00:56:49 user nova-compute[74850]:   <features>
Nov 14 00:56:49 user nova-compute[74850]:     <acpi/>
Nov 14 00:56:49 user nova-compute[74850]:     <apic/>
Nov 14 00:56:49 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:56:49 user nova-compute[74850]:   </features>
Nov 14 00:56:49 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:56:49 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:56:49 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:56:49 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:56:49 user nova-compute[74850]:   </clock>
Nov 14 00:56:49 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:56:49 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:56:49 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:56:49 user nova-compute[74850]:   </cpu>
Nov 14 00:56:49 user nova-compute[74850]:   <devices>
Nov 14 00:56:49 user nova-compute[74850]:     <disk type="block" device="disk">
Nov 14 00:56:49 user nova-compute[74850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:56:49 user nova-compute[74850]:       <source dev="/dev/sdf"/>
Nov 14 00:56:49 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:56:49 user nova-compute[74850]:       <serial>83caba72-44f3-43f9-a484-d9f730b0b65d</serial>
Nov 14 00:56:49 user nova-compute[74850]:     </disk>
Nov 14 00:56:49 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:56:49 user nova-compute[74850]:       <mac address="fa:16:3e:ac:57:e7"/>
Nov 14 00:56:49 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:56:49 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:56:49 user nova-compute[74850]:       <target dev="tap39232b36-ec"/>
Nov 14 00:56:49 user nova-compute[74850]:     </interface>
Nov 14 00:56:49 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:56:49 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/702746f7-305f-4eac-a71a-6c08b7cbccd8/console.log" append="off"/>
Nov 14 00:56:49 user nova-compute[74850]:     </serial>
Nov 14 00:56:49 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:56:49 user nova-compute[74850]:     <video>
Nov 14 00:56:49 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:56:49 user nova-compute[74850]:     </video>
Nov 14 00:56:49 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:56:49 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:56:49 user nova-compute[74850]:     </rng>
Nov 14 00:56:49 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:56:49 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:56:49 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:56:49 user nova-compute[74850]:     </memballoon>
Nov 14 00:56:49 user nova-compute[74850]:   </devices>
Nov 14 00:56:49 user nova-compute[74850]: </domain>
Nov 14 00:56:49 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:56:49 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:56:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-829621186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-829621186',id=29,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='491aa2a4f38140788cb0de9762a8baf4',ramdisk_id='',reservation_id='r-tiybmuy9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-726213232',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:56:33Z,user_data=None,user_id='a5bb5d788a3b4871ae41f57d06f785f2',uuid=702746f7-305f-4eac-a71a-6c08b7cbccd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39232b36-eca6-4dac-880c-43aafa9f1719", "address": "fa:16:3e:ac:57:e7", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39232b36-ec", "ovs_interfaceid": "39232b36-eca6-4dac-880c-43aafa9f1719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:56:49 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Converting VIF {"id": "39232b36-eca6-4dac-880c-43aafa9f1719", "address": "fa:16:3e:ac:57:e7", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39232b36-ec", "ovs_interfaceid": "39232b36-eca6-4dac-880c-43aafa9f1719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:56:49 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:57:e7,bridge_name='br-int',has_traffic_filtering=True,id=39232b36-eca6-4dac-880c-43aafa9f1719,network=Network(6f8f66ca-e2e8-4565-a05c-df75a16699ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39232b36-ec') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:56:49 user nova-compute[74850]: DEBUG os_vif [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:57:e7,bridge_name='br-int',has_traffic_filtering=True,id=39232b36-eca6-4dac-880c-43aafa9f1719,network=Network(6f8f66ca-e2e8-4565-a05c-df75a16699ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39232b36-ec') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:56:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:56:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:56:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a7ee6bc5-c393-5ffa-be44-5e0f2d93c231', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:56:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39232b36-ec, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:56:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap39232b36-ec, col_values=(('qos', UUID('9d6c9e80-ffcb-4aa3-ae17-cafe643ec427')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:56:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap39232b36-ec, col_values=(('external_ids', {'iface-id': '39232b36-eca6-4dac-880c-43aafa9f1719', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:57:e7', 'vm-uuid': '702746f7-305f-4eac-a71a-6c08b7cbccd8'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:56:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:56:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:49 user nova-compute[74850]: INFO os_vif [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:57:e7,bridge_name='br-int',has_traffic_filtering=True,id=39232b36-eca6-4dac-880c-43aafa9f1719,network=Network(6f8f66ca-e2e8-4565-a05c-df75a16699ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39232b36-ec')
Nov 14 00:56:49 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:56:49 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] No VIF found with MAC fa:16:3e:ac:57:e7, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:56:49 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:56:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:56:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:56:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:56:49 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 00:56:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-88204502-3979-4d0d-a29a-186a6251165e tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Acquiring lock "c5f97ca6-ee09-4180-9beb-da65c2aead9b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:56:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-88204502-3979-4d0d-a29a-186a6251165e tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "c5f97ca6-ee09-4180-9beb-da65c2aead9b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:56:49 user nova-compute[74850]: INFO nova.compute.manager [None req-88204502-3979-4d0d-a29a-186a6251165e tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Detaching volume 86d7d196-db62-44f0-ba1a-8031f61db2d9
Nov 14 00:56:50 user nova-compute[74850]: INFO nova.virt.block_device [None req-88204502-3979-4d0d-a29a-186a6251165e tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Attempting to driver detach volume 86d7d196-db62-44f0-ba1a-8031f61db2d9 from mountpoint /dev/vdb
Nov 14 00:56:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-88204502-3979-4d0d-a29a-186a6251165e tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Attempting to detach device vdb from instance c5f97ca6-ee09-4180-9beb-da65c2aead9b from the persistent domain config. {{(pid=74850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 00:56:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-88204502-3979-4d0d-a29a-186a6251165e tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 00:56:50 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:56:50 user nova-compute[74850]:   <source dev="/dev/sdd"/>
Nov 14 00:56:50 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:56:50 user nova-compute[74850]:   <serial>86d7d196-db62-44f0-ba1a-8031f61db2d9</serial>
Nov 14 00:56:50 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 00:56:50 user nova-compute[74850]: </disk>
Nov 14 00:56:50 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 00:56:50 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-88204502-3979-4d0d-a29a-186a6251165e tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Successfully detached device vdb from instance c5f97ca6-ee09-4180-9beb-da65c2aead9b from the persistent domain config.
Nov 14 00:56:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-88204502-3979-4d0d-a29a-186a6251165e tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c5f97ca6-ee09-4180-9beb-da65c2aead9b from the live domain config. {{(pid=74850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 00:56:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-88204502-3979-4d0d-a29a-186a6251165e tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 00:56:50 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:56:50 user nova-compute[74850]:   <source dev="/dev/sdd"/>
Nov 14 00:56:50 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:56:50 user nova-compute[74850]:   <serial>86d7d196-db62-44f0-ba1a-8031f61db2d9</serial>
Nov 14 00:56:50 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 00:56:50 user nova-compute[74850]: </disk>
Nov 14 00:56:50 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 00:56:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-88204502-3979-4d0d-a29a-186a6251165e tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c5f97ca6-ee09-4180-9beb-da65c2aead9b {{(pid=74850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 00:56:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:51 user nova-compute[74850]: DEBUG nova.compute.manager [req-05f88945-ace1-4852-b3a5-30bf493466b1 req-0614e1dd-1600-4aa2-90c4-27c5a3b03903 service nova] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Received event network-vif-plugged-39232b36-eca6-4dac-880c-43aafa9f1719 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:56:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-05f88945-ace1-4852-b3a5-30bf493466b1 req-0614e1dd-1600-4aa2-90c4-27c5a3b03903 service nova] Acquiring lock "702746f7-305f-4eac-a71a-6c08b7cbccd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:56:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-05f88945-ace1-4852-b3a5-30bf493466b1 req-0614e1dd-1600-4aa2-90c4-27c5a3b03903 service nova] Lock "702746f7-305f-4eac-a71a-6c08b7cbccd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:56:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-05f88945-ace1-4852-b3a5-30bf493466b1 req-0614e1dd-1600-4aa2-90c4-27c5a3b03903 service nova] Lock "702746f7-305f-4eac-a71a-6c08b7cbccd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:56:51 user nova-compute[74850]: DEBUG nova.compute.manager [req-05f88945-ace1-4852-b3a5-30bf493466b1 req-0614e1dd-1600-4aa2-90c4-27c5a3b03903 service nova] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] No waiting events found dispatching network-vif-plugged-39232b36-eca6-4dac-880c-43aafa9f1719 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:56:51 user nova-compute[74850]: WARNING nova.compute.manager [req-05f88945-ace1-4852-b3a5-30bf493466b1 req-0614e1dd-1600-4aa2-90c4-27c5a3b03903 service nova] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Received unexpected event network-vif-plugged-39232b36-eca6-4dac-880c-43aafa9f1719 for instance with vm_state building and task_state spawning.
Nov 14 00:56:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk (vdb) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:56:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:53 user nova-compute[74850]: DEBUG nova.compute.manager [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:56:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 00:56:53 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Instance spawned successfully.
Nov 14 00:56:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 00:56:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:56:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:56:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:56:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:56:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:56:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:56:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:53 user nova-compute[74850]: INFO nova.compute.manager [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Took 6.46 seconds to spawn the instance on the hypervisor.
Nov 14 00:56:53 user nova-compute[74850]: DEBUG nova.compute.manager [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:56:53 user nova-compute[74850]: DEBUG nova.compute.manager [req-f65c27a6-6009-4e10-aa3f-9934c290791f req-7b50e4c1-c89b-494c-bd36-a3be672a0f39 service nova] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Received event network-vif-plugged-39232b36-eca6-4dac-880c-43aafa9f1719 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:56:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f65c27a6-6009-4e10-aa3f-9934c290791f req-7b50e4c1-c89b-494c-bd36-a3be672a0f39 service nova] Acquiring lock "702746f7-305f-4eac-a71a-6c08b7cbccd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:56:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f65c27a6-6009-4e10-aa3f-9934c290791f req-7b50e4c1-c89b-494c-bd36-a3be672a0f39 service nova] Lock "702746f7-305f-4eac-a71a-6c08b7cbccd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:56:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f65c27a6-6009-4e10-aa3f-9934c290791f req-7b50e4c1-c89b-494c-bd36-a3be672a0f39 service nova] Lock "702746f7-305f-4eac-a71a-6c08b7cbccd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:56:53 user nova-compute[74850]: DEBUG nova.compute.manager [req-f65c27a6-6009-4e10-aa3f-9934c290791f req-7b50e4c1-c89b-494c-bd36-a3be672a0f39 service nova] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] No waiting events found dispatching network-vif-plugged-39232b36-eca6-4dac-880c-43aafa9f1719 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:56:53 user nova-compute[74850]: WARNING nova.compute.manager [req-f65c27a6-6009-4e10-aa3f-9934c290791f req-7b50e4c1-c89b-494c-bd36-a3be672a0f39 service nova] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Received unexpected event network-vif-plugged-39232b36-eca6-4dac-880c-43aafa9f1719 for instance with vm_state building and task_state spawning.
Nov 14 00:56:53 user nova-compute[74850]: INFO nova.compute.manager [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Took 21.38 seconds to build instance.
Nov 14 00:56:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-93db09a2-59df-4dfe-a2c8-0c20ee3091e0 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "702746f7-305f-4eac-a71a-6c08b7cbccd8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.468s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:56:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:56:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:54 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:56:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5f97ca6-ee09-4180-9beb-da65c2aead9b/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5f97ca6-ee09-4180-9beb-da65c2aead9b/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5f97ca6-ee09-4180-9beb-da65c2aead9b/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:54 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5f97ca6-ee09-4180-9beb-da65c2aead9b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:54 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:56:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:55 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:55 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:55 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:55 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:55 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:55 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:56:55 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:56:56 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:56:56 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:56:56 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=7614MB free_disk=25.076156616210938GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 00:56:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:56:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:56:56 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance a70d0196-f90e-47c4-be67-bf7ef4c3d8c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:56:56 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 1879be4c-9226-4c8c-a56c-f8e37398851b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:56:56 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance a62a2eab-2502-4275-948b-3f18c3fcff36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:56:56 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 748d0da7-bbb9-4e86-aae3-e48b1fa04c14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:56:56 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 4474ad0e-8eee-4db4-9896-50c049d45d26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:56:56 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 4f1102c5-f5ef-48d5-b271-6e25bee5cc70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:56:56 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 211c1477-8a76-4ecd-a7c8-dc0b5903d38c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:56:56 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance c7952bff-87d6-46c1-a6d4-7729dc4893ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:56:56 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:56:56 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance c5f97ca6-ee09-4180-9beb-da65c2aead9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:56:56 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 702746f7-305f-4eac-a71a-6c08b7cbccd8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:56:56 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 00:56:56 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 00:56:56 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Refreshing inventories for resource provider fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 00:56:56 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Updating ProviderTree inventory for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 00:56:56 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Updating inventory in ProviderTree for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 00:56:56 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Refreshing aggregate associations for resource provider fe703abb-f68c-420d-a7f0-bf5240e23c54, aggregates: None {{(pid=74850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 00:56:56 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Refreshing trait associations for resource provider fe703abb-f68c-420d-a7f0-bf5240e23c54, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 00:56:56 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:56:56 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:56:56 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 00:56:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.635s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:56:58 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:56:58 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:56:58 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 00:56:58 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Didn't find any instances for network info cache update. {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 00:56:58 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:56:58 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:56:58 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:56:58 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:56:58 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:56:58 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 00:56:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:56:59 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:57:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:06 user nova-compute[74850]: INFO nova.compute.manager [None req-494ff64a-8914-4ff0-a416-f05be2b2e5f9 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Unrescuing
Nov 14 00:57:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-494ff64a-8914-4ff0-a416-f05be2b2e5f9 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "refresh_cache-211c1477-8a76-4ecd-a7c8-dc0b5903d38c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:57:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-494ff64a-8914-4ff0-a416-f05be2b2e5f9 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquired lock "refresh_cache-211c1477-8a76-4ecd-a7c8-dc0b5903d38c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:57:06 user nova-compute[74850]: DEBUG nova.network.neutron [None req-494ff64a-8914-4ff0-a416-f05be2b2e5f9 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:57:07 user nova-compute[74850]: DEBUG nova.network.neutron [None req-494ff64a-8914-4ff0-a416-f05be2b2e5f9 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Updating instance_info_cache with network_info: [{"id": "5a111053-6390-4a23-97c2-9171e744c3c7", "address": "fa:16:3e:52:fd:39", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a111053-63", "ovs_interfaceid": "5a111053-6390-4a23-97c2-9171e744c3c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:57:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-494ff64a-8914-4ff0-a416-f05be2b2e5f9 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Releasing lock "refresh_cache-211c1477-8a76-4ecd-a7c8-dc0b5903d38c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:57:07 user nova-compute[74850]: DEBUG nova.objects.instance [None req-494ff64a-8914-4ff0-a416-f05be2b2e5f9 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lazy-loading 'flavor' on Instance uuid 211c1477-8a76-4ecd-a7c8-dc0b5903d38c {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:57:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:07 user nova-compute[74850]: DEBUG nova.compute.manager [req-6f85240c-4ca8-4c1b-bcbc-f2d66acb6623 req-32957d5d-7423-4331-b3e5-13846531862d service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Received event network-vif-unplugged-5a111053-6390-4a23-97c2-9171e744c3c7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:57:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6f85240c-4ca8-4c1b-bcbc-f2d66acb6623 req-32957d5d-7423-4331-b3e5-13846531862d service nova] Acquiring lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:57:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6f85240c-4ca8-4c1b-bcbc-f2d66acb6623 req-32957d5d-7423-4331-b3e5-13846531862d service nova] Lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:57:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6f85240c-4ca8-4c1b-bcbc-f2d66acb6623 req-32957d5d-7423-4331-b3e5-13846531862d service nova] Lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:57:07 user nova-compute[74850]: DEBUG nova.compute.manager [req-6f85240c-4ca8-4c1b-bcbc-f2d66acb6623 req-32957d5d-7423-4331-b3e5-13846531862d service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] No waiting events found dispatching network-vif-unplugged-5a111053-6390-4a23-97c2-9171e744c3c7 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:57:07 user nova-compute[74850]: WARNING nova.compute.manager [req-6f85240c-4ca8-4c1b-bcbc-f2d66acb6623 req-32957d5d-7423-4331-b3e5-13846531862d service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Received unexpected event network-vif-unplugged-5a111053-6390-4a23-97c2-9171e744c3c7 for instance with vm_state rescued and task_state unrescuing.
Nov 14 00:57:08 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Instance destroyed successfully.
Nov 14 00:57:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG nova.compute.manager [req-d0d442ae-d122-4a40-b8b4-0bb7d684acaa req-2c6d12e7-a5a1-4e96-b6b6-286541619edf service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Received event network-vif-plugged-5a111053-6390-4a23-97c2-9171e744c3c7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d0d442ae-d122-4a40-b8b4-0bb7d684acaa req-2c6d12e7-a5a1-4e96-b6b6-286541619edf service nova] Acquiring lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d0d442ae-d122-4a40-b8b4-0bb7d684acaa req-2c6d12e7-a5a1-4e96-b6b6-286541619edf service nova] Lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d0d442ae-d122-4a40-b8b4-0bb7d684acaa req-2c6d12e7-a5a1-4e96-b6b6-286541619edf service nova] Lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG nova.compute.manager [req-d0d442ae-d122-4a40-b8b4-0bb7d684acaa req-2c6d12e7-a5a1-4e96-b6b6-286541619edf service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] No waiting events found dispatching network-vif-plugged-5a111053-6390-4a23-97c2-9171e744c3c7 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:57:10 user nova-compute[74850]: WARNING nova.compute.manager [req-d0d442ae-d122-4a40-b8b4-0bb7d684acaa req-2c6d12e7-a5a1-4e96-b6b6-286541619edf service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Received unexpected event network-vif-plugged-5a111053-6390-4a23-97c2-9171e744c3c7 for instance with vm_state rescued and task_state unrescuing.
Nov 14 00:57:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:10 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-88204502-3979-4d0d-a29a-186a6251165e tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c5f97ca6-ee09-4180-9beb-da65c2aead9b is timed out.
Nov 14 00:57:10 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-88204502-3979-4d0d-a29a-186a6251165e tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Successfully detached device vdb from instance c5f97ca6-ee09-4180-9beb-da65c2aead9b from the live domain config.
Nov 14 00:57:10 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88204502-3979-4d0d-a29a-186a6251165e tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-88204502-3979-4d0d-a29a-186a6251165e tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TAuqnlba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:57:10 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-88204502-3979-4d0d-a29a-186a6251165e tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:57:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-88204502-3979-4d0d-a29a-186a6251165e tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-88204502-3979-4d0d-a29a-186a6251165e tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdc6238-4f7c-4b6c-8408-c6b09d693f7a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-88204502-3979-4d0d-a29a-186a6251165e tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 00:57:10 user nova-compute[74850]: No targets found.
Nov 14 00:57:10 user nova-compute[74850]: iSNS:
Nov 14 00:57:10 user nova-compute[74850]: No targets found.
Nov 14 00:57:10 user nova-compute[74850]: STATIC:
Nov 14 00:57:10 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a
Nov 14 00:57:10 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:57:10 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:57:10 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9
Nov 14 00:57:10 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:57:10 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:57:10 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d
Nov 14 00:57:10 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:57:10 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:57:10 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf
Nov 14 00:57:10 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:57:10 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:57:10 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0
Nov 14 00:57:10 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:57:10 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:57:10 user nova-compute[74850]: FIRMWARE:
Nov 14 00:57:10 user nova-compute[74850]: No targets found.
Nov 14 00:57:10 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-88204502-3979-4d0d-a29a-186a6251165e tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 00:57:10 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 00:57:10 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-88204502-3979-4d0d-a29a-186a6251165e tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8d8196-460c-4221-aada-323f624afb5f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33243e0-6cee-478c-8c10-522e66c31dee]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-88204502-3979-4d0d-a29a-186a6251165e tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:57:10 user nova-compute[74850]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:57:10 user nova-compute[74850]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 (non-flash)
Nov 14 00:57:10 user nova-compute[74850]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9 (non-flash)
Nov 14 00:57:10 user nova-compute[74850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 00:57:10 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-88204502-3979-4d0d-a29a-186a6251165e tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:57:10 user nova-compute[74850]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:57:10 user nova-compute[74850]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 (non-flash)
Nov 14 00:57:10 user nova-compute[74850]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9 (non-flash)
Nov 14 00:57:10 user nova-compute[74850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 00:57:10 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-88204502-3979-4d0d-a29a-186a6251165e tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a5c25c1f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9'): ({'sdd'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-88204502-3979-4d0d-a29a-186a6251165e tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Removing single pathed devices sdd {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88863b3-ef90-4a11-8233-7b144661ef9a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2923100f-a4f8-470d-8cf9-60cd454a640c]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-88204502-3979-4d0d-a29a-186a6251165e tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Flushing IO for device /dev/sdd {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb97775e-c538-43c7-a109-3162c239c474]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-88204502-3979-4d0d-a29a-186a6251165e tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.057s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[025eb503-83b9-4f9c-b7d2-bfe50c8c2f5f]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-88204502-3979-4d0d-a29a-186a6251165e tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-88204502-3979-4d0d-a29a-186a6251165e tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] SCSI volumes sdd have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-88204502-3979-4d0d-a29a-186a6251165e tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 00:57:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[716ef1fa-2aa7-4247-b4dc-0db5001c0a8d]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:57:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-88204502-3979-4d0d-a29a-186a6251165e tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:57:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9 -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.137s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[675d4d97-e1d1-4f60-a478-a9242420edd9]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:57:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-88204502-3979-4d0d-a29a-186a6251165e tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9, portal: 172.16.0.220,3260]
Nov 14 00:57:11 user nova-compute[74850]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9, portal: 172.16.0.220,3260] successful.
Nov 14 00:57:11 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:57:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9 -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86d7d196-db62-44f0-ba1a-8031f61db2d9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4a552e-edaf-44c3-a815-76df53824007]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:57:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-88204502-3979-4d0d-a29a-186a6251165e tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:57:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-88204502-3979-4d0d-a29a-186a6251165e tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.449s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:57:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-88204502-3979-4d0d-a29a-186a6251165e tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] <== disconnect_volume: return (451ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:57:11 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88204502-3979-4d0d-a29a-186a6251165e tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 00:57:11 user nova-compute[74850]: DEBUG nova.compute.manager [None req-494ff64a-8914-4ff0-a416-f05be2b2e5f9 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:57:11 user nova-compute[74850]: DEBUG nova.objects.instance [None req-88204502-3979-4d0d-a29a-186a6251165e tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lazy-loading 'flavor' on Instance uuid c5f97ca6-ee09-4180-9beb-da65c2aead9b {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:57:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-88204502-3979-4d0d-a29a-186a6251165e tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "c5f97ca6-ee09-4180-9beb-da65c2aead9b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.038s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:57:12 user nova-compute[74850]: DEBUG nova.compute.manager [req-281c0259-4591-4df1-8545-f28ef0f1dded req-5134f211-0a7e-490b-8ac7-8d4317fc011e service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Received event network-vif-plugged-5a111053-6390-4a23-97c2-9171e744c3c7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:57:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-281c0259-4591-4df1-8545-f28ef0f1dded req-5134f211-0a7e-490b-8ac7-8d4317fc011e service nova] Acquiring lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:57:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-281c0259-4591-4df1-8545-f28ef0f1dded req-5134f211-0a7e-490b-8ac7-8d4317fc011e service nova] Lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:57:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-281c0259-4591-4df1-8545-f28ef0f1dded req-5134f211-0a7e-490b-8ac7-8d4317fc011e service nova] Lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:57:12 user nova-compute[74850]: DEBUG nova.compute.manager [req-281c0259-4591-4df1-8545-f28ef0f1dded req-5134f211-0a7e-490b-8ac7-8d4317fc011e service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] No waiting events found dispatching network-vif-plugged-5a111053-6390-4a23-97c2-9171e744c3c7 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:57:12 user nova-compute[74850]: WARNING nova.compute.manager [req-281c0259-4591-4df1-8545-f28ef0f1dded req-5134f211-0a7e-490b-8ac7-8d4317fc011e service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Received unexpected event network-vif-plugged-5a111053-6390-4a23-97c2-9171e744c3c7 for instance with vm_state active and task_state None.
Nov 14 00:57:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "782a85d0-b427-4ee2-8d6c-778602f00bcd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:57:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:57:14 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 00:57:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:57:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:57:14 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 00:57:14 user nova-compute[74850]: INFO nova.compute.claims [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Claim successful on node user
Nov 14 00:57:14 user nova-compute[74850]: DEBUG nova.compute.manager [req-e425a61a-e586-4931-b84a-dce8b984f1b5 req-881a42ca-7129-4aae-9e3a-9f9d826ca356 service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Received event network-vif-plugged-5a111053-6390-4a23-97c2-9171e744c3c7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:57:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e425a61a-e586-4931-b84a-dce8b984f1b5 req-881a42ca-7129-4aae-9e3a-9f9d826ca356 service nova] Acquiring lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:57:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e425a61a-e586-4931-b84a-dce8b984f1b5 req-881a42ca-7129-4aae-9e3a-9f9d826ca356 service nova] Lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:57:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e425a61a-e586-4931-b84a-dce8b984f1b5 req-881a42ca-7129-4aae-9e3a-9f9d826ca356 service nova] Lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:57:14 user nova-compute[74850]: DEBUG nova.compute.manager [req-e425a61a-e586-4931-b84a-dce8b984f1b5 req-881a42ca-7129-4aae-9e3a-9f9d826ca356 service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] No waiting events found dispatching network-vif-plugged-5a111053-6390-4a23-97c2-9171e744c3c7 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:57:14 user nova-compute[74850]: WARNING nova.compute.manager [req-e425a61a-e586-4931-b84a-dce8b984f1b5 req-881a42ca-7129-4aae-9e3a-9f9d826ca356 service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Received unexpected event network-vif-plugged-5a111053-6390-4a23-97c2-9171e744c3c7 for instance with vm_state active and task_state None.
Nov 14 00:57:15 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:57:15 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:57:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.639s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:57:15 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 00:57:15 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:15 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 00:57:15 user nova-compute[74850]: DEBUG nova.network.neutron [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 00:57:15 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 00:57:15 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 00:57:15 user nova-compute[74850]: DEBUG nova.policy [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b677f8f7b06431cbeac4cbdfa2dcbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3e629e632d444faf3898681aaafa79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 00:57:15 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 00:57:15 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 00:57:15 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Creating image(s)
Nov 14 00:57:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "/opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:57:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "/opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:57:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "/opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:57:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.196s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:57:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:57:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.202s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk 1073741824" returned: 0 in 0.088s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.298s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:57:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.195s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:16 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Checking if we can resize image /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 00:57:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:16 user nova-compute[74850]: DEBUG nova.network.neutron [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Successfully created port: b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:57:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:16 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Cannot resize image /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 00:57:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 00:57:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Ensure instance console log exists: /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 00:57:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:57:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:57:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG nova.network.neutron [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Successfully updated port: b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "refresh_cache-782a85d0-b427-4ee2-8d6c-778602f00bcd" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquired lock "refresh_cache-782a85d0-b427-4ee2-8d6c-778602f00bcd" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG nova.network.neutron [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG nova.compute.manager [req-fbac82ec-517d-4c99-90f1-551b03e082df req-2b07412d-cdfa-4d10-8965-24544696f443 service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Received event network-changed-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG nova.compute.manager [req-fbac82ec-517d-4c99-90f1-551b03e082df req-2b07412d-cdfa-4d10-8965-24544696f443 service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Refreshing instance network info cache due to event network-changed-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fbac82ec-517d-4c99-90f1-551b03e082df req-2b07412d-cdfa-4d10-8965-24544696f443 service nova] Acquiring lock "refresh_cache-782a85d0-b427-4ee2-8d6c-778602f00bcd" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG nova.network.neutron [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG nova.network.neutron [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Updating instance_info_cache with network_info: [{"id": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "address": "fa:16:3e:70:96:bf", "network": {"id": "75650b3d-1169-46fa-a1cf-7ae51dd28e18", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227679489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3e629e632d444faf3898681aaafa79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744a9e-48", "ovs_interfaceid": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Releasing lock "refresh_cache-782a85d0-b427-4ee2-8d6c-778602f00bcd" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Instance network_info: |[{"id": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "address": "fa:16:3e:70:96:bf", "network": {"id": "75650b3d-1169-46fa-a1cf-7ae51dd28e18", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227679489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3e629e632d444faf3898681aaafa79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744a9e-48", "ovs_interfaceid": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fbac82ec-517d-4c99-90f1-551b03e082df req-2b07412d-cdfa-4d10-8965-24544696f443 service nova] Acquired lock "refresh_cache-782a85d0-b427-4ee2-8d6c-778602f00bcd" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG nova.network.neutron [req-fbac82ec-517d-4c99-90f1-551b03e082df req-2b07412d-cdfa-4d10-8965-24544696f443 service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Refreshing network info cache for port b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Start _get_guest_xml network_info=[{"id": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "address": "fa:16:3e:70:96:bf", "network": {"id": "75650b3d-1169-46fa-a1cf-7ae51dd28e18", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227679489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3e629e632d444faf3898681aaafa79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744a9e-48", "ovs_interfaceid": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:57:17 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:57:17 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:57:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:57:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-931477227',display_name='tempest-AttachVolumeTestJSON-server-931477227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-931477227',id=30,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqGPtaAqtRvdnzrU67gWLSZdIWQoykWaBYabKPElkLS5sz5jLsrZV0zgILMNEA+Yd/7TrkBFbU+t9G+drRSGt2wGNzDluZHtIgMdrMvm4dKLEvsHluVt5xKssaIW0AwAg==',key_name='tempest-keypair-1840551366',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c3e629e632d444faf3898681aaafa79',ramdisk_id='',reservation_id='r-iuno8cu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1639440895',owner_user_name='tempest-AttachVolumeTestJSON-1639440895-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:57:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b677f8f7b06431cbeac4cbdfa2dcbf5',uuid=782a85d0-b427-4ee2-8d6c-778602f00bcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "address": "fa:16:3e:70:96:bf", "network": {"id": "75650b3d-1169-46fa-a1cf-7ae51dd28e18", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227679489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3e629e632d444faf3898681aaafa79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744a9e-48", "ovs_interfaceid": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Converting VIF {"id": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "address": "fa:16:3e:70:96:bf", "network": {"id": "75650b3d-1169-46fa-a1cf-7ae51dd28e18", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227679489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3e629e632d444faf3898681aaafa79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744a9e-48", "ovs_interfaceid": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:96:bf,bridge_name='br-int',has_traffic_filtering=True,id=b4744a9e-4848-49b9-9f58-7d29e0ecb9c7,network=Network(75650b3d-1169-46fa-a1cf-7ae51dd28e18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4744a9e-48') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG nova.objects.instance [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lazy-loading 'pci_devices' on Instance uuid 782a85d0-b427-4ee2-8d6c-778602f00bcd {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:57:17 user nova-compute[74850]:   <uuid>782a85d0-b427-4ee2-8d6c-778602f00bcd</uuid>
Nov 14 00:57:17 user nova-compute[74850]:   <name>instance-0000001e</name>
Nov 14 00:57:17 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:57:17 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:57:17 user nova-compute[74850]:   <metadata>
Nov 14 00:57:17 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:57:17 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:57:17 user nova-compute[74850]:       <nova:name>tempest-AttachVolumeTestJSON-server-931477227</nova:name>
Nov 14 00:57:17 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:57:17</nova:creationTime>
Nov 14 00:57:17 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:57:17 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:57:17 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:57:17 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:57:17 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:57:17 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:57:17 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:57:17 user nova-compute[74850]:       <nova:owner>
Nov 14 00:57:17 user nova-compute[74850]:         <nova:user uuid="4b677f8f7b06431cbeac4cbdfa2dcbf5">tempest-AttachVolumeTestJSON-1639440895-project-member</nova:user>
Nov 14 00:57:17 user nova-compute[74850]:         <nova:project uuid="0c3e629e632d444faf3898681aaafa79">tempest-AttachVolumeTestJSON-1639440895</nova:project>
Nov 14 00:57:17 user nova-compute[74850]:       </nova:owner>
Nov 14 00:57:17 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:57:17 user nova-compute[74850]:       <nova:ports>
Nov 14 00:57:17 user nova-compute[74850]:         <nova:port uuid="b4744a9e-4848-49b9-9f58-7d29e0ecb9c7">
Nov 14 00:57:17 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 00:57:17 user nova-compute[74850]:         </nova:port>
Nov 14 00:57:17 user nova-compute[74850]:       </nova:ports>
Nov 14 00:57:17 user nova-compute[74850]:     </nova:instance>
Nov 14 00:57:17 user nova-compute[74850]:   </metadata>
Nov 14 00:57:17 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:57:17 user nova-compute[74850]:     <system>
Nov 14 00:57:17 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:57:17 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:57:17 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:57:17 user nova-compute[74850]:       <entry name="serial">782a85d0-b427-4ee2-8d6c-778602f00bcd</entry>
Nov 14 00:57:17 user nova-compute[74850]:       <entry name="uuid">782a85d0-b427-4ee2-8d6c-778602f00bcd</entry>
Nov 14 00:57:17 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:57:17 user nova-compute[74850]:     </system>
Nov 14 00:57:17 user nova-compute[74850]:   </sysinfo>
Nov 14 00:57:17 user nova-compute[74850]:   <os>
Nov 14 00:57:17 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:57:17 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 00:57:17 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:57:17 user nova-compute[74850]:   </os>
Nov 14 00:57:17 user nova-compute[74850]:   <features>
Nov 14 00:57:17 user nova-compute[74850]:     <acpi/>
Nov 14 00:57:17 user nova-compute[74850]:     <apic/>
Nov 14 00:57:17 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:57:17 user nova-compute[74850]:   </features>
Nov 14 00:57:17 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:57:17 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:57:17 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:57:17 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:57:17 user nova-compute[74850]:   </clock>
Nov 14 00:57:17 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:57:17 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:57:17 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:57:17 user nova-compute[74850]:   </cpu>
Nov 14 00:57:17 user nova-compute[74850]:   <devices>
Nov 14 00:57:17 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 00:57:17 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:57:17 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk"/>
Nov 14 00:57:17 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:57:17 user nova-compute[74850]:     </disk>
Nov 14 00:57:17 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:57:17 user nova-compute[74850]:       <mac address="fa:16:3e:70:96:bf"/>
Nov 14 00:57:17 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:57:17 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:57:17 user nova-compute[74850]:       <target dev="tapb4744a9e-48"/>
Nov 14 00:57:17 user nova-compute[74850]:     </interface>
Nov 14 00:57:17 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:57:17 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/console.log" append="off"/>
Nov 14 00:57:17 user nova-compute[74850]:     </serial>
Nov 14 00:57:17 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:57:17 user nova-compute[74850]:     <video>
Nov 14 00:57:17 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:57:17 user nova-compute[74850]:     </video>
Nov 14 00:57:17 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:57:17 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:57:17 user nova-compute[74850]:     </rng>
Nov 14 00:57:17 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:57:17 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:57:17 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:57:17 user nova-compute[74850]:     </memballoon>
Nov 14 00:57:17 user nova-compute[74850]:   </devices>
Nov 14 00:57:17 user nova-compute[74850]: </domain>
Nov 14 00:57:17 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:57:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-931477227',display_name='tempest-AttachVolumeTestJSON-server-931477227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-931477227',id=30,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqGPtaAqtRvdnzrU67gWLSZdIWQoykWaBYabKPElkLS5sz5jLsrZV0zgILMNEA+Yd/7TrkBFbU+t9G+drRSGt2wGNzDluZHtIgMdrMvm4dKLEvsHluVt5xKssaIW0AwAg==',key_name='tempest-keypair-1840551366',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c3e629e632d444faf3898681aaafa79',ramdisk_id='',reservation_id='r-iuno8cu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1639440895',owner_user_name='tempest-AttachVolumeTestJSON-1639440895-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:57:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b677f8f7b06431cbeac4cbdfa2dcbf5',uuid=782a85d0-b427-4ee2-8d6c-778602f00bcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "address": "fa:16:3e:70:96:bf", "network": {"id": "75650b3d-1169-46fa-a1cf-7ae51dd28e18", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227679489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3e629e632d444faf3898681aaafa79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744a9e-48", "ovs_interfaceid": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Converting VIF {"id": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "address": "fa:16:3e:70:96:bf", "network": {"id": "75650b3d-1169-46fa-a1cf-7ae51dd28e18", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227679489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3e629e632d444faf3898681aaafa79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744a9e-48", "ovs_interfaceid": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:96:bf,bridge_name='br-int',has_traffic_filtering=True,id=b4744a9e-4848-49b9-9f58-7d29e0ecb9c7,network=Network(75650b3d-1169-46fa-a1cf-7ae51dd28e18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4744a9e-48') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG os_vif [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:96:bf,bridge_name='br-int',has_traffic_filtering=True,id=b4744a9e-4848-49b9-9f58-7d29e0ecb9c7,network=Network(75650b3d-1169-46fa-a1cf-7ae51dd28e18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4744a9e-48') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cd61ce09-cb12-585b-b714-5c8b7381bd2b', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4744a9e-48, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb4744a9e-48, col_values=(('qos', UUID('2ad9ace5-62fb-4065-9241-de41ac0867d9')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb4744a9e-48, col_values=(('external_ids', {'iface-id': 'b4744a9e-4848-49b9-9f58-7d29e0ecb9c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:96:bf', 'vm-uuid': '782a85d0-b427-4ee2-8d6c-778602f00bcd'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:17 user nova-compute[74850]: INFO os_vif [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:96:bf,bridge_name='br-int',has_traffic_filtering=True,id=b4744a9e-4848-49b9-9f58-7d29e0ecb9c7,network=Network(75650b3d-1169-46fa-a1cf-7ae51dd28e18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4744a9e-48')
Nov 14 00:57:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] No VIF found with MAC fa:16:3e:70:96:bf, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG nova.network.neutron [req-fbac82ec-517d-4c99-90f1-551b03e082df req-2b07412d-cdfa-4d10-8965-24544696f443 service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Updated VIF entry in instance network info cache for port b4744a9e-4848-49b9-9f58-7d29e0ecb9c7. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG nova.network.neutron [req-fbac82ec-517d-4c99-90f1-551b03e082df req-2b07412d-cdfa-4d10-8965-24544696f443 service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Updating instance_info_cache with network_info: [{"id": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "address": "fa:16:3e:70:96:bf", "network": {"id": "75650b3d-1169-46fa-a1cf-7ae51dd28e18", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227679489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3e629e632d444faf3898681aaafa79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744a9e-48", "ovs_interfaceid": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:57:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fbac82ec-517d-4c99-90f1-551b03e082df req-2b07412d-cdfa-4d10-8965-24544696f443 service nova] Releasing lock "refresh_cache-782a85d0-b427-4ee2-8d6c-778602f00bcd" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:57:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:19 user nova-compute[74850]: DEBUG nova.compute.manager [req-46da801e-f43f-47c7-b2ed-8c9bba7f3566 req-fa36baef-5ad0-4a58-a84b-5663e06d3778 service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Received event network-vif-plugged-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:57:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-46da801e-f43f-47c7-b2ed-8c9bba7f3566 req-fa36baef-5ad0-4a58-a84b-5663e06d3778 service nova] Acquiring lock "782a85d0-b427-4ee2-8d6c-778602f00bcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:57:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-46da801e-f43f-47c7-b2ed-8c9bba7f3566 req-fa36baef-5ad0-4a58-a84b-5663e06d3778 service nova] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:57:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-46da801e-f43f-47c7-b2ed-8c9bba7f3566 req-fa36baef-5ad0-4a58-a84b-5663e06d3778 service nova] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:57:19 user nova-compute[74850]: DEBUG nova.compute.manager [req-46da801e-f43f-47c7-b2ed-8c9bba7f3566 req-fa36baef-5ad0-4a58-a84b-5663e06d3778 service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] No waiting events found dispatching network-vif-plugged-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:57:19 user nova-compute[74850]: WARNING nova.compute.manager [req-46da801e-f43f-47c7-b2ed-8c9bba7f3566 req-fa36baef-5ad0-4a58-a84b-5663e06d3778 service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Received unexpected event network-vif-plugged-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 for instance with vm_state building and task_state spawning.
Nov 14 00:57:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:21 user nova-compute[74850]: DEBUG nova.compute.manager [req-4bad6931-68c4-4d00-a0a5-593c815a5054 req-50ccffe9-f69e-41d2-a85d-ffee791f9f81 service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Received event network-vif-plugged-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:57:21 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-4bad6931-68c4-4d00-a0a5-593c815a5054 req-50ccffe9-f69e-41d2-a85d-ffee791f9f81 service nova] Acquiring lock "782a85d0-b427-4ee2-8d6c-778602f00bcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:57:21 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-4bad6931-68c4-4d00-a0a5-593c815a5054 req-50ccffe9-f69e-41d2-a85d-ffee791f9f81 service nova] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:57:21 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-4bad6931-68c4-4d00-a0a5-593c815a5054 req-50ccffe9-f69e-41d2-a85d-ffee791f9f81 service nova] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:57:21 user nova-compute[74850]: DEBUG nova.compute.manager [req-4bad6931-68c4-4d00-a0a5-593c815a5054 req-50ccffe9-f69e-41d2-a85d-ffee791f9f81 service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] No waiting events found dispatching network-vif-plugged-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:57:21 user nova-compute[74850]: WARNING nova.compute.manager [req-4bad6931-68c4-4d00-a0a5-593c815a5054 req-50ccffe9-f69e-41d2-a85d-ffee791f9f81 service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Received unexpected event network-vif-plugged-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 for instance with vm_state building and task_state spawning.
Nov 14 00:57:21 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:57:21 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 00:57:21 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Instance spawned successfully.
Nov 14 00:57:21 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 00:57:21 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:57:21 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:57:21 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:57:21 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:57:21 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:57:21 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:57:21 user nova-compute[74850]: INFO nova.compute.manager [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Took 5.89 seconds to spawn the instance on the hypervisor.
Nov 14 00:57:21 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:57:21 user nova-compute[74850]: INFO nova.compute.manager [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Took 6.92 seconds to build instance.
Nov 14 00:57:21 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6c8f423f-a668-4162-9f34-e466697431c4 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.035s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:57:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Acquiring lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:57:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:57:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Acquiring lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:57:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:57:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:57:27 user nova-compute[74850]: INFO nova.compute.manager [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Terminating instance
Nov 14 00:57:27 user nova-compute[74850]: DEBUG nova.compute.manager [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 00:57:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:27 user nova-compute[74850]: DEBUG nova.compute.manager [req-a1dec607-d0a2-4a00-91c0-374a17d29322 req-c1f94eb4-4f4f-426e-9e81-5d4410e5be03 service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Received event network-vif-unplugged-745756ea-b360-423f-8258-5339a80658b5 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:57:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a1dec607-d0a2-4a00-91c0-374a17d29322 req-c1f94eb4-4f4f-426e-9e81-5d4410e5be03 service nova] Acquiring lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:57:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a1dec607-d0a2-4a00-91c0-374a17d29322 req-c1f94eb4-4f4f-426e-9e81-5d4410e5be03 service nova] Lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:57:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a1dec607-d0a2-4a00-91c0-374a17d29322 req-c1f94eb4-4f4f-426e-9e81-5d4410e5be03 service nova] Lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:57:27 user nova-compute[74850]: DEBUG nova.compute.manager [req-a1dec607-d0a2-4a00-91c0-374a17d29322 req-c1f94eb4-4f4f-426e-9e81-5d4410e5be03 service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] No waiting events found dispatching network-vif-unplugged-745756ea-b360-423f-8258-5339a80658b5 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:57:27 user nova-compute[74850]: DEBUG nova.compute.manager [req-a1dec607-d0a2-4a00-91c0-374a17d29322 req-c1f94eb4-4f4f-426e-9e81-5d4410e5be03 service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Received event network-vif-unplugged-745756ea-b360-423f-8258-5339a80658b5 for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 00:57:28 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Instance destroyed successfully.
Nov 14 00:57:28 user nova-compute[74850]: DEBUG nova.objects.instance [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lazy-loading 'resources' on Instance uuid 4f1102c5-f5ef-48d5-b271-6e25bee5cc70 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:48:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-601800786',display_name='tempest-ServerActionsTestOtherB-server-601800786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-601800786',id=16,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwPveYWJd2P0BbCb28a9iVIK1Zsz5G3BGaDez0xzoCyU4RzkEN+R7LDyKbiUXGXbhQ6BKU8E1EnTC8pc8cZ9B9nXwhdl3wP+4ydXfXlf6SKZGReFXRGfyOHNNyPoLUUDg==',key_name='tempest-keypair-802679501',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:54:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af65f5e7dcc3404292714adcecdd9939',ramdisk_id='',reservation_id='r-kr9hd7jm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1251502845',owner_user_name='tempest-ServerActionsTestOtherB-1251502845-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:54:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2647a5318ce4cdca3154aef93651505',uuid=4f1102c5-f5ef-48d5-b271-6e25bee5cc70,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "745756ea-b360-423f-8258-5339a80658b5", "address": "fa:16:3e:1e:5a:e7", "network": {"id": "0e3f4d71-4998-448f-b706-8ae0f6d0d960", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-245892937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af65f5e7dcc3404292714adcecdd9939", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745756ea-b3", "ovs_interfaceid": "745756ea-b360-423f-8258-5339a80658b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Converting VIF {"id": "745756ea-b360-423f-8258-5339a80658b5", "address": "fa:16:3e:1e:5a:e7", "network": {"id": "0e3f4d71-4998-448f-b706-8ae0f6d0d960", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-245892937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af65f5e7dcc3404292714adcecdd9939", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745756ea-b3", "ovs_interfaceid": "745756ea-b360-423f-8258-5339a80658b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:5a:e7,bridge_name='br-int',has_traffic_filtering=True,id=745756ea-b360-423f-8258-5339a80658b5,network=Network(0e3f4d71-4998-448f-b706-8ae0f6d0d960),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745756ea-b3') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG os_vif [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:5a:e7,bridge_name='br-int',has_traffic_filtering=True,id=745756ea-b360-423f-8258-5339a80658b5,network=Network(0e3f4d71-4998-448f-b706-8ae0f6d0d960),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745756ea-b3') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap745756ea-b3, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2c46ab96-e747-481d-b901-83f1007d5ec1) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:57:28 user nova-compute[74850]: INFO os_vif [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:5a:e7,bridge_name='br-int',has_traffic_filtering=True,id=745756ea-b360-423f-8258-5339a80658b5,network=Network(0e3f4d71-4998-448f-b706-8ae0f6d0d960),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745756ea-b3')
Nov 14 00:57:28 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oniPaHRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:57:28 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:57:28 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b6cb00-f48c-467d-9b03-06f912b2ad68]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 00:57:28 user nova-compute[74850]: No targets found.
Nov 14 00:57:28 user nova-compute[74850]: iSNS:
Nov 14 00:57:28 user nova-compute[74850]: No targets found.
Nov 14 00:57:28 user nova-compute[74850]: STATIC:
Nov 14 00:57:28 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a
Nov 14 00:57:28 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:57:28 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:57:28 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d
Nov 14 00:57:28 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:57:28 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:57:28 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf
Nov 14 00:57:28 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:57:28 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:57:28 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0
Nov 14 00:57:28 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:57:28 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:57:28 user nova-compute[74850]: FIRMWARE:
Nov 14 00:57:28 user nova-compute[74850]: No targets found.
Nov 14 00:57:28 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 00:57:28 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 00:57:28 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9b0a12-8e9a-4f21-a487-de53aa2b77fd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad582f35-501a-47ae-b266-9bf5bbf34f64]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:57:28 user nova-compute[74850]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:57:28 user nova-compute[74850]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 (non-flash)
Nov 14 00:57:28 user nova-compute[74850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 00:57:28 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf (non-flash)
Nov 14 00:57:28 user nova-compute[74850]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:57:28 user nova-compute[74850]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 (non-flash)
Nov 14 00:57:28 user nova-compute[74850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 00:57:28 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a5c25c1f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf'): ({'sdc'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Removing single pathed devices sdc {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5595851e-5fbe-4532-b1ba-0dbf4a7b39a5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[69584fd2-781d-4c6c-b403-bcc31efe5097]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Flushing IO for device /dev/sdc {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e5fbef-156d-4ff3-b044-cdc7321dc440]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.059s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c24a47-79dd-4ae5-b69a-4e8f163e5853]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] SCSI volumes sdc have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d9efd7-5ad7-4d60-a1fb-b75addbb344a]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b210241c-06ff-4057-9cf3-1139ef2e50ac]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf, portal: 172.16.0.220,3260]
Nov 14 00:57:28 user nova-compute[74850]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf, portal: 172.16.0.220,3260] successful.
Nov 14 00:57:28 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa08a3a0-c9a2-48ea-a7cd-4e6e882354cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e7de38-7f47-49ba-819e-9eaadfcd0c15]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] <== disconnect_volume: return (320ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 00:57:28 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Deleting instance files /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70_del
Nov 14 00:57:28 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Deletion of /opt/stack/data/nova/instances/4f1102c5-f5ef-48d5-b271-6e25bee5cc70_del complete
Nov 14 00:57:28 user nova-compute[74850]: INFO nova.compute.manager [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 14 00:57:28 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 00:57:28 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 00:57:29 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:57:29 user nova-compute[74850]: DEBUG nova.compute.manager [req-c56e8d50-ecfd-4f6c-8272-94e3ecc06929 req-c1f5281c-c07b-4ce3-97e4-e8ace206df64 service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Received event network-vif-deleted-745756ea-b360-423f-8258-5339a80658b5 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:57:29 user nova-compute[74850]: INFO nova.compute.manager [req-c56e8d50-ecfd-4f6c-8272-94e3ecc06929 req-c1f5281c-c07b-4ce3-97e4-e8ace206df64 service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Neutron deleted interface 745756ea-b360-423f-8258-5339a80658b5; detaching it from the instance and deleting it from the info cache
Nov 14 00:57:29 user nova-compute[74850]: DEBUG nova.network.neutron [req-c56e8d50-ecfd-4f6c-8272-94e3ecc06929 req-c1f5281c-c07b-4ce3-97e4-e8ace206df64 service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:57:29 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Took 0.77 seconds to deallocate network for instance.
Nov 14 00:57:29 user nova-compute[74850]: DEBUG nova.compute.manager [req-c56e8d50-ecfd-4f6c-8272-94e3ecc06929 req-c1f5281c-c07b-4ce3-97e4-e8ace206df64 service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Detach interface failed, port_id=745756ea-b360-423f-8258-5339a80658b5, reason: Instance 4f1102c5-f5ef-48d5-b271-6e25bee5cc70 could not be found. {{(pid=74850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 00:57:29 user nova-compute[74850]: DEBUG nova.compute.manager [req-c565d80a-69a8-4398-b6f3-46eb268d281d req-c08dbf13-6c5b-4670-b10d-d029a06a5f4c service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Received event network-vif-plugged-745756ea-b360-423f-8258-5339a80658b5 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:57:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c565d80a-69a8-4398-b6f3-46eb268d281d req-c08dbf13-6c5b-4670-b10d-d029a06a5f4c service nova] Acquiring lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:57:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c565d80a-69a8-4398-b6f3-46eb268d281d req-c08dbf13-6c5b-4670-b10d-d029a06a5f4c service nova] Lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:57:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c565d80a-69a8-4398-b6f3-46eb268d281d req-c08dbf13-6c5b-4670-b10d-d029a06a5f4c service nova] Lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:57:29 user nova-compute[74850]: DEBUG nova.compute.manager [req-c565d80a-69a8-4398-b6f3-46eb268d281d req-c08dbf13-6c5b-4670-b10d-d029a06a5f4c service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] No waiting events found dispatching network-vif-plugged-745756ea-b360-423f-8258-5339a80658b5 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:57:29 user nova-compute[74850]: WARNING nova.compute.manager [req-c565d80a-69a8-4398-b6f3-46eb268d281d req-c08dbf13-6c5b-4670-b10d-d029a06a5f4c service nova] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Received unexpected event network-vif-plugged-745756ea-b360-423f-8258-5339a80658b5 for instance with vm_state active and task_state deleting.
Nov 14 00:57:30 user nova-compute[74850]: INFO nova.compute.manager [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] [instance: 4f1102c5-f5ef-48d5-b271-6e25bee5cc70] Took 0.74 seconds to detach 1 volumes for instance.
Nov 14 00:57:30 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:57:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:57:30 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:57:30 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:57:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.423s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:57:30 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Deleted allocations for instance 4f1102c5-f5ef-48d5-b271-6e25bee5cc70
Nov 14 00:57:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-92006c0d-1dd1-49fd-b053-03892655b826 tempest-ServerActionsTestOtherB-1251502845 tempest-ServerActionsTestOtherB-1251502845-project-member] Lock "4f1102c5-f5ef-48d5-b271-6e25bee5cc70" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.442s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:57:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:40 user nova-compute[74850]: DEBUG nova.compute.manager [req-6ae925b4-8d5c-4b13-aa59-8e4d4b124632 req-28ba35db-d410-457d-a7d0-b01ca8f14490 service nova] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Received event network-changed-1f60b107-fed3-4884-be05-f9c39313b71d {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:57:40 user nova-compute[74850]: DEBUG nova.compute.manager [req-6ae925b4-8d5c-4b13-aa59-8e4d4b124632 req-28ba35db-d410-457d-a7d0-b01ca8f14490 service nova] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Refreshing instance network info cache due to event network-changed-1f60b107-fed3-4884-be05-f9c39313b71d. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:57:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6ae925b4-8d5c-4b13-aa59-8e4d4b124632 req-28ba35db-d410-457d-a7d0-b01ca8f14490 service nova] Acquiring lock "refresh_cache-c5f97ca6-ee09-4180-9beb-da65c2aead9b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:57:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6ae925b4-8d5c-4b13-aa59-8e4d4b124632 req-28ba35db-d410-457d-a7d0-b01ca8f14490 service nova] Acquired lock "refresh_cache-c5f97ca6-ee09-4180-9beb-da65c2aead9b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:57:40 user nova-compute[74850]: DEBUG nova.network.neutron [req-6ae925b4-8d5c-4b13-aa59-8e4d4b124632 req-28ba35db-d410-457d-a7d0-b01ca8f14490 service nova] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Refreshing network info cache for port 1f60b107-fed3-4884-be05-f9c39313b71d {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:57:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-32397b98-c9ca-4ece-8090-b5027a7d8500 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Acquiring lock "c5f97ca6-ee09-4180-9beb-da65c2aead9b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:57:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-32397b98-c9ca-4ece-8090-b5027a7d8500 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "c5f97ca6-ee09-4180-9beb-da65c2aead9b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:57:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-32397b98-c9ca-4ece-8090-b5027a7d8500 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Acquiring lock "c5f97ca6-ee09-4180-9beb-da65c2aead9b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:57:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-32397b98-c9ca-4ece-8090-b5027a7d8500 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "c5f97ca6-ee09-4180-9beb-da65c2aead9b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:57:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-32397b98-c9ca-4ece-8090-b5027a7d8500 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "c5f97ca6-ee09-4180-9beb-da65c2aead9b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:57:40 user nova-compute[74850]: INFO nova.compute.manager [None req-32397b98-c9ca-4ece-8090-b5027a7d8500 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Terminating instance
Nov 14 00:57:40 user nova-compute[74850]: DEBUG nova.compute.manager [None req-32397b98-c9ca-4ece-8090-b5027a7d8500 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 00:57:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:41 user nova-compute[74850]: DEBUG nova.compute.manager [req-f5e3ceac-1926-4caa-96cd-9eab8ff17aaf req-cbcbfd1a-66f5-4934-a80e-ed602bd728f6 service nova] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Received event network-vif-unplugged-1f60b107-fed3-4884-be05-f9c39313b71d {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:57:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f5e3ceac-1926-4caa-96cd-9eab8ff17aaf req-cbcbfd1a-66f5-4934-a80e-ed602bd728f6 service nova] Acquiring lock "c5f97ca6-ee09-4180-9beb-da65c2aead9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:57:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f5e3ceac-1926-4caa-96cd-9eab8ff17aaf req-cbcbfd1a-66f5-4934-a80e-ed602bd728f6 service nova] Lock "c5f97ca6-ee09-4180-9beb-da65c2aead9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:57:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f5e3ceac-1926-4caa-96cd-9eab8ff17aaf req-cbcbfd1a-66f5-4934-a80e-ed602bd728f6 service nova] Lock "c5f97ca6-ee09-4180-9beb-da65c2aead9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:57:41 user nova-compute[74850]: DEBUG nova.compute.manager [req-f5e3ceac-1926-4caa-96cd-9eab8ff17aaf req-cbcbfd1a-66f5-4934-a80e-ed602bd728f6 service nova] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] No waiting events found dispatching network-vif-unplugged-1f60b107-fed3-4884-be05-f9c39313b71d {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:57:41 user nova-compute[74850]: DEBUG nova.compute.manager [req-f5e3ceac-1926-4caa-96cd-9eab8ff17aaf req-cbcbfd1a-66f5-4934-a80e-ed602bd728f6 service nova] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Received event network-vif-unplugged-1f60b107-fed3-4884-be05-f9c39313b71d for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 00:57:41 user nova-compute[74850]: DEBUG nova.network.neutron [req-6ae925b4-8d5c-4b13-aa59-8e4d4b124632 req-28ba35db-d410-457d-a7d0-b01ca8f14490 service nova] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Updated VIF entry in instance network info cache for port 1f60b107-fed3-4884-be05-f9c39313b71d. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:57:41 user nova-compute[74850]: DEBUG nova.network.neutron [req-6ae925b4-8d5c-4b13-aa59-8e4d4b124632 req-28ba35db-d410-457d-a7d0-b01ca8f14490 service nova] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Updating instance_info_cache with network_info: [{"id": "1f60b107-fed3-4884-be05-f9c39313b71d", "address": "fa:16:3e:27:57:ed", "network": {"id": "b096d728-1246-4eaa-9222-ed8eee74870c", "bridge": "br-int", "label": "tempest-TestStampPattern-1207618832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e17bbd82f843fdaa3c48d8cb64a2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f60b107-fe", "ovs_interfaceid": "1f60b107-fed3-4884-be05-f9c39313b71d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:57:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6ae925b4-8d5c-4b13-aa59-8e4d4b124632 req-28ba35db-d410-457d-a7d0-b01ca8f14490 service nova] Releasing lock "refresh_cache-c5f97ca6-ee09-4180-9beb-da65c2aead9b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:57:41 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Instance destroyed successfully.
Nov 14 00:57:41 user nova-compute[74850]: DEBUG nova.objects.instance [None req-32397b98-c9ca-4ece-8090-b5027a7d8500 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lazy-loading 'resources' on Instance uuid c5f97ca6-ee09-4180-9beb-da65c2aead9b {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:57:41 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-32397b98-c9ca-4ece-8090-b5027a7d8500 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:54:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-752559758',display_name='tempest-TestStampPattern-server-752559758',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-752559758',id=28,image_ref='0db64770-aa6b-4c5d-97ef-85e5c6405aff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrZlgeE9/Eb/dSvSLuh1rHNCQMOaoa95CjuZ377Ld81ZeZuC/2z69Zf0ms8CG6YuI4ZXEqqItRYp52TjDRYLlQoYwNXCNYDhSdvz3DpnModEihmBQQVehRcSLXR08S+jQ==',key_name='tempest-TestStampPattern-158458074',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:54:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='82e17bbd82f843fdaa3c48d8cb64a2c9',ramdisk_id='',reservation_id='r-wjpey9fv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='4474ad0e-8eee-4db4-9896-50c049d45d26',image_min_disk='1',image_min_ram='0',image_owner_id='82e17bbd82f843fdaa3c48d8cb64a2c9',image_owner_project_name='tempest-TestStampPattern-1231523385',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1231523385-project-member',image_user_id='208acda449ad436c85bdbebff0560e63',owner_project_name='tempest-TestStampPattern-1231523385',owner_user_name='tempest-TestStampPattern-1231523385-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:54:57Z,user_data=None,user_id='208acda449ad436c85bdbebff0560e63',uuid=c5f97ca6-ee09-4180-9beb-da65c2aead9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f60b107-fed3-4884-be05-f9c39313b71d", "address": "fa:16:3e:27:57:ed", "network": {"id": "b096d728-1246-4eaa-9222-ed8eee74870c", "bridge": "br-int", "label": "tempest-TestStampPattern-1207618832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e17bbd82f843fdaa3c48d8cb64a2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f60b107-fe", "ovs_interfaceid": "1f60b107-fed3-4884-be05-f9c39313b71d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:57:41 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-32397b98-c9ca-4ece-8090-b5027a7d8500 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Converting VIF {"id": "1f60b107-fed3-4884-be05-f9c39313b71d", "address": "fa:16:3e:27:57:ed", "network": {"id": "b096d728-1246-4eaa-9222-ed8eee74870c", "bridge": "br-int", "label": "tempest-TestStampPattern-1207618832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e17bbd82f843fdaa3c48d8cb64a2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f60b107-fe", "ovs_interfaceid": "1f60b107-fed3-4884-be05-f9c39313b71d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:57:41 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-32397b98-c9ca-4ece-8090-b5027a7d8500 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:57:ed,bridge_name='br-int',has_traffic_filtering=True,id=1f60b107-fed3-4884-be05-f9c39313b71d,network=Network(b096d728-1246-4eaa-9222-ed8eee74870c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f60b107-fe') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:57:41 user nova-compute[74850]: DEBUG os_vif [None req-32397b98-c9ca-4ece-8090-b5027a7d8500 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:57:ed,bridge_name='br-int',has_traffic_filtering=True,id=1f60b107-fed3-4884-be05-f9c39313b71d,network=Network(b096d728-1246-4eaa-9222-ed8eee74870c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f60b107-fe') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:57:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f60b107-fe, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:57:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:57:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ba5c5b1a-0d7d-4bc0-aa45-c7ea1c9f93d0) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:57:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:57:41 user nova-compute[74850]: INFO os_vif [None req-32397b98-c9ca-4ece-8090-b5027a7d8500 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:57:ed,bridge_name='br-int',has_traffic_filtering=True,id=1f60b107-fed3-4884-be05-f9c39313b71d,network=Network(b096d728-1246-4eaa-9222-ed8eee74870c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f60b107-fe')
Nov 14 00:57:41 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-32397b98-c9ca-4ece-8090-b5027a7d8500 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Deleting instance files /opt/stack/data/nova/instances/c5f97ca6-ee09-4180-9beb-da65c2aead9b_del
Nov 14 00:57:41 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-32397b98-c9ca-4ece-8090-b5027a7d8500 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Deletion of /opt/stack/data/nova/instances/c5f97ca6-ee09-4180-9beb-da65c2aead9b_del complete
Nov 14 00:57:41 user nova-compute[74850]: INFO nova.compute.manager [None req-32397b98-c9ca-4ece-8090-b5027a7d8500 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 14 00:57:41 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-32397b98-c9ca-4ece-8090-b5027a7d8500 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 00:57:41 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 00:57:41 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 00:57:42 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:57:42 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Took 0.58 seconds to deallocate network for instance.
Nov 14 00:57:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-32397b98-c9ca-4ece-8090-b5027a7d8500 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:57:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-32397b98-c9ca-4ece-8090-b5027a7d8500 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:57:42 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-32397b98-c9ca-4ece-8090-b5027a7d8500 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:57:42 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-32397b98-c9ca-4ece-8090-b5027a7d8500 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:57:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-32397b98-c9ca-4ece-8090-b5027a7d8500 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:57:42 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-32397b98-c9ca-4ece-8090-b5027a7d8500 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Deleted allocations for instance c5f97ca6-ee09-4180-9beb-da65c2aead9b
Nov 14 00:57:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-32397b98-c9ca-4ece-8090-b5027a7d8500 tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "c5f97ca6-ee09-4180-9beb-da65c2aead9b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.962s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:57:43 user nova-compute[74850]: DEBUG nova.compute.manager [req-fcf23be8-034b-4d0e-8a73-51e3758cbce3 req-e01885e6-6a4f-4553-b596-dd4f374a8ab6 service nova] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Received event network-vif-plugged-1f60b107-fed3-4884-be05-f9c39313b71d {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:57:43 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fcf23be8-034b-4d0e-8a73-51e3758cbce3 req-e01885e6-6a4f-4553-b596-dd4f374a8ab6 service nova] Acquiring lock "c5f97ca6-ee09-4180-9beb-da65c2aead9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:57:43 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fcf23be8-034b-4d0e-8a73-51e3758cbce3 req-e01885e6-6a4f-4553-b596-dd4f374a8ab6 service nova] Lock "c5f97ca6-ee09-4180-9beb-da65c2aead9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:57:43 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fcf23be8-034b-4d0e-8a73-51e3758cbce3 req-e01885e6-6a4f-4553-b596-dd4f374a8ab6 service nova] Lock "c5f97ca6-ee09-4180-9beb-da65c2aead9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:57:43 user nova-compute[74850]: DEBUG nova.compute.manager [req-fcf23be8-034b-4d0e-8a73-51e3758cbce3 req-e01885e6-6a4f-4553-b596-dd4f374a8ab6 service nova] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] No waiting events found dispatching network-vif-plugged-1f60b107-fed3-4884-be05-f9c39313b71d {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:57:43 user nova-compute[74850]: WARNING nova.compute.manager [req-fcf23be8-034b-4d0e-8a73-51e3758cbce3 req-e01885e6-6a4f-4553-b596-dd4f374a8ab6 service nova] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Received unexpected event network-vif-plugged-1f60b107-fed3-4884-be05-f9c39313b71d for instance with vm_state deleted and task_state None.
Nov 14 00:57:43 user nova-compute[74850]: DEBUG nova.compute.manager [req-fcf23be8-034b-4d0e-8a73-51e3758cbce3 req-e01885e6-6a4f-4553-b596-dd4f374a8ab6 service nova] [instance: c5f97ca6-ee09-4180-9beb-da65c2aead9b] Received event network-vif-deleted-1f60b107-fed3-4884-be05-f9c39313b71d {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:57:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:47 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:57:49 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:57:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:57:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:57:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:57:49 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 00:57:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:57:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:57:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:57:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:57:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:57:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:57:54 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:57:54 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:57:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=7828MB free_disk=25.064132690429688GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 00:57:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:57:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:57:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance a70d0196-f90e-47c4-be67-bf7ef4c3d8c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:57:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 1879be4c-9226-4c8c-a56c-f8e37398851b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:57:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance a62a2eab-2502-4275-948b-3f18c3fcff36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:57:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 748d0da7-bbb9-4e86-aae3-e48b1fa04c14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:57:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 4474ad0e-8eee-4db4-9896-50c049d45d26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:57:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 211c1477-8a76-4ecd-a7c8-dc0b5903d38c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:57:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance c7952bff-87d6-46c1-a6d4-7729dc4893ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:57:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:57:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 702746f7-305f-4eac-a71a-6c08b7cbccd8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:57:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 782a85d0-b427-4ee2-8d6c-778602f00bcd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:57:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 00:57:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 00:57:54 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:57:54 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:57:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 00:57:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.419s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:57:56 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:57:56 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:57:56 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:57:56 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:57:56 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:57:57 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:57:57 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 00:57:57 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Rebuilding the list of instances to heal {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 00:57:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "refresh_cache-a70d0196-f90e-47c4-be67-bf7ef4c3d8c4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:57:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquired lock "refresh_cache-a70d0196-f90e-47c4-be67-bf7ef4c3d8c4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:57:58 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Forcefully refreshing network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 00:57:58 user nova-compute[74850]: DEBUG nova.objects.instance [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lazy-loading 'info_cache' on Instance uuid a70d0196-f90e-47c4-be67-bf7ef4c3d8c4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:57:58 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Updating instance_info_cache with network_info: [{"id": "f0de03a3-fd19-4cd1-a408-5168dcf267d7", "address": "fa:16:3e:44:d7:64", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0de03a3-fd", "ovs_interfaceid": "f0de03a3-fd19-4cd1-a408-5168dcf267d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:57:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Releasing lock "refresh_cache-a70d0196-f90e-47c4-be67-bf7ef4c3d8c4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:57:58 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Updated the network info_cache for instance {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 00:57:58 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:57:58 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 00:57:59 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:58:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:58:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-cd585978-3bc0-4158-ab4f-3e9734403d5e tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Acquiring lock "a62a2eab-2502-4275-948b-3f18c3fcff36" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:58:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-cd585978-3bc0-4158-ab4f-3e9734403d5e tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Lock "a62a2eab-2502-4275-948b-3f18c3fcff36" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:58:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-cd585978-3bc0-4158-ab4f-3e9734403d5e tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Acquiring lock "a62a2eab-2502-4275-948b-3f18c3fcff36-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:58:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-cd585978-3bc0-4158-ab4f-3e9734403d5e tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Lock "a62a2eab-2502-4275-948b-3f18c3fcff36-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:58:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-cd585978-3bc0-4158-ab4f-3e9734403d5e tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Lock "a62a2eab-2502-4275-948b-3f18c3fcff36-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:58:07 user nova-compute[74850]: INFO nova.compute.manager [None req-cd585978-3bc0-4158-ab4f-3e9734403d5e tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Terminating instance
Nov 14 00:58:07 user nova-compute[74850]: DEBUG nova.compute.manager [None req-cd585978-3bc0-4158-ab4f-3e9734403d5e tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 00:58:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:07 user nova-compute[74850]: DEBUG nova.compute.manager [req-ef498bf0-ce58-496f-b1d4-7bb9e0cb0abb req-865b425d-a677-42e7-9c93-b3fbee0e7f33 service nova] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Received event network-vif-unplugged-12f841ee-4cd7-42bc-b5c7-4881419e2e26 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:58:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ef498bf0-ce58-496f-b1d4-7bb9e0cb0abb req-865b425d-a677-42e7-9c93-b3fbee0e7f33 service nova] Acquiring lock "a62a2eab-2502-4275-948b-3f18c3fcff36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:58:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ef498bf0-ce58-496f-b1d4-7bb9e0cb0abb req-865b425d-a677-42e7-9c93-b3fbee0e7f33 service nova] Lock "a62a2eab-2502-4275-948b-3f18c3fcff36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:58:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ef498bf0-ce58-496f-b1d4-7bb9e0cb0abb req-865b425d-a677-42e7-9c93-b3fbee0e7f33 service nova] Lock "a62a2eab-2502-4275-948b-3f18c3fcff36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:58:07 user nova-compute[74850]: DEBUG nova.compute.manager [req-ef498bf0-ce58-496f-b1d4-7bb9e0cb0abb req-865b425d-a677-42e7-9c93-b3fbee0e7f33 service nova] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] No waiting events found dispatching network-vif-unplugged-12f841ee-4cd7-42bc-b5c7-4881419e2e26 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:58:07 user nova-compute[74850]: DEBUG nova.compute.manager [req-ef498bf0-ce58-496f-b1d4-7bb9e0cb0abb req-865b425d-a677-42e7-9c93-b3fbee0e7f33 service nova] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Received event network-vif-unplugged-12f841ee-4cd7-42bc-b5c7-4881419e2e26 for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 00:58:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:07 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Instance destroyed successfully.
Nov 14 00:58:07 user nova-compute[74850]: DEBUG nova.objects.instance [None req-cd585978-3bc0-4158-ab4f-3e9734403d5e tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Lazy-loading 'resources' on Instance uuid a62a2eab-2502-4275-948b-3f18c3fcff36 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:58:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-cd585978-3bc0-4158-ab4f-3e9734403d5e tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:49:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-624514644',display_name='tempest-ServersNegativeTestJSON-server-624514644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-624514644',id=19,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:49:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf004672a7b54f718937d1a0db6cec04',ramdisk_id='',reservation_id='r-bfsai53n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1191110421',owner_user_name='tempest-ServersNegativeTestJSON-1191110421-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:49:34Z,user_data=None,user_id='1fb1ab671fa64b55ac3d30df3d41cb3b',uuid=a62a2eab-2502-4275-948b-3f18c3fcff36,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12f841ee-4cd7-42bc-b5c7-4881419e2e26", "address": "fa:16:3e:14:c5:ac", "network": {"id": "70b59622-f2a8-4dfc-9f03-828f4824be1e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1478695014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf004672a7b54f718937d1a0db6cec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12f841ee-4c", "ovs_interfaceid": "12f841ee-4cd7-42bc-b5c7-4881419e2e26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:58:07 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-cd585978-3bc0-4158-ab4f-3e9734403d5e tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Converting VIF {"id": "12f841ee-4cd7-42bc-b5c7-4881419e2e26", "address": "fa:16:3e:14:c5:ac", "network": {"id": "70b59622-f2a8-4dfc-9f03-828f4824be1e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1478695014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf004672a7b54f718937d1a0db6cec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12f841ee-4c", "ovs_interfaceid": "12f841ee-4cd7-42bc-b5c7-4881419e2e26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:58:07 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-cd585978-3bc0-4158-ab4f-3e9734403d5e tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:c5:ac,bridge_name='br-int',has_traffic_filtering=True,id=12f841ee-4cd7-42bc-b5c7-4881419e2e26,network=Network(70b59622-f2a8-4dfc-9f03-828f4824be1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12f841ee-4c') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:58:07 user nova-compute[74850]: DEBUG os_vif [None req-cd585978-3bc0-4158-ab4f-3e9734403d5e tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:c5:ac,bridge_name='br-int',has_traffic_filtering=True,id=12f841ee-4cd7-42bc-b5c7-4881419e2e26,network=Network(70b59622-f2a8-4dfc-9f03-828f4824be1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12f841ee-4c') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:58:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap12f841ee-4c, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:58:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:58:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f8ebd876-9374-48b0-8f68-490aba710d89) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:58:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:07 user nova-compute[74850]: INFO os_vif [None req-cd585978-3bc0-4158-ab4f-3e9734403d5e tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:c5:ac,bridge_name='br-int',has_traffic_filtering=True,id=12f841ee-4cd7-42bc-b5c7-4881419e2e26,network=Network(70b59622-f2a8-4dfc-9f03-828f4824be1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12f841ee-4c')
Nov 14 00:58:07 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-cd585978-3bc0-4158-ab4f-3e9734403d5e tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Deleting instance files /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36_del
Nov 14 00:58:07 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-cd585978-3bc0-4158-ab4f-3e9734403d5e tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Deletion of /opt/stack/data/nova/instances/a62a2eab-2502-4275-948b-3f18c3fcff36_del complete
Nov 14 00:58:07 user nova-compute[74850]: INFO nova.compute.manager [None req-cd585978-3bc0-4158-ab4f-3e9734403d5e tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 00:58:07 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-cd585978-3bc0-4158-ab4f-3e9734403d5e tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 00:58:07 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 00:58:07 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 00:58:08 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:58:08 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Took 0.51 seconds to deallocate network for instance.
Nov 14 00:58:08 user nova-compute[74850]: DEBUG nova.compute.manager [req-8e0b3cb7-c396-4dac-b8da-dac867801866 req-0736a44f-88df-4ba0-93b8-3f4a2c39108b service nova] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Received event network-vif-deleted-12f841ee-4cd7-42bc-b5c7-4881419e2e26 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:58:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-cd585978-3bc0-4158-ab4f-3e9734403d5e tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:58:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-cd585978-3bc0-4158-ab4f-3e9734403d5e tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:58:08 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-cd585978-3bc0-4158-ab4f-3e9734403d5e tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:58:08 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-cd585978-3bc0-4158-ab4f-3e9734403d5e tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:58:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-cd585978-3bc0-4158-ab4f-3e9734403d5e tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:58:08 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-cd585978-3bc0-4158-ab4f-3e9734403d5e tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Deleted allocations for instance a62a2eab-2502-4275-948b-3f18c3fcff36
Nov 14 00:58:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-cd585978-3bc0-4158-ab4f-3e9734403d5e tempest-ServersNegativeTestJSON-1191110421 tempest-ServersNegativeTestJSON-1191110421-project-member] Lock "a62a2eab-2502-4275-948b-3f18c3fcff36" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.874s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:58:09 user nova-compute[74850]: DEBUG nova.compute.manager [req-ed1d3e18-aaeb-43a5-b0ec-17d237272914 req-792f344b-8ea3-4fa0-9c89-c4f6b25ca005 service nova] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Received event network-vif-plugged-12f841ee-4cd7-42bc-b5c7-4881419e2e26 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:58:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ed1d3e18-aaeb-43a5-b0ec-17d237272914 req-792f344b-8ea3-4fa0-9c89-c4f6b25ca005 service nova] Acquiring lock "a62a2eab-2502-4275-948b-3f18c3fcff36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:58:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ed1d3e18-aaeb-43a5-b0ec-17d237272914 req-792f344b-8ea3-4fa0-9c89-c4f6b25ca005 service nova] Lock "a62a2eab-2502-4275-948b-3f18c3fcff36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:58:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ed1d3e18-aaeb-43a5-b0ec-17d237272914 req-792f344b-8ea3-4fa0-9c89-c4f6b25ca005 service nova] Lock "a62a2eab-2502-4275-948b-3f18c3fcff36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:58:09 user nova-compute[74850]: DEBUG nova.compute.manager [req-ed1d3e18-aaeb-43a5-b0ec-17d237272914 req-792f344b-8ea3-4fa0-9c89-c4f6b25ca005 service nova] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] No waiting events found dispatching network-vif-plugged-12f841ee-4cd7-42bc-b5c7-4881419e2e26 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:58:09 user nova-compute[74850]: WARNING nova.compute.manager [req-ed1d3e18-aaeb-43a5-b0ec-17d237272914 req-792f344b-8ea3-4fa0-9c89-c4f6b25ca005 service nova] [instance: a62a2eab-2502-4275-948b-3f18c3fcff36] Received unexpected event network-vif-plugged-12f841ee-4cd7-42bc-b5c7-4881419e2e26 for instance with vm_state deleted and task_state None.
Nov 14 00:58:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:58:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74850) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 00:58:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:58:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:58:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:22 user nova-compute[74850]: INFO nova.compute.manager [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Rescuing
Nov 14 00:58:22 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "refresh_cache-702746f7-305f-4eac-a71a-6c08b7cbccd8" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:58:22 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquired lock "refresh_cache-702746f7-305f-4eac-a71a-6c08b7cbccd8" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:58:22 user nova-compute[74850]: DEBUG nova.network.neutron [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:58:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:58:23 user nova-compute[74850]: DEBUG nova.network.neutron [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Updating instance_info_cache with network_info: [{"id": "39232b36-eca6-4dac-880c-43aafa9f1719", "address": "fa:16:3e:ac:57:e7", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39232b36-ec", "ovs_interfaceid": "39232b36-eca6-4dac-880c-43aafa9f1719", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:58:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Releasing lock "refresh_cache-702746f7-305f-4eac-a71a-6c08b7cbccd8" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:58:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:24 user nova-compute[74850]: DEBUG nova.compute.manager [req-dfad801e-b749-439f-a752-709ac4937beb req-4078797b-aa07-4d83-a9ca-72150f41b8f2 service nova] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Received event network-vif-unplugged-39232b36-eca6-4dac-880c-43aafa9f1719 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:58:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-dfad801e-b749-439f-a752-709ac4937beb req-4078797b-aa07-4d83-a9ca-72150f41b8f2 service nova] Acquiring lock "702746f7-305f-4eac-a71a-6c08b7cbccd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:58:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-dfad801e-b749-439f-a752-709ac4937beb req-4078797b-aa07-4d83-a9ca-72150f41b8f2 service nova] Lock "702746f7-305f-4eac-a71a-6c08b7cbccd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:58:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-dfad801e-b749-439f-a752-709ac4937beb req-4078797b-aa07-4d83-a9ca-72150f41b8f2 service nova] Lock "702746f7-305f-4eac-a71a-6c08b7cbccd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:58:24 user nova-compute[74850]: DEBUG nova.compute.manager [req-dfad801e-b749-439f-a752-709ac4937beb req-4078797b-aa07-4d83-a9ca-72150f41b8f2 service nova] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] No waiting events found dispatching network-vif-unplugged-39232b36-eca6-4dac-880c-43aafa9f1719 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:58:24 user nova-compute[74850]: WARNING nova.compute.manager [req-dfad801e-b749-439f-a752-709ac4937beb req-4078797b-aa07-4d83-a9ca-72150f41b8f2 service nova] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Received unexpected event network-vif-unplugged-39232b36-eca6-4dac-880c-43aafa9f1719 for instance with vm_state active and task_state rescuing.
Nov 14 00:58:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:24 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Instance destroyed successfully.
Nov 14 00:58:24 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Attempting a stable device rescue
Nov 14 00:58:24 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74850) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 00:58:24 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Instance directory exists: not creating {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 00:58:24 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Creating image(s)
Nov 14 00:58:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "/opt/stack/data/nova/instances/702746f7-305f-4eac-a71a-6c08b7cbccd8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:58:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "/opt/stack/data/nova/instances/702746f7-305f-4eac-a71a-6c08b7cbccd8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:58:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "/opt/stack/data/nova/instances/702746f7-305f-4eac-a71a-6c08b7cbccd8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:58:24 user nova-compute[74850]: DEBUG nova.objects.instance [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lazy-loading 'trusted_certs' on Instance uuid 702746f7-305f-4eac-a71a-6c08b7cbccd8 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:58:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "46d57a6f73da8e9d73a2d757d2c19a6975a416ec" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:58:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "46d57a6f73da8e9d73a2d757d2c19a6975a416ec" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:58:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:25 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46d57a6f73da8e9d73a2d757d2c19a6975a416ec.part --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2bfff296-9adf-4813-9650-1d35a07dbd77 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:58:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2bfff296-9adf-4813-9650-1d35a07dbd77 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:58:25 user nova-compute[74850]: INFO nova.compute.manager [None req-2bfff296-9adf-4813-9650-1d35a07dbd77 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Detaching volume cce03f17-6ce8-4475-b375-12c3351729c0
Nov 14 00:58:26 user nova-compute[74850]: INFO nova.virt.block_device [None req-2bfff296-9adf-4813-9650-1d35a07dbd77 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Attempting to driver detach volume cce03f17-6ce8-4475-b375-12c3351729c0 from mountpoint /dev/vdb
Nov 14 00:58:26 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2bfff296-9adf-4813-9650-1d35a07dbd77 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Attempting to detach device vdb from instance 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf from the persistent domain config. {{(pid=74850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 00:58:26 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-2bfff296-9adf-4813-9650-1d35a07dbd77 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 00:58:26 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:58:26 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 00:58:26 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:58:26 user nova-compute[74850]:   <serial>cce03f17-6ce8-4475-b375-12c3351729c0</serial>
Nov 14 00:58:26 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 00:58:26 user nova-compute[74850]: </disk>
Nov 14 00:58:26 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 00:58:26 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-2bfff296-9adf-4813-9650-1d35a07dbd77 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Successfully detached device vdb from instance 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf from the persistent domain config.
Nov 14 00:58:26 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2bfff296-9adf-4813-9650-1d35a07dbd77 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf from the live domain config. {{(pid=74850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 00:58:26 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-2bfff296-9adf-4813-9650-1d35a07dbd77 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 00:58:26 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:58:26 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 00:58:26 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:58:26 user nova-compute[74850]:   <serial>cce03f17-6ce8-4475-b375-12c3351729c0</serial>
Nov 14 00:58:26 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 00:58:26 user nova-compute[74850]: </disk>
Nov 14 00:58:26 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 00:58:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46d57a6f73da8e9d73a2d757d2c19a6975a416ec.part --force-share --output=json" returned: 0 in 0.193s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:26 user nova-compute[74850]: DEBUG nova.virt.images [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] 75499763-ef88-4ac9-b06e-9c94e05efc5f was qcow2, converting to raw {{(pid=74850) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 00:58:26 user nova-compute[74850]: DEBUG nova.privsep.utils [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74850) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 00:58:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/46d57a6f73da8e9d73a2d757d2c19a6975a416ec.part /opt/stack/data/nova/instances/_base/46d57a6f73da8e9d73a2d757d2c19a6975a416ec.converted {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:26 user nova-compute[74850]: DEBUG nova.compute.manager [req-78cc2693-3ff1-41f5-b702-f7f7ddae400c req-c4d7a76a-a184-46d9-866e-ca309686ea1c service nova] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Received event network-vif-plugged-39232b36-eca6-4dac-880c-43aafa9f1719 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:58:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-78cc2693-3ff1-41f5-b702-f7f7ddae400c req-c4d7a76a-a184-46d9-866e-ca309686ea1c service nova] Acquiring lock "702746f7-305f-4eac-a71a-6c08b7cbccd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:58:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-78cc2693-3ff1-41f5-b702-f7f7ddae400c req-c4d7a76a-a184-46d9-866e-ca309686ea1c service nova] Lock "702746f7-305f-4eac-a71a-6c08b7cbccd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:58:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-78cc2693-3ff1-41f5-b702-f7f7ddae400c req-c4d7a76a-a184-46d9-866e-ca309686ea1c service nova] Lock "702746f7-305f-4eac-a71a-6c08b7cbccd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:58:26 user nova-compute[74850]: DEBUG nova.compute.manager [req-78cc2693-3ff1-41f5-b702-f7f7ddae400c req-c4d7a76a-a184-46d9-866e-ca309686ea1c service nova] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] No waiting events found dispatching network-vif-plugged-39232b36-eca6-4dac-880c-43aafa9f1719 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:58:26 user nova-compute[74850]: WARNING nova.compute.manager [req-78cc2693-3ff1-41f5-b702-f7f7ddae400c req-c4d7a76a-a184-46d9-866e-ca309686ea1c service nova] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Received unexpected event network-vif-plugged-39232b36-eca6-4dac-880c-43aafa9f1719 for instance with vm_state active and task_state rescuing.
Nov 14 00:58:26 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2bfff296-9adf-4813-9650-1d35a07dbd77 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf {{(pid=74850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 00:58:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/46d57a6f73da8e9d73a2d757d2c19a6975a416ec.part /opt/stack/data/nova/instances/_base/46d57a6f73da8e9d73a2d757d2c19a6975a416ec.converted" returned: 0 in 0.704s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46d57a6f73da8e9d73a2d757d2c19a6975a416ec.converted --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46d57a6f73da8e9d73a2d757d2c19a6975a416ec.converted --force-share --output=json" returned: 0 in 0.199s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "46d57a6f73da8e9d73a2d757d2c19a6975a416ec" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.250s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "46d57a6f73da8e9d73a2d757d2c19a6975a416ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "46d57a6f73da8e9d73a2d757d2c19a6975a416ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46d57a6f73da8e9d73a2d757d2c19a6975a416ec --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46d57a6f73da8e9d73a2d757d2c19a6975a416ec --force-share --output=json" returned: 0 in 0.177s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/46d57a6f73da8e9d73a2d757d2c19a6975a416ec,backing_fmt=raw /opt/stack/data/nova/instances/702746f7-305f-4eac-a71a-6c08b7cbccd8/disk.rescue {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/46d57a6f73da8e9d73a2d757d2c19a6975a416ec,backing_fmt=raw /opt/stack/data/nova/instances/702746f7-305f-4eac-a71a-6c08b7cbccd8/disk.rescue" returned: 0 in 0.052s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "46d57a6f73da8e9d73a2d757d2c19a6975a416ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG nova.objects.instance [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lazy-loading 'migration_context' on Instance uuid 702746f7-305f-4eac-a71a-6c08b7cbccd8 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG nova.objects.base [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Object Instance<702746f7-305f-4eac-a71a-6c08b7cbccd8> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Start _get_guest_xml network_info=[{"id": "39232b36-eca6-4dac-880c-43aafa9f1719", "address": "fa:16:3e:ac:57:e7", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "vif_mac": "fa:16:3e:ac:57:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39232b36-ec", "ovs_interfaceid": "39232b36-eca6-4dac-880c-43aafa9f1719", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '75499763-ef88-4ac9-b06e-9c94e05efc5f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c26b97ea-bc13-4e2b-a65f-ebacf4d44ddc', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VeutpWAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '702746f7-305f-4eac-a71a-6c08b7cbccd8', 'attached_at': '', 'detached_at': '', 'volume_id': '83caba72-44f3-43f9-a484-d9f730b0b65d', 'serial': '83caba72-44f3-43f9-a484-d9f730b0b65d'}, 'volume_type': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG nova.objects.instance [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lazy-loading 'resources' on Instance uuid 702746f7-305f-4eac-a71a-6c08b7cbccd8 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG nova.objects.base [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Object Instance<702746f7-305f-4eac-a71a-6c08b7cbccd8> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG nova.objects.instance [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lazy-loading 'numa_topology' on Instance uuid 702746f7-305f-4eac-a71a-6c08b7cbccd8 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG nova.objects.base [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Object Instance<702746f7-305f-4eac-a71a-6c08b7cbccd8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 00:58:27 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:58:27 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:58:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG nova.objects.instance [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lazy-loading 'vcpu_model' on Instance uuid 702746f7-305f-4eac-a71a-6c08b7cbccd8 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG nova.objects.base [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Object Instance<702746f7-305f-4eac-a71a-6c08b7cbccd8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VeutpWAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:58:27 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:58:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:58:27 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:58:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:58:27 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 00:58:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec661fb8-9397-4932-a906-2814c08ee927]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = VeutpWAx\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 00:58:27 user nova-compute[74850]: node.name = iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d
Nov 14 00:58:27 user nova-compute[74850]: node.tpgt = -1
Nov 14 00:58:27 user nova-compute[74850]: node.startup = automatic
Nov 14 00:58:27 user nova-compute[74850]: node.leading_login = No
Nov 14 00:58:27 user nova-compute[74850]: iface.iscsi_ifacename = default
Nov 14 00:58:27 user nova-compute[74850]: iface.net_ifacename = <empty>
Nov 14 00:58:27 user nova-compute[74850]: iface.ipaddress = <empty>
Nov 14 00:58:27 user nova-compute[74850]: iface.prefix_len = 0
Nov 14 00:58:27 user nova-compute[74850]: iface.hwaddress = <empty>
Nov 14 00:58:27 user nova-compute[74850]: iface.transport_name = tcp
Nov 14 00:58:27 user nova-compute[74850]: iface.initiatorname = <empty>
Nov 14 00:58:27 user nova-compute[74850]: iface.state = <empty>
Nov 14 00:58:27 user nova-compute[74850]: iface.vlan_id = 0
Nov 14 00:58:27 user nova-compute[74850]: iface.vlan_priority = 0
Nov 14 00:58:27 user nova-compute[74850]: iface.vlan_state = <empty>
Nov 14 00:58:27 user nova-compute[74850]: iface.iface_num = 0
Nov 14 00:58:27 user nova-compute[74850]: iface.mtu = 0
Nov 14 00:58:27 user nova-compute[74850]: iface.port = 0
Nov 14 00:58:27 user nova-compute[74850]: iface.bootproto = <empty>
Nov 14 00:58:27 user nova-compute[74850]: iface.subnet_mask = <empty>
Nov 14 00:58:27 user nova-compute[74850]: iface.gateway = <empty>
Nov 14 00:58:27 user nova-compute[74850]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 00:58:27 user nova-compute[74850]: iface.dhcp_alt_client_id = <empty>
Nov 14 00:58:27 user nova-compute[74850]: iface.dhcp_dns = <empty>
Nov 14 00:58:27 user nova-compute[74850]: iface.dhcp_learn_iqn = <empty>
Nov 14 00:58:27 user nova-compute[74850]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 00:58:27 user nova-compute[74850]: iface.dhcp_vendor_id_state = <empty>
Nov 14 00:58:27 user nova-compute[74850]: iface.dhcp_vendor_id = <empty>
Nov 14 00:58:27 user nova-compute[74850]: iface.dhcp_slp_da = <empty>
Nov 14 00:58:27 user nova-compute[74850]: iface.fragmentation = <empty>
Nov 14 00:58:27 user nova-compute[74850]: iface.gratuitous_arp = <empty>
Nov 14 00:58:27 user nova-compute[74850]: iface.incoming_forwarding = <empty>
Nov 14 00:58:27 user nova-compute[74850]: iface.tos_state = <empty>
Nov 14 00:58:27 user nova-compute[74850]: iface.tos = 0
Nov 14 00:58:27 user nova-compute[74850]: iface.ttl = 0
Nov 14 00:58:27 user nova-compute[74850]: iface.delayed_ack = <empty>
Nov 14 00:58:27 user nova-compute[74850]: iface.tcp_nagle = <empty>
Nov 14 00:58:27 user nova-compute[74850]: iface.tcp_wsf_state = <empty>
Nov 14 00:58:27 user nova-compute[74850]: iface.tcp_wsf = 0
Nov 14 00:58:27 user nova-compute[74850]: iface.tcp_timer_scale = 0
Nov 14 00:58:27 user nova-compute[74850]: iface.tcp_timestamp = <empty>
Nov 14 00:58:27 user nova-compute[74850]: iface.redirect = <empty>
Nov 14 00:58:27 user nova-compute[74850]: iface.def_task_mgmt_timeout = 0
Nov 14 00:58:27 user nova-compute[74850]: iface.header_digest = <empty>
Nov 14 00:58:27 user nova-compute[74850]: iface.data_digest = <empty>
Nov 14 00:58:27 user nova-compute[74850]: iface.immediate_data = <empty>
Nov 14 00:58:27 user nova-compute[74850]: iface.initial_r2t = <empty>
Nov 14 00:58:27 user nova-compute[74850]: iface.data_seq_inorder = <empty>
Nov 14 00:58:27 user nova-compute[74850]: iface.data_pdu_inorder = <empty>
Nov 14 00:58:27 user nova-compute[74850]: iface.erl = 0
Nov 14 00:58:27 user nova-compute[74850]: iface.max_receive_data_len = 0
Nov 14 00:58:27 user nova-compute[74850]: iface.first_burst_len = 0
Nov 14 00:58:27 user nova-compute[74850]: iface.max_outstanding_r2t = 0
Nov 14 00:58:27 user nova-compute[74850]: iface.max_burst_len = 0
Nov 14 00:58:27 user nova-compute[74850]: iface.chap_auth = <empty>
Nov 14 00:58:27 user nova-compute[74850]: iface.bidi_chap = <empty>
Nov 14 00:58:27 user nova-compute[74850]: iface.strict_login_compliance = <empty>
Nov 14 00:58:27 user nova-compute[74850]: iface.discovery_auth = <empty>
Nov 14 00:58:27 user nova-compute[74850]: iface.discovery_logout = <empty>
Nov 14 00:58:27 user nova-compute[74850]: node.discovery_address = <empty>
Nov 14 00:58:27 user nova-compute[74850]: node.discovery_port = 0
Nov 14 00:58:27 user nova-compute[74850]: node.discovery_type = static
Nov 14 00:58:27 user nova-compute[74850]: node.session.initial_cmdsn = 0
Nov 14 00:58:27 user nova-compute[74850]: node.session.initial_login_retry_max = 8
Nov 14 00:58:27 user nova-compute[74850]: node.session.xmit_thread_priority = -20
Nov 14 00:58:27 user nova-compute[74850]: node.session.cmds_max = 128
Nov 14 00:58:27 user nova-compute[74850]: node.session.queue_depth = 32
Nov 14 00:58:27 user nova-compute[74850]: node.session.nr_sessions = 1
Nov 14 00:58:27 user nova-compute[74850]: node.session.auth.authmethod = CHAP
Nov 14 00:58:27 user nova-compute[74850]: node.session.auth.username = VeutpWAx
Nov 14 00:58:27 user nova-compute[74850]: node.session.auth.password = ***
Nov 14 00:58:27 user nova-compute[74850]: node.session.auth.username_in = <empty>
Nov 14 00:58:27 user nova-compute[74850]: node.session.auth.password_in = <empty>
Nov 14 00:58:27 user nova-compute[74850]: node.session.auth.chap_algs = MD5
Nov 14 00:58:27 user nova-compute[74850]: node.session.timeo.replacement_timeout = 120
Nov 14 00:58:27 user nova-compute[74850]: node.session.err_timeo.abort_timeout = 15
Nov 14 00:58:27 user nova-compute[74850]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 00:58:27 user nova-compute[74850]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 00:58:27 user nova-compute[74850]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 00:58:27 user nova-compute[74850]: node.session.iscsi.FastAbort = Yes
Nov 14 00:58:27 user nova-compute[74850]: node.session.iscsi.InitialR2T = No
Nov 14 00:58:27 user nova-compute[74850]: node.session.iscsi.ImmediateData = Yes
Nov 14 00:58:27 user nova-compute[74850]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 00:58:27 user nova-compute[74850]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 00:58:27 user nova-compute[74850]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 00:58:27 user nova-compute[74850]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 00:58:27 user nova-compute[74850]: node.session.iscsi.MaxConnections = 1
Nov 14 00:58:27 user nova-compute[74850]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 00:58:27 user nova-compute[74850]: node.session.iscsi.ERL = 0
Nov 14 00:58:27 user nova-compute[74850]: node.session.scan = manual
Nov 14 00:58:27 user nova-compute[74850]: node.session.reopen_max = 0
Nov 14 00:58:27 user nova-compute[74850]: node.conn[0].address = 172.16.0.220
Nov 14 00:58:27 user nova-compute[74850]: node.conn[0].port = 3260
Nov 14 00:58:27 user nova-compute[74850]: node.conn[0].startup = manual
Nov 14 00:58:27 user nova-compute[74850]: node.conn[0].tcp.window_size = 524288
Nov 14 00:58:27 user nova-compute[74850]: node.conn[0].tcp.type_of_service = 0
Nov 14 00:58:27 user nova-compute[74850]: node.conn[0].timeo.logout_timeout = 15
Nov 14 00:58:27 user nova-compute[74850]: node.conn[0].timeo.login_timeout = 15
Nov 14 00:58:27 user nova-compute[74850]: node.conn[0].timeo.auth_timeout = 45
Nov 14 00:58:27 user nova-compute[74850]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 00:58:27 user nova-compute[74850]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 00:58:27 user nova-compute[74850]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 00:58:27 user nova-compute[74850]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 00:58:27 user nova-compute[74850]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 00:58:27 user nova-compute[74850]: node.conn[0].iscsi.DataDigest = None
Nov 14 00:58:27 user nova-compute[74850]: node.conn[0].iscsi.IFMarker = No
Nov 14 00:58:27 user nova-compute[74850]: node.conn[0].iscsi.OFMarker = No
Nov 14 00:58:27 user nova-compute[74850]: # END RECORD
Nov 14 00:58:27 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73c955a-7450-41cd-9297-274e34f73973]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b3f664-586f-4350-8969-7952e0ae5f45]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VeutpWAx {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VeutpWAx" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6737b8d-1ff8-419c-b18e-49c193101f41]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VeutpWAx'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[242bbe2f-db56-4a32-b40b-b9f093ae172d]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c000669-db04-4838-bef9-bc7524c2e8df]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:58:27 user nova-compute[74850]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 (non-flash)
Nov 14 00:58:27 user nova-compute[74850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 00:58:27 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:58:27 user nova-compute[74850]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 (non-flash)
Nov 14 00:58:27 user nova-compute[74850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 00:58:27 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.145s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] HCTL ('37', '0', '0', 0) found on session 32 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.013s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad16845-2e99-4a86-90f0-5590dea6b3c5]: (4, ('0 0 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Searching for a device in session 32 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VeutpWAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.169s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] <== connect_volume: return (170ms) {'type': 'block', 'scsi_wwn': '23739386536623036', 'path': '/dev/sdf'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739386536623036', 'path': '/dev/sdf'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:56:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-829621186',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-829621186',id=29,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:56:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='491aa2a4f38140788cb0de9762a8baf4',ramdisk_id='',reservation_id='r-tiybmuy9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-726213232',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:56:53Z,user_data=None,user_id='a5bb5d788a3b4871ae41f57d06f785f2',uuid=702746f7-305f-4eac-a71a-6c08b7cbccd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39232b36-eca6-4dac-880c-43aafa9f1719", "address": "fa:16:3e:ac:57:e7", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "vif_mac": "fa:16:3e:ac:57:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39232b36-ec", "ovs_interfaceid": "39232b36-eca6-4dac-880c-43aafa9f1719", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Converting VIF {"id": "39232b36-eca6-4dac-880c-43aafa9f1719", "address": "fa:16:3e:ac:57:e7", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "vif_mac": "fa:16:3e:ac:57:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39232b36-ec", "ovs_interfaceid": "39232b36-eca6-4dac-880c-43aafa9f1719", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:57:e7,bridge_name='br-int',has_traffic_filtering=True,id=39232b36-eca6-4dac-880c-43aafa9f1719,network=Network(6f8f66ca-e2e8-4565-a05c-df75a16699ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39232b36-ec') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG nova.objects.instance [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lazy-loading 'pci_devices' on Instance uuid 702746f7-305f-4eac-a71a-6c08b7cbccd8 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG nova.objects.base [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Object Instance<702746f7-305f-4eac-a71a-6c08b7cbccd8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:58:27 user nova-compute[74850]:   <uuid>702746f7-305f-4eac-a71a-6c08b7cbccd8</uuid>
Nov 14 00:58:27 user nova-compute[74850]:   <name>instance-0000001d</name>
Nov 14 00:58:27 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:58:27 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:58:27 user nova-compute[74850]:   <metadata>
Nov 14 00:58:27 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:58:27 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:58:27 user nova-compute[74850]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-829621186</nova:name>
Nov 14 00:58:27 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:58:27</nova:creationTime>
Nov 14 00:58:27 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:58:27 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:58:27 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:58:27 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:58:27 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:58:27 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:58:27 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:58:27 user nova-compute[74850]:       <nova:owner>
Nov 14 00:58:27 user nova-compute[74850]:         <nova:user uuid="a5bb5d788a3b4871ae41f57d06f785f2">tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member</nova:user>
Nov 14 00:58:27 user nova-compute[74850]:         <nova:project uuid="491aa2a4f38140788cb0de9762a8baf4">tempest-ServerBootFromVolumeStableRescueTest-726213232</nova:project>
Nov 14 00:58:27 user nova-compute[74850]:       </nova:owner>
Nov 14 00:58:27 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:58:27 user nova-compute[74850]:       <nova:ports>
Nov 14 00:58:27 user nova-compute[74850]:         <nova:port uuid="39232b36-eca6-4dac-880c-43aafa9f1719">
Nov 14 00:58:27 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 00:58:27 user nova-compute[74850]:         </nova:port>
Nov 14 00:58:27 user nova-compute[74850]:       </nova:ports>
Nov 14 00:58:27 user nova-compute[74850]:     </nova:instance>
Nov 14 00:58:27 user nova-compute[74850]:   </metadata>
Nov 14 00:58:27 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:58:27 user nova-compute[74850]:     <system>
Nov 14 00:58:27 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:58:27 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:58:27 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:58:27 user nova-compute[74850]:       <entry name="serial">702746f7-305f-4eac-a71a-6c08b7cbccd8</entry>
Nov 14 00:58:27 user nova-compute[74850]:       <entry name="uuid">702746f7-305f-4eac-a71a-6c08b7cbccd8</entry>
Nov 14 00:58:27 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:58:27 user nova-compute[74850]:     </system>
Nov 14 00:58:27 user nova-compute[74850]:   </sysinfo>
Nov 14 00:58:27 user nova-compute[74850]:   <os>
Nov 14 00:58:27 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:58:27 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:58:27 user nova-compute[74850]:   </os>
Nov 14 00:58:27 user nova-compute[74850]:   <features>
Nov 14 00:58:27 user nova-compute[74850]:     <acpi/>
Nov 14 00:58:27 user nova-compute[74850]:     <apic/>
Nov 14 00:58:27 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:58:27 user nova-compute[74850]:   </features>
Nov 14 00:58:27 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:58:27 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:58:27 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:58:27 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:58:27 user nova-compute[74850]:   </clock>
Nov 14 00:58:27 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:58:27 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:58:27 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:58:27 user nova-compute[74850]:   </cpu>
Nov 14 00:58:27 user nova-compute[74850]:   <devices>
Nov 14 00:58:27 user nova-compute[74850]:     <disk type="block" device="disk">
Nov 14 00:58:27 user nova-compute[74850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:58:27 user nova-compute[74850]:       <source dev="/dev/sdf"/>
Nov 14 00:58:27 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:58:27 user nova-compute[74850]:       <serial>83caba72-44f3-43f9-a484-d9f730b0b65d</serial>
Nov 14 00:58:27 user nova-compute[74850]:     </disk>
Nov 14 00:58:27 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 00:58:27 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:58:27 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/702746f7-305f-4eac-a71a-6c08b7cbccd8/disk.rescue"/>
Nov 14 00:58:27 user nova-compute[74850]:       <target dev="vdb" bus="virtio"/>
Nov 14 00:58:27 user nova-compute[74850]:       <boot order="1"/>
Nov 14 00:58:27 user nova-compute[74850]:     </disk>
Nov 14 00:58:27 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:58:27 user nova-compute[74850]:       <mac address="fa:16:3e:ac:57:e7"/>
Nov 14 00:58:27 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:58:27 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:58:27 user nova-compute[74850]:       <target dev="tap39232b36-ec"/>
Nov 14 00:58:27 user nova-compute[74850]:     </interface>
Nov 14 00:58:27 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:58:27 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/702746f7-305f-4eac-a71a-6c08b7cbccd8/console.log" append="off"/>
Nov 14 00:58:27 user nova-compute[74850]:     </serial>
Nov 14 00:58:27 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:58:27 user nova-compute[74850]:     <video>
Nov 14 00:58:27 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:58:27 user nova-compute[74850]:     </video>
Nov 14 00:58:27 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:58:27 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:58:27 user nova-compute[74850]:     </rng>
Nov 14 00:58:27 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:58:27 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:58:27 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:58:27 user nova-compute[74850]:     </memballoon>
Nov 14 00:58:27 user nova-compute[74850]:   </devices>
Nov 14 00:58:27 user nova-compute[74850]: </domain>
Nov 14 00:58:27 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:58:27 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Instance destroyed successfully.
Nov 14 00:58:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] No VIF found with MAC fa:16:3e:ac:57:e7, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:58:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:29 user nova-compute[74850]: DEBUG nova.compute.manager [req-c767ac00-f5dd-4243-ae69-da5ec4ac72a8 req-ed6e89b0-3bca-42ff-9a4d-dd61330176b0 service nova] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Received event network-vif-plugged-39232b36-eca6-4dac-880c-43aafa9f1719 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:58:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c767ac00-f5dd-4243-ae69-da5ec4ac72a8 req-ed6e89b0-3bca-42ff-9a4d-dd61330176b0 service nova] Acquiring lock "702746f7-305f-4eac-a71a-6c08b7cbccd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:58:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c767ac00-f5dd-4243-ae69-da5ec4ac72a8 req-ed6e89b0-3bca-42ff-9a4d-dd61330176b0 service nova] Lock "702746f7-305f-4eac-a71a-6c08b7cbccd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:58:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c767ac00-f5dd-4243-ae69-da5ec4ac72a8 req-ed6e89b0-3bca-42ff-9a4d-dd61330176b0 service nova] Lock "702746f7-305f-4eac-a71a-6c08b7cbccd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:58:29 user nova-compute[74850]: DEBUG nova.compute.manager [req-c767ac00-f5dd-4243-ae69-da5ec4ac72a8 req-ed6e89b0-3bca-42ff-9a4d-dd61330176b0 service nova] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] No waiting events found dispatching network-vif-plugged-39232b36-eca6-4dac-880c-43aafa9f1719 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:58:29 user nova-compute[74850]: WARNING nova.compute.manager [req-c767ac00-f5dd-4243-ae69-da5ec4ac72a8 req-ed6e89b0-3bca-42ff-9a4d-dd61330176b0 service nova] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Received unexpected event network-vif-plugged-39232b36-eca6-4dac-880c-43aafa9f1719 for instance with vm_state active and task_state rescuing.
Nov 14 00:58:30 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:30 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:31 user nova-compute[74850]: DEBUG nova.compute.manager [None req-32ab168b-e75e-498c-ba3f-431a2274d02a tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:58:31 user nova-compute[74850]: DEBUG nova.compute.manager [req-b7dd7585-61b1-49de-9ced-e7df26fe1487 req-42c4dd61-da35-47d5-9ff3-bac805ed712d service nova] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Received event network-vif-plugged-39232b36-eca6-4dac-880c-43aafa9f1719 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:58:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b7dd7585-61b1-49de-9ced-e7df26fe1487 req-42c4dd61-da35-47d5-9ff3-bac805ed712d service nova] Acquiring lock "702746f7-305f-4eac-a71a-6c08b7cbccd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:58:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b7dd7585-61b1-49de-9ced-e7df26fe1487 req-42c4dd61-da35-47d5-9ff3-bac805ed712d service nova] Lock "702746f7-305f-4eac-a71a-6c08b7cbccd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:58:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b7dd7585-61b1-49de-9ced-e7df26fe1487 req-42c4dd61-da35-47d5-9ff3-bac805ed712d service nova] Lock "702746f7-305f-4eac-a71a-6c08b7cbccd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:58:31 user nova-compute[74850]: DEBUG nova.compute.manager [req-b7dd7585-61b1-49de-9ced-e7df26fe1487 req-42c4dd61-da35-47d5-9ff3-bac805ed712d service nova] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] No waiting events found dispatching network-vif-plugged-39232b36-eca6-4dac-880c-43aafa9f1719 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:58:31 user nova-compute[74850]: WARNING nova.compute.manager [req-b7dd7585-61b1-49de-9ced-e7df26fe1487 req-42c4dd61-da35-47d5-9ff3-bac805ed712d service nova] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Received unexpected event network-vif-plugged-39232b36-eca6-4dac-880c-43aafa9f1719 for instance with vm_state rescued and task_state None.
Nov 14 00:58:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "2749d176-9c59-493e-b3c3-af5980329041" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:58:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "2749d176-9c59-493e-b3c3-af5980329041" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:58:35 user nova-compute[74850]: DEBUG nova.compute.manager [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 00:58:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:58:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:58:35 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 00:58:35 user nova-compute[74850]: INFO nova.compute.claims [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Claim successful on node user
Nov 14 00:58:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:35 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:58:35 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:58:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:58:35 user nova-compute[74850]: DEBUG nova.compute.manager [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 00:58:35 user nova-compute[74850]: DEBUG nova.compute.manager [req-75808f00-87b1-4002-adfc-2064286e260d req-1f15acdb-67bc-446a-bd84-f32121dc1dc7 service nova] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Received event network-changed-d5b53759-f1dd-4a6c-83c0-d4fe816d1131 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:58:35 user nova-compute[74850]: DEBUG nova.compute.manager [req-75808f00-87b1-4002-adfc-2064286e260d req-1f15acdb-67bc-446a-bd84-f32121dc1dc7 service nova] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Refreshing instance network info cache due to event network-changed-d5b53759-f1dd-4a6c-83c0-d4fe816d1131. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:58:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-75808f00-87b1-4002-adfc-2064286e260d req-1f15acdb-67bc-446a-bd84-f32121dc1dc7 service nova] Acquiring lock "refresh_cache-4474ad0e-8eee-4db4-9896-50c049d45d26" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:58:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-75808f00-87b1-4002-adfc-2064286e260d req-1f15acdb-67bc-446a-bd84-f32121dc1dc7 service nova] Acquired lock "refresh_cache-4474ad0e-8eee-4db4-9896-50c049d45d26" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:58:35 user nova-compute[74850]: DEBUG nova.network.neutron [req-75808f00-87b1-4002-adfc-2064286e260d req-1f15acdb-67bc-446a-bd84-f32121dc1dc7 service nova] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Refreshing network info cache for port d5b53759-f1dd-4a6c-83c0-d4fe816d1131 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:58:35 user nova-compute[74850]: DEBUG nova.compute.manager [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 00:58:35 user nova-compute[74850]: DEBUG nova.network.neutron [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 00:58:35 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 00:58:35 user nova-compute[74850]: DEBUG nova.compute.manager [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 00:58:35 user nova-compute[74850]: DEBUG nova.policy [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb027592ab214b57b389227a97576a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f609057d1e44679838d565d80cade3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 00:58:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-48205572-d365-4ad5-87f9-a8eda38e119b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Acquiring lock "4474ad0e-8eee-4db4-9896-50c049d45d26" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:58:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-48205572-d365-4ad5-87f9-a8eda38e119b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "4474ad0e-8eee-4db4-9896-50c049d45d26" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:58:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-48205572-d365-4ad5-87f9-a8eda38e119b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Acquiring lock "4474ad0e-8eee-4db4-9896-50c049d45d26-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:58:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-48205572-d365-4ad5-87f9-a8eda38e119b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "4474ad0e-8eee-4db4-9896-50c049d45d26-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:58:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-48205572-d365-4ad5-87f9-a8eda38e119b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "4474ad0e-8eee-4db4-9896-50c049d45d26-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:58:35 user nova-compute[74850]: INFO nova.compute.manager [None req-48205572-d365-4ad5-87f9-a8eda38e119b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Terminating instance
Nov 14 00:58:35 user nova-compute[74850]: DEBUG nova.compute.manager [None req-48205572-d365-4ad5-87f9-a8eda38e119b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 00:58:35 user nova-compute[74850]: DEBUG nova.compute.manager [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 00:58:35 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 00:58:35 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Creating image(s)
Nov 14 00:58:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "/opt/stack/data/nova/instances/2749d176-9c59-493e-b3c3-af5980329041/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:58:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "/opt/stack/data/nova/instances/2749d176-9c59-493e-b3c3-af5980329041/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:58:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "/opt/stack/data/nova/instances/2749d176-9c59-493e-b3c3-af5980329041/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:58:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.186s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:58:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:58:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:36 user nova-compute[74850]: DEBUG nova.network.neutron [req-75808f00-87b1-4002-adfc-2064286e260d req-1f15acdb-67bc-446a-bd84-f32121dc1dc7 service nova] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Updated VIF entry in instance network info cache for port d5b53759-f1dd-4a6c-83c0-d4fe816d1131. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:58:36 user nova-compute[74850]: DEBUG nova.network.neutron [req-75808f00-87b1-4002-adfc-2064286e260d req-1f15acdb-67bc-446a-bd84-f32121dc1dc7 service nova] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Updating instance_info_cache with network_info: [{"id": "d5b53759-f1dd-4a6c-83c0-d4fe816d1131", "address": "fa:16:3e:50:2f:7c", "network": {"id": "b096d728-1246-4eaa-9222-ed8eee74870c", "bridge": "br-int", "label": "tempest-TestStampPattern-1207618832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e17bbd82f843fdaa3c48d8cb64a2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b53759-f1", "ovs_interfaceid": "d5b53759-f1dd-4a6c-83c0-d4fe816d1131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:58:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-75808f00-87b1-4002-adfc-2064286e260d req-1f15acdb-67bc-446a-bd84-f32121dc1dc7 service nova] Releasing lock "refresh_cache-4474ad0e-8eee-4db4-9896-50c049d45d26" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:58:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.187s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/2749d176-9c59-493e-b3c3-af5980329041/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/2749d176-9c59-493e-b3c3-af5980329041/disk 1073741824" returned: 0 in 0.059s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:58:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.188s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:36 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2749d176-9c59-493e-b3c3-af5980329041/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 00:58:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2749d176-9c59-493e-b3c3-af5980329041/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:36 user nova-compute[74850]: DEBUG nova.network.neutron [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Successfully created port: 021a5c27-b8d3-492f-b536-69e13aae8216 {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:58:36 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Instance destroyed successfully.
Nov 14 00:58:36 user nova-compute[74850]: DEBUG nova.objects.instance [None req-48205572-d365-4ad5-87f9-a8eda38e119b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lazy-loading 'resources' on Instance uuid 4474ad0e-8eee-4db4-9896-50c049d45d26 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:58:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-48205572-d365-4ad5-87f9-a8eda38e119b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:51:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1019310177',display_name='tempest-TestStampPattern-server-1019310177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1019310177',id=23,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrZlgeE9/Eb/dSvSLuh1rHNCQMOaoa95CjuZ377Ld81ZeZuC/2z69Zf0ms8CG6YuI4ZXEqqItRYp52TjDRYLlQoYwNXCNYDhSdvz3DpnModEihmBQQVehRcSLXR08S+jQ==',key_name='tempest-TestStampPattern-158458074',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:51:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='82e17bbd82f843fdaa3c48d8cb64a2c9',ramdisk_id='',reservation_id='r-01bnjg4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1231523385',owner_user_name='tempest-TestStampPattern-1231523385-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:54:46Z,user_data=None,user_id='208acda449ad436c85bdbebff0560e63',uuid=4474ad0e-8eee-4db4-9896-50c049d45d26,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5b53759-f1dd-4a6c-83c0-d4fe816d1131", "address": "fa:16:3e:50:2f:7c", "network": {"id": "b096d728-1246-4eaa-9222-ed8eee74870c", "bridge": "br-int", "label": "tempest-TestStampPattern-1207618832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e17bbd82f843fdaa3c48d8cb64a2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b53759-f1", "ovs_interfaceid": "d5b53759-f1dd-4a6c-83c0-d4fe816d1131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:58:36 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-48205572-d365-4ad5-87f9-a8eda38e119b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Converting VIF {"id": "d5b53759-f1dd-4a6c-83c0-d4fe816d1131", "address": "fa:16:3e:50:2f:7c", "network": {"id": "b096d728-1246-4eaa-9222-ed8eee74870c", "bridge": "br-int", "label": "tempest-TestStampPattern-1207618832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e17bbd82f843fdaa3c48d8cb64a2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b53759-f1", "ovs_interfaceid": "d5b53759-f1dd-4a6c-83c0-d4fe816d1131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:58:36 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-48205572-d365-4ad5-87f9-a8eda38e119b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:2f:7c,bridge_name='br-int',has_traffic_filtering=True,id=d5b53759-f1dd-4a6c-83c0-d4fe816d1131,network=Network(b096d728-1246-4eaa-9222-ed8eee74870c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5b53759-f1') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:58:36 user nova-compute[74850]: DEBUG os_vif [None req-48205572-d365-4ad5-87f9-a8eda38e119b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:2f:7c,bridge_name='br-int',has_traffic_filtering=True,id=d5b53759-f1dd-4a6c-83c0-d4fe816d1131,network=Network(b096d728-1246-4eaa-9222-ed8eee74870c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5b53759-f1') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:58:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5b53759-f1, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:58:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:58:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05a260db-94b2-4c23-95c9-6c9e69e371c5) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:58:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:58:36 user nova-compute[74850]: INFO os_vif [None req-48205572-d365-4ad5-87f9-a8eda38e119b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:2f:7c,bridge_name='br-int',has_traffic_filtering=True,id=d5b53759-f1dd-4a6c-83c0-d4fe816d1131,network=Network(b096d728-1246-4eaa-9222-ed8eee74870c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5b53759-f1')
Nov 14 00:58:36 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-48205572-d365-4ad5-87f9-a8eda38e119b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Deleting instance files /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26_del
Nov 14 00:58:36 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-48205572-d365-4ad5-87f9-a8eda38e119b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Deletion of /opt/stack/data/nova/instances/4474ad0e-8eee-4db4-9896-50c049d45d26_del complete
Nov 14 00:58:36 user nova-compute[74850]: INFO nova.compute.manager [None req-48205572-d365-4ad5-87f9-a8eda38e119b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 14 00:58:36 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-48205572-d365-4ad5-87f9-a8eda38e119b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 00:58:36 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 00:58:36 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 00:58:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2749d176-9c59-493e-b3c3-af5980329041/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:36 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Cannot resize image /opt/stack/data/nova/instances/2749d176-9c59-493e-b3c3-af5980329041/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 00:58:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 00:58:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Ensure instance console log exists: /opt/stack/data/nova/instances/2749d176-9c59-493e-b3c3-af5980329041/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 00:58:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:58:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:58:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG nova.network.neutron [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Successfully updated port: 021a5c27-b8d3-492f-b536-69e13aae8216 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "refresh_cache-2749d176-9c59-493e-b3c3-af5980329041" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquired lock "refresh_cache-2749d176-9c59-493e-b3c3-af5980329041" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG nova.network.neutron [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:58:37 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Took 0.50 seconds to deallocate network for instance.
Nov 14 00:58:37 user nova-compute[74850]: DEBUG nova.compute.manager [req-ce71f4b6-8abc-43ce-963d-26d22c414574 req-4c397d97-0e25-4d9d-b211-3f916b917100 service nova] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Received event network-changed-021a5c27-b8d3-492f-b536-69e13aae8216 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG nova.compute.manager [req-ce71f4b6-8abc-43ce-963d-26d22c414574 req-4c397d97-0e25-4d9d-b211-3f916b917100 service nova] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Refreshing instance network info cache due to event network-changed-021a5c27-b8d3-492f-b536-69e13aae8216. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ce71f4b6-8abc-43ce-963d-26d22c414574 req-4c397d97-0e25-4d9d-b211-3f916b917100 service nova] Acquiring lock "refresh_cache-2749d176-9c59-493e-b3c3-af5980329041" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-48205572-d365-4ad5-87f9-a8eda38e119b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-48205572-d365-4ad5-87f9-a8eda38e119b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG nova.network.neutron [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG nova.network.neutron [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Updating instance_info_cache with network_info: [{"id": "021a5c27-b8d3-492f-b536-69e13aae8216", "address": "fa:16:3e:77:48:ae", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021a5c27-b8", "ovs_interfaceid": "021a5c27-b8d3-492f-b536-69e13aae8216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Releasing lock "refresh_cache-2749d176-9c59-493e-b3c3-af5980329041" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG nova.compute.manager [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Instance network_info: |[{"id": "021a5c27-b8d3-492f-b536-69e13aae8216", "address": "fa:16:3e:77:48:ae", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021a5c27-b8", "ovs_interfaceid": "021a5c27-b8d3-492f-b536-69e13aae8216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ce71f4b6-8abc-43ce-963d-26d22c414574 req-4c397d97-0e25-4d9d-b211-3f916b917100 service nova] Acquired lock "refresh_cache-2749d176-9c59-493e-b3c3-af5980329041" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG nova.network.neutron [req-ce71f4b6-8abc-43ce-963d-26d22c414574 req-4c397d97-0e25-4d9d-b211-3f916b917100 service nova] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Refreshing network info cache for port 021a5c27-b8d3-492f-b536-69e13aae8216 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Start _get_guest_xml network_info=[{"id": "021a5c27-b8d3-492f-b536-69e13aae8216", "address": "fa:16:3e:77:48:ae", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021a5c27-b8", "ovs_interfaceid": "021a5c27-b8d3-492f-b536-69e13aae8216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-48205572-d365-4ad5-87f9-a8eda38e119b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:58:37 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:58:37 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:58:37 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-48205572-d365-4ad5-87f9-a8eda38e119b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:58:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1605490917',display_name='tempest-AttachVolumeNegativeTest-server-1605490917',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1605490917',id=31,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLpBY92Em/Y+DF81kuDBnosgwSxcAXqsnW32pYf5a3o2cZY/5eLk1T7zgqDAS/T4yRRyDs2nbdPCYLTEOXLF18X7DWo/x+V8pcN0r5N1UqQ891bevyfqI6wIrYYrJQExA==',key_name='tempest-keypair-1782448778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35f609057d1e44679838d565d80cade3',ramdisk_id='',reservation_id='r-ti4qyqg7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1995397455',owner_user_name='tempest-AttachVolumeNegativeTest-1995397455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:58:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb027592ab214b57b389227a97576a43',uuid=2749d176-9c59-493e-b3c3-af5980329041,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "021a5c27-b8d3-492f-b536-69e13aae8216", "address": "fa:16:3e:77:48:ae", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021a5c27-b8", "ovs_interfaceid": "021a5c27-b8d3-492f-b536-69e13aae8216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Converting VIF {"id": "021a5c27-b8d3-492f-b536-69e13aae8216", "address": "fa:16:3e:77:48:ae", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021a5c27-b8", "ovs_interfaceid": "021a5c27-b8d3-492f-b536-69e13aae8216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:48:ae,bridge_name='br-int',has_traffic_filtering=True,id=021a5c27-b8d3-492f-b536-69e13aae8216,network=Network(11208f55-0e63-4c33-a12c-e061c8061eec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021a5c27-b8') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG nova.objects.instance [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lazy-loading 'pci_devices' on Instance uuid 2749d176-9c59-493e-b3c3-af5980329041 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-48205572-d365-4ad5-87f9-a8eda38e119b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:58:37 user nova-compute[74850]:   <uuid>2749d176-9c59-493e-b3c3-af5980329041</uuid>
Nov 14 00:58:37 user nova-compute[74850]:   <name>instance-0000001f</name>
Nov 14 00:58:37 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:58:37 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:58:37 user nova-compute[74850]:   <metadata>
Nov 14 00:58:37 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:58:37 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:58:37 user nova-compute[74850]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1605490917</nova:name>
Nov 14 00:58:37 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:58:37</nova:creationTime>
Nov 14 00:58:37 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:58:37 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:58:37 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:58:37 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:58:37 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:58:37 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:58:37 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:58:37 user nova-compute[74850]:       <nova:owner>
Nov 14 00:58:37 user nova-compute[74850]:         <nova:user uuid="fb027592ab214b57b389227a97576a43">tempest-AttachVolumeNegativeTest-1995397455-project-member</nova:user>
Nov 14 00:58:37 user nova-compute[74850]:         <nova:project uuid="35f609057d1e44679838d565d80cade3">tempest-AttachVolumeNegativeTest-1995397455</nova:project>
Nov 14 00:58:37 user nova-compute[74850]:       </nova:owner>
Nov 14 00:58:37 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:58:37 user nova-compute[74850]:       <nova:ports>
Nov 14 00:58:37 user nova-compute[74850]:         <nova:port uuid="021a5c27-b8d3-492f-b536-69e13aae8216">
Nov 14 00:58:37 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 00:58:37 user nova-compute[74850]:         </nova:port>
Nov 14 00:58:37 user nova-compute[74850]:       </nova:ports>
Nov 14 00:58:37 user nova-compute[74850]:     </nova:instance>
Nov 14 00:58:37 user nova-compute[74850]:   </metadata>
Nov 14 00:58:37 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:58:37 user nova-compute[74850]:     <system>
Nov 14 00:58:37 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:58:37 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:58:37 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:58:37 user nova-compute[74850]:       <entry name="serial">2749d176-9c59-493e-b3c3-af5980329041</entry>
Nov 14 00:58:37 user nova-compute[74850]:       <entry name="uuid">2749d176-9c59-493e-b3c3-af5980329041</entry>
Nov 14 00:58:37 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:58:37 user nova-compute[74850]:     </system>
Nov 14 00:58:37 user nova-compute[74850]:   </sysinfo>
Nov 14 00:58:37 user nova-compute[74850]:   <os>
Nov 14 00:58:37 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:58:37 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 00:58:37 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:58:37 user nova-compute[74850]:   </os>
Nov 14 00:58:37 user nova-compute[74850]:   <features>
Nov 14 00:58:37 user nova-compute[74850]:     <acpi/>
Nov 14 00:58:37 user nova-compute[74850]:     <apic/>
Nov 14 00:58:37 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:58:37 user nova-compute[74850]:   </features>
Nov 14 00:58:37 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:58:37 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:58:37 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:58:37 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:58:37 user nova-compute[74850]:   </clock>
Nov 14 00:58:37 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:58:37 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:58:37 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:58:37 user nova-compute[74850]:   </cpu>
Nov 14 00:58:37 user nova-compute[74850]:   <devices>
Nov 14 00:58:37 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 00:58:37 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:58:37 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/2749d176-9c59-493e-b3c3-af5980329041/disk"/>
Nov 14 00:58:37 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:58:37 user nova-compute[74850]:     </disk>
Nov 14 00:58:37 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:58:37 user nova-compute[74850]:       <mac address="fa:16:3e:77:48:ae"/>
Nov 14 00:58:37 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:58:37 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:58:37 user nova-compute[74850]:       <target dev="tap021a5c27-b8"/>
Nov 14 00:58:37 user nova-compute[74850]:     </interface>
Nov 14 00:58:37 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:58:37 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/2749d176-9c59-493e-b3c3-af5980329041/console.log" append="off"/>
Nov 14 00:58:37 user nova-compute[74850]:     </serial>
Nov 14 00:58:37 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:58:37 user nova-compute[74850]:     <video>
Nov 14 00:58:37 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:58:37 user nova-compute[74850]:     </video>
Nov 14 00:58:37 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:58:37 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:58:37 user nova-compute[74850]:     </rng>
Nov 14 00:58:37 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:58:37 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:58:37 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:58:37 user nova-compute[74850]:     </memballoon>
Nov 14 00:58:37 user nova-compute[74850]:   </devices>
Nov 14 00:58:37 user nova-compute[74850]: </domain>
Nov 14 00:58:37 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:58:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1605490917',display_name='tempest-AttachVolumeNegativeTest-server-1605490917',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1605490917',id=31,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLpBY92Em/Y+DF81kuDBnosgwSxcAXqsnW32pYf5a3o2cZY/5eLk1T7zgqDAS/T4yRRyDs2nbdPCYLTEOXLF18X7DWo/x+V8pcN0r5N1UqQ891bevyfqI6wIrYYrJQExA==',key_name='tempest-keypair-1782448778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35f609057d1e44679838d565d80cade3',ramdisk_id='',reservation_id='r-ti4qyqg7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1995397455',owner_user_name='tempest-AttachVolumeNegativeTest-1995397455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:58:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb027592ab214b57b389227a97576a43',uuid=2749d176-9c59-493e-b3c3-af5980329041,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "021a5c27-b8d3-492f-b536-69e13aae8216", "address": "fa:16:3e:77:48:ae", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021a5c27-b8", "ovs_interfaceid": "021a5c27-b8d3-492f-b536-69e13aae8216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Converting VIF {"id": "021a5c27-b8d3-492f-b536-69e13aae8216", "address": "fa:16:3e:77:48:ae", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021a5c27-b8", "ovs_interfaceid": "021a5c27-b8d3-492f-b536-69e13aae8216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:48:ae,bridge_name='br-int',has_traffic_filtering=True,id=021a5c27-b8d3-492f-b536-69e13aae8216,network=Network(11208f55-0e63-4c33-a12c-e061c8061eec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021a5c27-b8') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG os_vif [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:48:ae,bridge_name='br-int',has_traffic_filtering=True,id=021a5c27-b8d3-492f-b536-69e13aae8216,network=Network(11208f55-0e63-4c33-a12c-e061c8061eec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021a5c27-b8') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c3a5c996-3ccd-5483-914d-703361dae53c', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap021a5c27-b8, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap021a5c27-b8, col_values=(('qos', UUID('d3548db4-712b-4da4-97f8-b54abdf46ca5')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap021a5c27-b8, col_values=(('external_ids', {'iface-id': '021a5c27-b8d3-492f-b536-69e13aae8216', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:48:ae', 'vm-uuid': '2749d176-9c59-493e-b3c3-af5980329041'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:37 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-48205572-d365-4ad5-87f9-a8eda38e119b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Deleted allocations for instance 4474ad0e-8eee-4db4-9896-50c049d45d26
Nov 14 00:58:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:37 user nova-compute[74850]: INFO os_vif [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:48:ae,bridge_name='br-int',has_traffic_filtering=True,id=021a5c27-b8d3-492f-b536-69e13aae8216,network=Network(11208f55-0e63-4c33-a12c-e061c8061eec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021a5c27-b8')
Nov 14 00:58:37 user nova-compute[74850]: DEBUG nova.compute.manager [req-07038aa3-50e2-4925-a908-789dbecd9dbd req-cd8a8045-03c7-4a44-8937-970b351cd3e0 service nova] [instance: 4474ad0e-8eee-4db4-9896-50c049d45d26] Received event network-vif-deleted-d5b53759-f1dd-4a6c-83c0-d4fe816d1131 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] No VIF found with MAC fa:16:3e:77:48:ae, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:58:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-48205572-d365-4ad5-87f9-a8eda38e119b tempest-TestStampPattern-1231523385 tempest-TestStampPattern-1231523385-project-member] Lock "4474ad0e-8eee-4db4-9896-50c049d45d26" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.930s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:58:38 user nova-compute[74850]: DEBUG nova.network.neutron [req-ce71f4b6-8abc-43ce-963d-26d22c414574 req-4c397d97-0e25-4d9d-b211-3f916b917100 service nova] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Updated VIF entry in instance network info cache for port 021a5c27-b8d3-492f-b536-69e13aae8216. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:58:38 user nova-compute[74850]: DEBUG nova.network.neutron [req-ce71f4b6-8abc-43ce-963d-26d22c414574 req-4c397d97-0e25-4d9d-b211-3f916b917100 service nova] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Updating instance_info_cache with network_info: [{"id": "021a5c27-b8d3-492f-b536-69e13aae8216", "address": "fa:16:3e:77:48:ae", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021a5c27-b8", "ovs_interfaceid": "021a5c27-b8d3-492f-b536-69e13aae8216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:58:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ce71f4b6-8abc-43ce-963d-26d22c414574 req-4c397d97-0e25-4d9d-b211-3f916b917100 service nova] Releasing lock "refresh_cache-2749d176-9c59-493e-b3c3-af5980329041" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:58:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:39 user nova-compute[74850]: DEBUG nova.compute.manager [req-1dde6ccc-9f24-432a-a46b-99d73b1b0885 req-c3622bdd-f930-44f6-85f9-bf5194b12fd5 service nova] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Received event network-vif-plugged-021a5c27-b8d3-492f-b536-69e13aae8216 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:58:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-1dde6ccc-9f24-432a-a46b-99d73b1b0885 req-c3622bdd-f930-44f6-85f9-bf5194b12fd5 service nova] Acquiring lock "2749d176-9c59-493e-b3c3-af5980329041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:58:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-1dde6ccc-9f24-432a-a46b-99d73b1b0885 req-c3622bdd-f930-44f6-85f9-bf5194b12fd5 service nova] Lock "2749d176-9c59-493e-b3c3-af5980329041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:58:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-1dde6ccc-9f24-432a-a46b-99d73b1b0885 req-c3622bdd-f930-44f6-85f9-bf5194b12fd5 service nova] Lock "2749d176-9c59-493e-b3c3-af5980329041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:58:39 user nova-compute[74850]: DEBUG nova.compute.manager [req-1dde6ccc-9f24-432a-a46b-99d73b1b0885 req-c3622bdd-f930-44f6-85f9-bf5194b12fd5 service nova] [instance: 2749d176-9c59-493e-b3c3-af5980329041] No waiting events found dispatching network-vif-plugged-021a5c27-b8d3-492f-b536-69e13aae8216 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:58:39 user nova-compute[74850]: WARNING nova.compute.manager [req-1dde6ccc-9f24-432a-a46b-99d73b1b0885 req-c3622bdd-f930-44f6-85f9-bf5194b12fd5 service nova] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Received unexpected event network-vif-plugged-021a5c27-b8d3-492f-b536-69e13aae8216 for instance with vm_state building and task_state spawning.
Nov 14 00:58:39 user nova-compute[74850]: DEBUG nova.compute.manager [req-1dde6ccc-9f24-432a-a46b-99d73b1b0885 req-c3622bdd-f930-44f6-85f9-bf5194b12fd5 service nova] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Received event network-vif-plugged-021a5c27-b8d3-492f-b536-69e13aae8216 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:58:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-1dde6ccc-9f24-432a-a46b-99d73b1b0885 req-c3622bdd-f930-44f6-85f9-bf5194b12fd5 service nova] Acquiring lock "2749d176-9c59-493e-b3c3-af5980329041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:58:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-1dde6ccc-9f24-432a-a46b-99d73b1b0885 req-c3622bdd-f930-44f6-85f9-bf5194b12fd5 service nova] Lock "2749d176-9c59-493e-b3c3-af5980329041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:58:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-1dde6ccc-9f24-432a-a46b-99d73b1b0885 req-c3622bdd-f930-44f6-85f9-bf5194b12fd5 service nova] Lock "2749d176-9c59-493e-b3c3-af5980329041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:58:39 user nova-compute[74850]: DEBUG nova.compute.manager [req-1dde6ccc-9f24-432a-a46b-99d73b1b0885 req-c3622bdd-f930-44f6-85f9-bf5194b12fd5 service nova] [instance: 2749d176-9c59-493e-b3c3-af5980329041] No waiting events found dispatching network-vif-plugged-021a5c27-b8d3-492f-b536-69e13aae8216 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:58:39 user nova-compute[74850]: WARNING nova.compute.manager [req-1dde6ccc-9f24-432a-a46b-99d73b1b0885 req-c3622bdd-f930-44f6-85f9-bf5194b12fd5 service nova] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Received unexpected event network-vif-plugged-021a5c27-b8d3-492f-b536-69e13aae8216 for instance with vm_state building and task_state spawning.
Nov 14 00:58:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:41 user nova-compute[74850]: DEBUG nova.compute.manager [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:58:41 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 00:58:41 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Instance spawned successfully.
Nov 14 00:58:41 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 00:58:41 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:58:41 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:58:41 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:58:41 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:58:41 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:58:41 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:58:41 user nova-compute[74850]: INFO nova.compute.manager [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Took 5.37 seconds to spawn the instance on the hypervisor.
Nov 14 00:58:41 user nova-compute[74850]: DEBUG nova.compute.manager [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:58:41 user nova-compute[74850]: INFO nova.compute.manager [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Took 6.22 seconds to build instance.
Nov 14 00:58:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-724a1c48-ece1-4a0b-88ff-beb2af9a02d2 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "2749d176-9c59-493e-b3c3-af5980329041" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.313s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:58:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:46 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-2bfff296-9adf-4813-9650-1d35a07dbd77 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf is timed out.
Nov 14 00:58:46 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-2bfff296-9adf-4813-9650-1d35a07dbd77 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Successfully detached device vdb from instance 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf from the live domain config.
Nov 14 00:58:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bfff296-9adf-4813-9650-1d35a07dbd77 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfff296-9adf-4813-9650-1d35a07dbd77 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ePlbYuKM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:58:46 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-2bfff296-9adf-4813-9650-1d35a07dbd77 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:58:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-2bfff296-9adf-4813-9650-1d35a07dbd77 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-2bfff296-9adf-4813-9650-1d35a07dbd77 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0b87c3-3c45-4717-a3f8-ebfe6101152d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfff296-9adf-4813-9650-1d35a07dbd77 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 00:58:46 user nova-compute[74850]: No targets found.
Nov 14 00:58:46 user nova-compute[74850]: iSNS:
Nov 14 00:58:46 user nova-compute[74850]: No targets found.
Nov 14 00:58:46 user nova-compute[74850]: STATIC:
Nov 14 00:58:46 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a
Nov 14 00:58:46 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:58:46 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:58:46 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d
Nov 14 00:58:46 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:58:46 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:58:46 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0
Nov 14 00:58:46 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:58:46 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:58:46 user nova-compute[74850]: FIRMWARE:
Nov 14 00:58:46 user nova-compute[74850]: No targets found.
Nov 14 00:58:46 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfff296-9adf-4813-9650-1d35a07dbd77 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 00:58:46 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 00:58:46 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfff296-9adf-4813-9650-1d35a07dbd77 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5847c12a-518b-4140-a473-c146b34046f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f3949b-d8d0-42af-acb2-3fcb26fb1835]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfff296-9adf-4813-9650-1d35a07dbd77 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:58:46 user nova-compute[74850]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 (non-flash)
Nov 14 00:58:46 user nova-compute[74850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 00:58:46 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfff296-9adf-4813-9650-1d35a07dbd77 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:58:46 user nova-compute[74850]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 (non-flash)
Nov 14 00:58:46 user nova-compute[74850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 00:58:46 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfff296-9adf-4813-9650-1d35a07dbd77 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a5c1b8670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0'): ({'sdb'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-2bfff296-9adf-4813-9650-1d35a07dbd77 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Removing single pathed devices sdb {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c441df2-c7d3-4e56-8b6d-a225c37abeb1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69a6603-ce2b-42fa-a43b-b7287b0e69ca]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-2bfff296-9adf-4813-9650-1d35a07dbd77 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Flushing IO for device /dev/sdb {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.011s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1cef40-37b2-419a-baab-c96b41b4851a]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-2bfff296-9adf-4813-9650-1d35a07dbd77 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7073f5e9-1cc4-44cc-a70a-6679e8da1169]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-2bfff296-9adf-4813-9650-1d35a07dbd77 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-2bfff296-9adf-4813-9650-1d35a07dbd77 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfff296-9adf-4813-9650-1d35a07dbd77 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4176256-d31e-448c-9f56-f650643315f6]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfff296-9adf-4813-9650-1d35a07dbd77 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e8e60d-fe31-4b89-93e4-cba8b9eb28e9]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfff296-9adf-4813-9650-1d35a07dbd77 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0, portal: 172.16.0.220,3260]
Nov 14 00:58:46 user nova-compute[74850]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0, portal: 172.16.0.220,3260] successful.
Nov 14 00:58:46 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cce03f17-6ce8-4475-b375-12c3351729c0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f885f427-06e5-46db-b15c-29cc3c365956]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfff296-9adf-4813-9650-1d35a07dbd77 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-2bfff296-9adf-4813-9650-1d35a07dbd77 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfff296-9adf-4813-9650-1d35a07dbd77 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] <== disconnect_volume: return (283ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:58:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bfff296-9adf-4813-9650-1d35a07dbd77 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 00:58:47 user nova-compute[74850]: DEBUG nova.objects.instance [None req-2bfff296-9adf-4813-9650-1d35a07dbd77 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lazy-loading 'flavor' on Instance uuid 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:58:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2bfff296-9adf-4813-9650-1d35a07dbd77 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.735s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:58:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:49 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:58:49 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:58:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:58:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:58:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:58:49 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 00:58:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:58:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2749d176-9c59-493e-b3c3-af5980329041/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2749d176-9c59-493e-b3c3-af5980329041/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2749d176-9c59-493e-b3c3-af5980329041/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2749d176-9c59-493e-b3c3-af5980329041/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:58:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/702746f7-305f-4eac-a71a-6c08b7cbccd8/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/702746f7-305f-4eac-a71a-6c08b7cbccd8/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/702746f7-305f-4eac-a71a-6c08b7cbccd8/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/702746f7-305f-4eac-a71a-6c08b7cbccd8/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:58:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:58:54 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:58:54 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:58:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=7833MB free_disk=25.11768341064453GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 00:58:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:58:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:58:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance a70d0196-f90e-47c4-be67-bf7ef4c3d8c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:58:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 1879be4c-9226-4c8c-a56c-f8e37398851b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:58:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 748d0da7-bbb9-4e86-aae3-e48b1fa04c14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:58:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 211c1477-8a76-4ecd-a7c8-dc0b5903d38c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:58:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance c7952bff-87d6-46c1-a6d4-7729dc4893ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:58:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:58:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 702746f7-305f-4eac-a71a-6c08b7cbccd8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:58:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 782a85d0-b427-4ee2-8d6c-778602f00bcd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:58:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 2749d176-9c59-493e-b3c3-af5980329041 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:58:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 00:58:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 00:58:54 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:58:54 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:58:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 00:58:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.405s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:58:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:57 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:58:57 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:58:57 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:58:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:58:57 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:58:57 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 00:58:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "refresh_cache-1879be4c-9226-4c8c-a56c-f8e37398851b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:58:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquired lock "refresh_cache-1879be4c-9226-4c8c-a56c-f8e37398851b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:58:58 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Forcefully refreshing network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 00:58:58 user nova-compute[74850]: DEBUG nova.compute.manager [req-17542baa-2b41-4453-bf17-f893147d37a4 req-f0bf314e-e48f-4f2f-b2e7-0b44ef9e8829 service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Received event network-changed-5a111053-6390-4a23-97c2-9171e744c3c7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:58:58 user nova-compute[74850]: DEBUG nova.compute.manager [req-17542baa-2b41-4453-bf17-f893147d37a4 req-f0bf314e-e48f-4f2f-b2e7-0b44ef9e8829 service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Refreshing instance network info cache due to event network-changed-5a111053-6390-4a23-97c2-9171e744c3c7. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:58:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-17542baa-2b41-4453-bf17-f893147d37a4 req-f0bf314e-e48f-4f2f-b2e7-0b44ef9e8829 service nova] Acquiring lock "refresh_cache-211c1477-8a76-4ecd-a7c8-dc0b5903d38c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:58:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-17542baa-2b41-4453-bf17-f893147d37a4 req-f0bf314e-e48f-4f2f-b2e7-0b44ef9e8829 service nova] Acquired lock "refresh_cache-211c1477-8a76-4ecd-a7c8-dc0b5903d38c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:58:58 user nova-compute[74850]: DEBUG nova.network.neutron [req-17542baa-2b41-4453-bf17-f893147d37a4 req-f0bf314e-e48f-4f2f-b2e7-0b44ef9e8829 service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Refreshing network info cache for port 5a111053-6390-4a23-97c2-9171e744c3c7 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:58:58 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Updating instance_info_cache with network_info: [{"id": "ff543781-9ab0-418a-ab62-1a74ee0ed1a9", "address": "fa:16:3e:04:e7:ab", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff543781-9a", "ovs_interfaceid": "ff543781-9ab0-418a-ab62-1a74ee0ed1a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:58:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Releasing lock "refresh_cache-1879be4c-9226-4c8c-a56c-f8e37398851b" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:58:58 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Updated the network info_cache for instance {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 00:58:58 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:58:58 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 00:58:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5270b017-52f9-4386-b357-4ec976ba2348 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:58:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5270b017-52f9-4386-b357-4ec976ba2348 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:58:58 user nova-compute[74850]: INFO nova.compute.manager [None req-5270b017-52f9-4386-b357-4ec976ba2348 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Detaching volume e5967bf1-73b3-46b7-ab8b-f48f9198036a
Nov 14 00:58:58 user nova-compute[74850]: INFO nova.virt.block_device [None req-5270b017-52f9-4386-b357-4ec976ba2348 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Attempting to driver detach volume e5967bf1-73b3-46b7-ab8b-f48f9198036a from mountpoint /dev/vdb
Nov 14 00:58:58 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5270b017-52f9-4386-b357-4ec976ba2348 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Attempting to detach device vdb from instance 211c1477-8a76-4ecd-a7c8-dc0b5903d38c from the persistent domain config. {{(pid=74850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 00:58:58 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-5270b017-52f9-4386-b357-4ec976ba2348 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 00:58:58 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:58:58 user nova-compute[74850]:   <source dev="/dev/sde"/>
Nov 14 00:58:58 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:58:58 user nova-compute[74850]:   <serial>e5967bf1-73b3-46b7-ab8b-f48f9198036a</serial>
Nov 14 00:58:58 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 00:58:58 user nova-compute[74850]: </disk>
Nov 14 00:58:58 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 00:58:58 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-5270b017-52f9-4386-b357-4ec976ba2348 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Successfully detached device vdb from instance 211c1477-8a76-4ecd-a7c8-dc0b5903d38c from the persistent domain config.
Nov 14 00:58:58 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5270b017-52f9-4386-b357-4ec976ba2348 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 211c1477-8a76-4ecd-a7c8-dc0b5903d38c from the live domain config. {{(pid=74850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 00:58:58 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-5270b017-52f9-4386-b357-4ec976ba2348 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 00:58:58 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:58:58 user nova-compute[74850]:   <source dev="/dev/sde"/>
Nov 14 00:58:58 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:58:58 user nova-compute[74850]:   <serial>e5967bf1-73b3-46b7-ab8b-f48f9198036a</serial>
Nov 14 00:58:58 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 00:58:58 user nova-compute[74850]: </disk>
Nov 14 00:58:58 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 00:58:58 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:58:58 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:58:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5270b017-52f9-4386-b357-4ec976ba2348 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 211c1477-8a76-4ecd-a7c8-dc0b5903d38c {{(pid=74850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 00:58:59 user nova-compute[74850]: DEBUG nova.network.neutron [req-17542baa-2b41-4453-bf17-f893147d37a4 req-f0bf314e-e48f-4f2f-b2e7-0b44ef9e8829 service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Updated VIF entry in instance network info cache for port 5a111053-6390-4a23-97c2-9171e744c3c7. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:58:59 user nova-compute[74850]: DEBUG nova.network.neutron [req-17542baa-2b41-4453-bf17-f893147d37a4 req-f0bf314e-e48f-4f2f-b2e7-0b44ef9e8829 service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Updating instance_info_cache with network_info: [{"id": "5a111053-6390-4a23-97c2-9171e744c3c7", "address": "fa:16:3e:52:fd:39", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a111053-63", "ovs_interfaceid": "5a111053-6390-4a23-97c2-9171e744c3c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:58:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-17542baa-2b41-4453-bf17-f893147d37a4 req-f0bf314e-e48f-4f2f-b2e7-0b44ef9e8829 service nova] Releasing lock "refresh_cache-211c1477-8a76-4ecd-a7c8-dc0b5903d38c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:59:00 user nova-compute[74850]: DEBUG nova.compute.manager [req-2043ee4b-d0f7-46e4-b77b-fd76d584851e req-af4534ea-d206-49c3-ae73-43f3eae0ef0b service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Received event network-changed-5a111053-6390-4a23-97c2-9171e744c3c7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:59:00 user nova-compute[74850]: DEBUG nova.compute.manager [req-2043ee4b-d0f7-46e4-b77b-fd76d584851e req-af4534ea-d206-49c3-ae73-43f3eae0ef0b service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Refreshing instance network info cache due to event network-changed-5a111053-6390-4a23-97c2-9171e744c3c7. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:59:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-2043ee4b-d0f7-46e4-b77b-fd76d584851e req-af4534ea-d206-49c3-ae73-43f3eae0ef0b service nova] Acquiring lock "refresh_cache-211c1477-8a76-4ecd-a7c8-dc0b5903d38c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:59:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-2043ee4b-d0f7-46e4-b77b-fd76d584851e req-af4534ea-d206-49c3-ae73-43f3eae0ef0b service nova] Acquired lock "refresh_cache-211c1477-8a76-4ecd-a7c8-dc0b5903d38c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:59:00 user nova-compute[74850]: DEBUG nova.network.neutron [req-2043ee4b-d0f7-46e4-b77b-fd76d584851e req-af4534ea-d206-49c3-ae73-43f3eae0ef0b service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Refreshing network info cache for port 5a111053-6390-4a23-97c2-9171e744c3c7 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:59:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:00 user nova-compute[74850]: DEBUG nova.network.neutron [req-2043ee4b-d0f7-46e4-b77b-fd76d584851e req-af4534ea-d206-49c3-ae73-43f3eae0ef0b service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Updated VIF entry in instance network info cache for port 5a111053-6390-4a23-97c2-9171e744c3c7. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:59:00 user nova-compute[74850]: DEBUG nova.network.neutron [req-2043ee4b-d0f7-46e4-b77b-fd76d584851e req-af4534ea-d206-49c3-ae73-43f3eae0ef0b service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Updating instance_info_cache with network_info: [{"id": "5a111053-6390-4a23-97c2-9171e744c3c7", "address": "fa:16:3e:52:fd:39", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a111053-63", "ovs_interfaceid": "5a111053-6390-4a23-97c2-9171e744c3c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:59:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-2043ee4b-d0f7-46e4-b77b-fd76d584851e req-af4534ea-d206-49c3-ae73-43f3eae0ef0b service nova] Releasing lock "refresh_cache-211c1477-8a76-4ecd-a7c8-dc0b5903d38c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:59:00 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:59:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:05 user nova-compute[74850]: DEBUG nova.compute.manager [req-8289dc25-bfde-4cc5-beec-d6376d04f108 req-96bf6662-3074-4cf8-8737-6e83e5daa5e1 service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Received event network-changed-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:59:05 user nova-compute[74850]: DEBUG nova.compute.manager [req-8289dc25-bfde-4cc5-beec-d6376d04f108 req-96bf6662-3074-4cf8-8737-6e83e5daa5e1 service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Refreshing instance network info cache due to event network-changed-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:59:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-8289dc25-bfde-4cc5-beec-d6376d04f108 req-96bf6662-3074-4cf8-8737-6e83e5daa5e1 service nova] Acquiring lock "refresh_cache-782a85d0-b427-4ee2-8d6c-778602f00bcd" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:59:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-8289dc25-bfde-4cc5-beec-d6376d04f108 req-96bf6662-3074-4cf8-8737-6e83e5daa5e1 service nova] Acquired lock "refresh_cache-782a85d0-b427-4ee2-8d6c-778602f00bcd" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:59:05 user nova-compute[74850]: DEBUG nova.network.neutron [req-8289dc25-bfde-4cc5-beec-d6376d04f108 req-96bf6662-3074-4cf8-8737-6e83e5daa5e1 service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Refreshing network info cache for port b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:59:06 user nova-compute[74850]: DEBUG nova.network.neutron [req-8289dc25-bfde-4cc5-beec-d6376d04f108 req-96bf6662-3074-4cf8-8737-6e83e5daa5e1 service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Updated VIF entry in instance network info cache for port b4744a9e-4848-49b9-9f58-7d29e0ecb9c7. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:59:06 user nova-compute[74850]: DEBUG nova.network.neutron [req-8289dc25-bfde-4cc5-beec-d6376d04f108 req-96bf6662-3074-4cf8-8737-6e83e5daa5e1 service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Updating instance_info_cache with network_info: [{"id": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "address": "fa:16:3e:70:96:bf", "network": {"id": "75650b3d-1169-46fa-a1cf-7ae51dd28e18", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227679489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3e629e632d444faf3898681aaafa79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744a9e-48", "ovs_interfaceid": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:59:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-8289dc25-bfde-4cc5-beec-d6376d04f108 req-96bf6662-3074-4cf8-8737-6e83e5daa5e1 service nova] Releasing lock "refresh_cache-782a85d0-b427-4ee2-8d6c-778602f00bcd" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:59:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "782a85d0-b427-4ee2-8d6c-778602f00bcd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:59:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:59:07 user nova-compute[74850]: DEBUG nova.objects.instance [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lazy-loading 'flavor' on Instance uuid 782a85d0-b427-4ee2-8d6c-778602f00bcd {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:59:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:59:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "782a85d0-b427-4ee2-8d6c-778602f00bcd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:59:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:59:08 user nova-compute[74850]: INFO nova.compute.manager [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Attaching volume 40c8987b-4ae1-4338-b6da-3d4612c015e1 to /dev/vdb
Nov 14 00:59:08 user nova-compute[74850]: DEBUG os_brick.utils [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:59:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c12b5f8-d55e-4dea-8782-58ccf6dbf1bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:59:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ff5c40-0876-4644-ab3e-e4231d68c4f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:59:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f848074a-5ab9-49d4-b0f3-3304b2720e23]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:59:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[027c75e6-ec53-47cc-9a51-53d54a0a3283]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:59:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:59:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 00:59:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:59:08 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 00:59:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8c9e3c-9552-4f49-a6d7-b782152b0db9]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:59:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 00:59:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 00:59:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 00:59:08 user nova-compute[74850]: DEBUG os_brick.utils [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:59:08 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Updating existing volume attachment record: 7012802f-fc42-40f0-bbc6-12e3e6db4e21 {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 00:59:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:59:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:59:09 user nova-compute[74850]: DEBUG nova.compute.manager [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 00:59:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:59:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:59:09 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 00:59:09 user nova-compute[74850]: INFO nova.compute.claims [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Claim successful on node user
Nov 14 00:59:10 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:59:10 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:59:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:59:10 user nova-compute[74850]: DEBUG nova.compute.manager [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 00:59:10 user nova-compute[74850]: DEBUG nova.compute.manager [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 00:59:10 user nova-compute[74850]: DEBUG nova.network.neutron [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 00:59:10 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 00:59:10 user nova-compute[74850]: DEBUG nova.compute.manager [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 00:59:10 user nova-compute[74850]: DEBUG nova.policy [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe8332d8221a49db86a402c5851b4882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396f5de82e54abfa812bf8a7e89b0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 00:59:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:10 user nova-compute[74850]: DEBUG nova.compute.manager [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 00:59:10 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 00:59:10 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Creating image(s)
Nov 14 00:59:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "/opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:59:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "/opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:59:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "/opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:59:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.171s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:59:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:59:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.178s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/disk 1073741824" returned: 0 in 0.061s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:59:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.182s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:11 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 00:59:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:11 user nova-compute[74850]: DEBUG nova.network.neutron [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Successfully created port: ee3e224b-fade-4ac4-bb64-1bf1a4df045c {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:59:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:11 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Cannot resize image /opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 00:59:11 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 00:59:11 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Ensure instance console log exists: /opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 00:59:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:59:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:59:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG nova.network.neutron [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Successfully updated port: ee3e224b-fade-4ac4-bb64-1bf1a4df045c {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "refresh_cache-7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquired lock "refresh_cache-7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG nova.network.neutron [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG nova.compute.manager [req-ef5fe074-ce71-430f-b691-ba3dc2c42c25 req-8cb38834-3ff5-41a4-b4de-a008d7cffa79 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Received event network-changed-ee3e224b-fade-4ac4-bb64-1bf1a4df045c {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG nova.compute.manager [req-ef5fe074-ce71-430f-b691-ba3dc2c42c25 req-8cb38834-3ff5-41a4-b4de-a008d7cffa79 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Refreshing instance network info cache due to event network-changed-ee3e224b-fade-4ac4-bb64-1bf1a4df045c. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ef5fe074-ce71-430f-b691-ba3dc2c42c25 req-8cb38834-3ff5-41a4-b4de-a008d7cffa79 service nova] Acquiring lock "refresh_cache-7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG nova.network.neutron [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ePJdMtNr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:59:12 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:59:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:59:12 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:59:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:59:12 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 00:59:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[99281967-a415-4c2a-bd9d-dd1fb99e6bd1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 00:59:12 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed04b5a1-86c6-4b22-8eaf-5a49af22ecd0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1] added
Nov 14 00:59:12 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG nova.network.neutron [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Updating instance_info_cache with network_info: [{"id": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "address": "fa:16:3e:06:ff:75", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3e224b-fa", "ovs_interfaceid": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[35daeceb-185f-4da4-882a-f655bd09b6cb]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Releasing lock "refresh_cache-7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG nova.compute.manager [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Instance network_info: |[{"id": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "address": "fa:16:3e:06:ff:75", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3e224b-fa", "ovs_interfaceid": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ef5fe074-ce71-430f-b691-ba3dc2c42c25 req-8cb38834-3ff5-41a4-b4de-a008d7cffa79 service nova] Acquired lock "refresh_cache-7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG nova.network.neutron [req-ef5fe074-ce71-430f-b691-ba3dc2c42c25 req-8cb38834-3ff5-41a4-b4de-a008d7cffa79 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Refreshing network info cache for port ee3e224b-fade-4ac4-bb64-1bf1a4df045c {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Start _get_guest_xml network_info=[{"id": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "address": "fa:16:3e:06:ff:75", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3e224b-fa", "ovs_interfaceid": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e0ccdd-a55c-488e-88fd-c13738f9a725]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ePJdMtNr {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:12 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:59:12 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:59:12 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:59:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-589429054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-589429054',id=32,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlYimApQkMypM1Jjvk0FBuh/aRLC/vPd/t+SoVKgbKU6stO3sCw/jpQFU3J/aANjVRSOq807ChnwPcFRUlfzkxpk30iEXkNZZFCxlyV6ZflIjFflWG7QN4jpLjTPyifHw==',key_name='tempest-keypair-553908575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e396f5de82e54abfa812bf8a7e89b0c4',ramdisk_id='',reservation_id='r-s21f41qa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-270753956',owner_user_name='tempest-AttachVolumeShelveTestJSON-270753956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:59:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe8332d8221a49db86a402c5851b4882',uuid=7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "address": "fa:16:3e:06:ff:75", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3e224b-fa", "ovs_interfaceid": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Converting VIF {"id": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "address": "fa:16:3e:06:ff:75", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3e224b-fa", "ovs_interfaceid": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:ff:75,bridge_name='br-int',has_traffic_filtering=True,id=ee3e224b-fade-4ac4-bb64-1bf1a4df045c,network=Network(dfd22096-9f0c-4e0f-aac4-06c224b5b9f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee3e224b-fa') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG nova.objects.instance [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ePJdMtNr" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bdb914-1c57-4e6a-85cf-b291772927c3]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ePJdMtNr'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:59:12 user nova-compute[74850]:   <uuid>7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e</uuid>
Nov 14 00:59:12 user nova-compute[74850]:   <name>instance-00000020</name>
Nov 14 00:59:12 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 00:59:12 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 00:59:12 user nova-compute[74850]:   <metadata>
Nov 14 00:59:12 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:59:12 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 00:59:12 user nova-compute[74850]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-589429054</nova:name>
Nov 14 00:59:12 user nova-compute[74850]:       <nova:creationTime>2023-11-14 00:59:12</nova:creationTime>
Nov 14 00:59:12 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 00:59:12 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 00:59:12 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 00:59:12 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 00:59:12 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:59:12 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:59:12 user nova-compute[74850]:       </nova:flavor>
Nov 14 00:59:12 user nova-compute[74850]:       <nova:owner>
Nov 14 00:59:12 user nova-compute[74850]:         <nova:user uuid="fe8332d8221a49db86a402c5851b4882">tempest-AttachVolumeShelveTestJSON-270753956-project-member</nova:user>
Nov 14 00:59:12 user nova-compute[74850]:         <nova:project uuid="e396f5de82e54abfa812bf8a7e89b0c4">tempest-AttachVolumeShelveTestJSON-270753956</nova:project>
Nov 14 00:59:12 user nova-compute[74850]:       </nova:owner>
Nov 14 00:59:12 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 00:59:12 user nova-compute[74850]:       <nova:ports>
Nov 14 00:59:12 user nova-compute[74850]:         <nova:port uuid="ee3e224b-fade-4ac4-bb64-1bf1a4df045c">
Nov 14 00:59:12 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 00:59:12 user nova-compute[74850]:         </nova:port>
Nov 14 00:59:12 user nova-compute[74850]:       </nova:ports>
Nov 14 00:59:12 user nova-compute[74850]:     </nova:instance>
Nov 14 00:59:12 user nova-compute[74850]:   </metadata>
Nov 14 00:59:12 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 00:59:12 user nova-compute[74850]:     <system>
Nov 14 00:59:12 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:59:12 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:59:12 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 00:59:12 user nova-compute[74850]:       <entry name="serial">7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e</entry>
Nov 14 00:59:12 user nova-compute[74850]:       <entry name="uuid">7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e</entry>
Nov 14 00:59:12 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:59:12 user nova-compute[74850]:     </system>
Nov 14 00:59:12 user nova-compute[74850]:   </sysinfo>
Nov 14 00:59:12 user nova-compute[74850]:   <os>
Nov 14 00:59:12 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:59:12 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 00:59:12 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 00:59:12 user nova-compute[74850]:   </os>
Nov 14 00:59:12 user nova-compute[74850]:   <features>
Nov 14 00:59:12 user nova-compute[74850]:     <acpi/>
Nov 14 00:59:12 user nova-compute[74850]:     <apic/>
Nov 14 00:59:12 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 00:59:12 user nova-compute[74850]:   </features>
Nov 14 00:59:12 user nova-compute[74850]:   <clock offset="utc">
Nov 14 00:59:12 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:59:12 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:59:12 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 00:59:12 user nova-compute[74850]:   </clock>
Nov 14 00:59:12 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 00:59:12 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 00:59:12 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:59:12 user nova-compute[74850]:   </cpu>
Nov 14 00:59:12 user nova-compute[74850]:   <devices>
Nov 14 00:59:12 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 00:59:12 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:59:12 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/disk"/>
Nov 14 00:59:12 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 00:59:12 user nova-compute[74850]:     </disk>
Nov 14 00:59:12 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 00:59:12 user nova-compute[74850]:       <mac address="fa:16:3e:06:ff:75"/>
Nov 14 00:59:12 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:59:12 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 00:59:12 user nova-compute[74850]:       <target dev="tapee3e224b-fa"/>
Nov 14 00:59:12 user nova-compute[74850]:     </interface>
Nov 14 00:59:12 user nova-compute[74850]:     <serial type="pty">
Nov 14 00:59:12 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/console.log" append="off"/>
Nov 14 00:59:12 user nova-compute[74850]:     </serial>
Nov 14 00:59:12 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:59:12 user nova-compute[74850]:     <video>
Nov 14 00:59:12 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 00:59:12 user nova-compute[74850]:     </video>
Nov 14 00:59:12 user nova-compute[74850]:     <rng model="virtio">
Nov 14 00:59:12 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:59:12 user nova-compute[74850]:     </rng>
Nov 14 00:59:12 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:59:12 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 00:59:12 user nova-compute[74850]:       <stats period="10"/>
Nov 14 00:59:12 user nova-compute[74850]:     </memballoon>
Nov 14 00:59:12 user nova-compute[74850]:   </devices>
Nov 14 00:59:12 user nova-compute[74850]: </domain>
Nov 14 00:59:12 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:59:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-589429054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-589429054',id=32,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlYimApQkMypM1Jjvk0FBuh/aRLC/vPd/t+SoVKgbKU6stO3sCw/jpQFU3J/aANjVRSOq807ChnwPcFRUlfzkxpk30iEXkNZZFCxlyV6ZflIjFflWG7QN4jpLjTPyifHw==',key_name='tempest-keypair-553908575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e396f5de82e54abfa812bf8a7e89b0c4',ramdisk_id='',reservation_id='r-s21f41qa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-270753956',owner_user_name='tempest-AttachVolumeShelveTestJSON-270753956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:59:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe8332d8221a49db86a402c5851b4882',uuid=7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "address": "fa:16:3e:06:ff:75", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3e224b-fa", "ovs_interfaceid": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Converting VIF {"id": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "address": "fa:16:3e:06:ff:75", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3e224b-fa", "ovs_interfaceid": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:ff:75,bridge_name='br-int',has_traffic_filtering=True,id=ee3e224b-fade-4ac4-bb64-1bf1a4df045c,network=Network(dfd22096-9f0c-4e0f-aac4-06c224b5b9f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee3e224b-fa') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG os_vif [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:ff:75,bridge_name='br-int',has_traffic_filtering=True,id=ee3e224b-fade-4ac4-bb64-1bf1a4df045c,network=Network(dfd22096-9f0c-4e0f-aac4-06c224b5b9f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee3e224b-fa') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6966a1e4-0100-51ed-8670-af1e7ee2e439', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee3e224b-fa, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapee3e224b-fa, col_values=(('qos', UUID('2998ca86-4a66-42ea-954b-7393a9ae2848')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapee3e224b-fa, col_values=(('external_ids', {'iface-id': 'ee3e224b-fade-4ac4-bb64-1bf1a4df045c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:ff:75', 'vm-uuid': '7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b27f15-8955-4dc6-9d56-aac892a9f230]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:12 user nova-compute[74850]: INFO os_vif [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:ff:75,bridge_name='br-int',has_traffic_filtering=True,id=ee3e224b-fade-4ac4-bb64-1bf1a4df045c,network=Network(dfd22096-9f0c-4e0f-aac4-06c224b5b9f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee3e224b-fa')
Nov 14 00:59:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d3605e-a8a2-43b1-87ff-d3bacc85eac3]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:59:12 user nova-compute[74850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 00:59:12 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:59:12 user nova-compute[74850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 00:59:12 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] No VIF found with MAC fa:16:3e:06:ff:75, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e98aef9-52c3-4047-85c5-29ee69d561cc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1, portal: 172.16.0.220,3260]
Nov 14 00:59:12 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1, portal: 172.16.0.220,3260] successful.
Nov 14 00:59:12 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bb51ea-7d81-4142-a412-1627734dff92]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7da4c38-f0e6-4b58-8330-1d7d59f89027]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:59:12 user nova-compute[74850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 00:59:12 user nova-compute[74850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)
Nov 14 00:59:12 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:59:12 user nova-compute[74850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 00:59:12 user nova-compute[74850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)
Nov 14 00:59:12 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9d6c98-515e-41ed-aebc-4a300a586499]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ePJdMtNr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG nova.network.neutron [req-ef5fe074-ce71-430f-b691-ba3dc2c42c25 req-8cb38834-3ff5-41a4-b4de-a008d7cffa79 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Updated VIF entry in instance network info cache for port ee3e224b-fade-4ac4-bb64-1bf1a4df045c. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG nova.network.neutron [req-ef5fe074-ce71-430f-b691-ba3dc2c42c25 req-8cb38834-3ff5-41a4-b4de-a008d7cffa79 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Updating instance_info_cache with network_info: [{"id": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "address": "fa:16:3e:06:ff:75", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3e224b-fa", "ovs_interfaceid": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:59:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ef5fe074-ce71-430f-b691-ba3dc2c42c25 req-8cb38834-3ff5-41a4-b4de-a008d7cffa79 service nova] Releasing lock "refresh_cache-7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:59:13 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:59:13 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23634313532396465', 'path': '/dev/sdb'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:59:13 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634313532396465', 'path': '/dev/sdb'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 00:59:13 user nova-compute[74850]: DEBUG nova.objects.instance [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lazy-loading 'flavor' on Instance uuid 782a85d0-b427-4ee2-8d6c-778602f00bcd {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:59:13 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 00:59:13 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:59:13 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 00:59:13 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:59:13 user nova-compute[74850]:   <serial>40c8987b-4ae1-4338-b6da-3d4612c015e1</serial>
Nov 14 00:59:13 user nova-compute[74850]: </disk>
Nov 14 00:59:13 user nova-compute[74850]:  {{(pid=74850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 00:59:13 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:14 user nova-compute[74850]: DEBUG nova.compute.manager [req-725c7feb-66f2-4e5a-bd84-c14cd69efedd req-a7a930ba-7f0a-4ccb-a818-ab809d4e7af0 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Received event network-vif-plugged-ee3e224b-fade-4ac4-bb64-1bf1a4df045c {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:59:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-725c7feb-66f2-4e5a-bd84-c14cd69efedd req-a7a930ba-7f0a-4ccb-a818-ab809d4e7af0 service nova] Acquiring lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:59:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-725c7feb-66f2-4e5a-bd84-c14cd69efedd req-a7a930ba-7f0a-4ccb-a818-ab809d4e7af0 service nova] Lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:59:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-725c7feb-66f2-4e5a-bd84-c14cd69efedd req-a7a930ba-7f0a-4ccb-a818-ab809d4e7af0 service nova] Lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:59:14 user nova-compute[74850]: DEBUG nova.compute.manager [req-725c7feb-66f2-4e5a-bd84-c14cd69efedd req-a7a930ba-7f0a-4ccb-a818-ab809d4e7af0 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] No waiting events found dispatching network-vif-plugged-ee3e224b-fade-4ac4-bb64-1bf1a4df045c {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:59:14 user nova-compute[74850]: WARNING nova.compute.manager [req-725c7feb-66f2-4e5a-bd84-c14cd69efedd req-a7a930ba-7f0a-4ccb-a818-ab809d4e7af0 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Received unexpected event network-vif-plugged-ee3e224b-fade-4ac4-bb64-1bf1a4df045c for instance with vm_state building and task_state spawning.
Nov 14 00:59:14 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:59:14 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:59:14 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] No VIF found with MAC fa:16:3e:70:96:bf, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:59:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-95dea8f9-08f7-4b6c-9028-75d22b56c425 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.470s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:59:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-60caadce-1fbb-4fd9-ad55-9d2b519befe5 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:59:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-60caadce-1fbb-4fd9-ad55-9d2b519befe5 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:59:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-60caadce-1fbb-4fd9-ad55-9d2b519befe5 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:59:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-60caadce-1fbb-4fd9-ad55-9d2b519befe5 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:59:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-60caadce-1fbb-4fd9-ad55-9d2b519befe5 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:59:15 user nova-compute[74850]: INFO nova.compute.manager [None req-60caadce-1fbb-4fd9-ad55-9d2b519befe5 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Terminating instance
Nov 14 00:59:15 user nova-compute[74850]: DEBUG nova.compute.manager [None req-60caadce-1fbb-4fd9-ad55-9d2b519befe5 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 00:59:15 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:15 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:15 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:15 user nova-compute[74850]: DEBUG nova.compute.manager [req-5ffe6285-b037-4c1e-a066-8653dde8bb1b req-450a4f6e-4bba-43fa-994b-8fc696f70eaf service nova] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Received event network-vif-unplugged-eac9af58-5f10-4ea2-a8ef-fb93b63fa661 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:59:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5ffe6285-b037-4c1e-a066-8653dde8bb1b req-450a4f6e-4bba-43fa-994b-8fc696f70eaf service nova] Acquiring lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:59:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5ffe6285-b037-4c1e-a066-8653dde8bb1b req-450a4f6e-4bba-43fa-994b-8fc696f70eaf service nova] Lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:59:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5ffe6285-b037-4c1e-a066-8653dde8bb1b req-450a4f6e-4bba-43fa-994b-8fc696f70eaf service nova] Lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:59:15 user nova-compute[74850]: DEBUG nova.compute.manager [req-5ffe6285-b037-4c1e-a066-8653dde8bb1b req-450a4f6e-4bba-43fa-994b-8fc696f70eaf service nova] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] No waiting events found dispatching network-vif-unplugged-eac9af58-5f10-4ea2-a8ef-fb93b63fa661 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:59:15 user nova-compute[74850]: DEBUG nova.compute.manager [req-5ffe6285-b037-4c1e-a066-8653dde8bb1b req-450a4f6e-4bba-43fa-994b-8fc696f70eaf service nova] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Received event network-vif-unplugged-eac9af58-5f10-4ea2-a8ef-fb93b63fa661 for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 00:59:15 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:15 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-696de86d-a353-4a73-9797-67e266fd4a49 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "782a85d0-b427-4ee2-8d6c-778602f00bcd" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:59:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-696de86d-a353-4a73-9797-67e266fd4a49 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:59:15 user nova-compute[74850]: DEBUG nova.compute.manager [None req-696de86d-a353-4a73-9797-67e266fd4a49 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:59:15 user nova-compute[74850]: DEBUG nova.compute.manager [None req-696de86d-a353-4a73-9797-67e266fd4a49 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74850) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 14 00:59:15 user nova-compute[74850]: DEBUG nova.objects.instance [None req-696de86d-a353-4a73-9797-67e266fd4a49 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lazy-loading 'flavor' on Instance uuid 782a85d0-b427-4ee2-8d6c-778602f00bcd {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:59:15 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:15 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:15 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:15 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:16 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Instance destroyed successfully.
Nov 14 00:59:16 user nova-compute[74850]: DEBUG nova.objects.instance [None req-60caadce-1fbb-4fd9-ad55-9d2b519befe5 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lazy-loading 'resources' on Instance uuid 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:59:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-60caadce-1fbb-4fd9-ad55-9d2b519befe5 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T00:53:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1625476669',display_name='tempest-ServerActionsTestOtherA-server-2143394548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1625476669',id=27,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDV2rMj6ypVN79NzZquMwuzVGFzBjsYheQsnYgiaIuxZDRWAmZIAl29ZfE9ZXIZPbNiV6W1etqaTbE7SdUIDyBWr5Q7XZ0JyP5fqpcxD+e7pdwSJyDS2tj+RVfGVMn8zvg==',key_name='tempest-keypair-1763585720',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:55:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67d09cd8d15a4b058988fa348d7fdc2e',ramdisk_id='',reservation_id='r-6aqonybt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1680693726',owner_user_name='tempest-ServerActionsTestOtherA-1680693726-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:55:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dab7bcadfc32457e8bfa6fa81cba2702',uuid=5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eac9af58-5f10-4ea2-a8ef-fb93b63fa661", "address": "fa:16:3e:7d:47:f6", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac9af58-5f", "ovs_interfaceid": "eac9af58-5f10-4ea2-a8ef-fb93b63fa661", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:59:16 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-60caadce-1fbb-4fd9-ad55-9d2b519befe5 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Converting VIF {"id": "eac9af58-5f10-4ea2-a8ef-fb93b63fa661", "address": "fa:16:3e:7d:47:f6", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac9af58-5f", "ovs_interfaceid": "eac9af58-5f10-4ea2-a8ef-fb93b63fa661", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:59:16 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-60caadce-1fbb-4fd9-ad55-9d2b519befe5 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:47:f6,bridge_name='br-int',has_traffic_filtering=True,id=eac9af58-5f10-4ea2-a8ef-fb93b63fa661,network=Network(6e563565-dc0c-4f19-9030-742bf28811d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac9af58-5f') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:59:16 user nova-compute[74850]: DEBUG os_vif [None req-60caadce-1fbb-4fd9-ad55-9d2b519befe5 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:47:f6,bridge_name='br-int',has_traffic_filtering=True,id=eac9af58-5f10-4ea2-a8ef-fb93b63fa661,network=Network(6e563565-dc0c-4f19-9030-742bf28811d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac9af58-5f') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:59:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeac9af58-5f, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:59:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:59:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=49095c6c-212d-4d3c-8f33-402a6fb9acee) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:59:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:59:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:16 user nova-compute[74850]: INFO os_vif [None req-60caadce-1fbb-4fd9-ad55-9d2b519befe5 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:47:f6,bridge_name='br-int',has_traffic_filtering=True,id=eac9af58-5f10-4ea2-a8ef-fb93b63fa661,network=Network(6e563565-dc0c-4f19-9030-742bf28811d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac9af58-5f')
Nov 14 00:59:16 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-60caadce-1fbb-4fd9-ad55-9d2b519befe5 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Deleting instance files /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf_del
Nov 14 00:59:16 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-60caadce-1fbb-4fd9-ad55-9d2b519befe5 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Deletion of /opt/stack/data/nova/instances/5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf_del complete
Nov 14 00:59:16 user nova-compute[74850]: INFO nova.compute.manager [None req-60caadce-1fbb-4fd9-ad55-9d2b519befe5 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 14 00:59:16 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-60caadce-1fbb-4fd9-ad55-9d2b519befe5 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 00:59:16 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 00:59:16 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 00:59:16 user nova-compute[74850]: DEBUG nova.compute.manager [req-5443feb7-ae41-4197-8d00-90573db5f361 req-bdb5a627-e672-47f6-b1a1-21c764c8b804 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Received event network-vif-plugged-ee3e224b-fade-4ac4-bb64-1bf1a4df045c {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:59:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5443feb7-ae41-4197-8d00-90573db5f361 req-bdb5a627-e672-47f6-b1a1-21c764c8b804 service nova] Acquiring lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:59:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5443feb7-ae41-4197-8d00-90573db5f361 req-bdb5a627-e672-47f6-b1a1-21c764c8b804 service nova] Lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:59:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5443feb7-ae41-4197-8d00-90573db5f361 req-bdb5a627-e672-47f6-b1a1-21c764c8b804 service nova] Lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:59:16 user nova-compute[74850]: DEBUG nova.compute.manager [req-5443feb7-ae41-4197-8d00-90573db5f361 req-bdb5a627-e672-47f6-b1a1-21c764c8b804 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] No waiting events found dispatching network-vif-plugged-ee3e224b-fade-4ac4-bb64-1bf1a4df045c {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:59:16 user nova-compute[74850]: WARNING nova.compute.manager [req-5443feb7-ae41-4197-8d00-90573db5f361 req-bdb5a627-e672-47f6-b1a1-21c764c8b804 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Received unexpected event network-vif-plugged-ee3e224b-fade-4ac4-bb64-1bf1a4df045c for instance with vm_state building and task_state spawning.
Nov 14 00:59:16 user nova-compute[74850]: DEBUG nova.compute.manager [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:59:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 00:59:16 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Instance spawned successfully.
Nov 14 00:59:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 00:59:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:59:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:59:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:59:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:59:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:59:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:59:16 user nova-compute[74850]: INFO nova.compute.manager [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Took 6.09 seconds to spawn the instance on the hypervisor.
Nov 14 00:59:16 user nova-compute[74850]: DEBUG nova.compute.manager [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:59:16 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Instance destroyed successfully.
Nov 14 00:59:16 user nova-compute[74850]: DEBUG nova.compute.manager [None req-696de86d-a353-4a73-9797-67e266fd4a49 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:59:16 user nova-compute[74850]: INFO nova.compute.manager [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Took 6.83 seconds to build instance.
Nov 14 00:59:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5fad3933-4cde-407d-952b-9c4eb6f631da tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.980s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:59:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-696de86d-a353-4a73-9797-67e266fd4a49 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.971s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:59:16 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:59:17 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Took 0.82 seconds to deallocate network for instance.
Nov 14 00:59:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-60caadce-1fbb-4fd9-ad55-9d2b519befe5 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:59:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-60caadce-1fbb-4fd9-ad55-9d2b519befe5 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:59:17 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-60caadce-1fbb-4fd9-ad55-9d2b519befe5 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:59:17 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-60caadce-1fbb-4fd9-ad55-9d2b519befe5 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:59:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-60caadce-1fbb-4fd9-ad55-9d2b519befe5 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:59:17 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-60caadce-1fbb-4fd9-ad55-9d2b519befe5 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Deleted allocations for instance 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf
Nov 14 00:59:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-60caadce-1fbb-4fd9-ad55-9d2b519befe5 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.259s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:59:17 user nova-compute[74850]: DEBUG nova.compute.manager [req-7c142efc-ff63-497d-a92f-1911d06900ac req-ce80ea30-0e8d-4c53-9085-7aabf1d2863d service nova] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Received event network-vif-plugged-eac9af58-5f10-4ea2-a8ef-fb93b63fa661 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:59:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7c142efc-ff63-497d-a92f-1911d06900ac req-ce80ea30-0e8d-4c53-9085-7aabf1d2863d service nova] Acquiring lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:59:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7c142efc-ff63-497d-a92f-1911d06900ac req-ce80ea30-0e8d-4c53-9085-7aabf1d2863d service nova] Lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:59:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7c142efc-ff63-497d-a92f-1911d06900ac req-ce80ea30-0e8d-4c53-9085-7aabf1d2863d service nova] Lock "5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:59:17 user nova-compute[74850]: DEBUG nova.compute.manager [req-7c142efc-ff63-497d-a92f-1911d06900ac req-ce80ea30-0e8d-4c53-9085-7aabf1d2863d service nova] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] No waiting events found dispatching network-vif-plugged-eac9af58-5f10-4ea2-a8ef-fb93b63fa661 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:59:17 user nova-compute[74850]: WARNING nova.compute.manager [req-7c142efc-ff63-497d-a92f-1911d06900ac req-ce80ea30-0e8d-4c53-9085-7aabf1d2863d service nova] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Received unexpected event network-vif-plugged-eac9af58-5f10-4ea2-a8ef-fb93b63fa661 for instance with vm_state deleted and task_state None.
Nov 14 00:59:17 user nova-compute[74850]: DEBUG nova.compute.manager [req-7c142efc-ff63-497d-a92f-1911d06900ac req-ce80ea30-0e8d-4c53-9085-7aabf1d2863d service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Received event network-vif-unplugged-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:59:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7c142efc-ff63-497d-a92f-1911d06900ac req-ce80ea30-0e8d-4c53-9085-7aabf1d2863d service nova] Acquiring lock "782a85d0-b427-4ee2-8d6c-778602f00bcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:59:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7c142efc-ff63-497d-a92f-1911d06900ac req-ce80ea30-0e8d-4c53-9085-7aabf1d2863d service nova] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:59:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7c142efc-ff63-497d-a92f-1911d06900ac req-ce80ea30-0e8d-4c53-9085-7aabf1d2863d service nova] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:59:17 user nova-compute[74850]: DEBUG nova.compute.manager [req-7c142efc-ff63-497d-a92f-1911d06900ac req-ce80ea30-0e8d-4c53-9085-7aabf1d2863d service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] No waiting events found dispatching network-vif-unplugged-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:59:17 user nova-compute[74850]: WARNING nova.compute.manager [req-7c142efc-ff63-497d-a92f-1911d06900ac req-ce80ea30-0e8d-4c53-9085-7aabf1d2863d service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Received unexpected event network-vif-unplugged-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 for instance with vm_state stopped and task_state None.
Nov 14 00:59:17 user nova-compute[74850]: DEBUG nova.compute.manager [req-7c142efc-ff63-497d-a92f-1911d06900ac req-ce80ea30-0e8d-4c53-9085-7aabf1d2863d service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Received event network-vif-plugged-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:59:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7c142efc-ff63-497d-a92f-1911d06900ac req-ce80ea30-0e8d-4c53-9085-7aabf1d2863d service nova] Acquiring lock "782a85d0-b427-4ee2-8d6c-778602f00bcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:59:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7c142efc-ff63-497d-a92f-1911d06900ac req-ce80ea30-0e8d-4c53-9085-7aabf1d2863d service nova] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:59:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7c142efc-ff63-497d-a92f-1911d06900ac req-ce80ea30-0e8d-4c53-9085-7aabf1d2863d service nova] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:59:17 user nova-compute[74850]: DEBUG nova.compute.manager [req-7c142efc-ff63-497d-a92f-1911d06900ac req-ce80ea30-0e8d-4c53-9085-7aabf1d2863d service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] No waiting events found dispatching network-vif-plugged-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:59:17 user nova-compute[74850]: WARNING nova.compute.manager [req-7c142efc-ff63-497d-a92f-1911d06900ac req-ce80ea30-0e8d-4c53-9085-7aabf1d2863d service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Received unexpected event network-vif-plugged-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 for instance with vm_state stopped and task_state None.
Nov 14 00:59:18 user nova-compute[74850]: DEBUG nova.compute.manager [req-b182adb7-e585-4598-8183-3545f7735afe req-f093be9f-1ff0-437b-9cd4-7f13fa7fb086 service nova] [instance: 5bfef5c7-c5b7-45a6-b087-8ad3ab6dbccf] Received event network-vif-deleted-eac9af58-5f10-4ea2-a8ef-fb93b63fa661 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:59:19 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-5270b017-52f9-4386-b357-4ec976ba2348 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 211c1477-8a76-4ecd-a7c8-dc0b5903d38c is timed out.
Nov 14 00:59:19 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-5270b017-52f9-4386-b357-4ec976ba2348 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Successfully detached device vdb from instance 211c1477-8a76-4ecd-a7c8-dc0b5903d38c from the live domain config.
Nov 14 00:59:19 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5270b017-52f9-4386-b357-4ec976ba2348 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5270b017-52f9-4386-b357-4ec976ba2348 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jAZHPWDS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:59:19 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-5270b017-52f9-4386-b357-4ec976ba2348 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:59:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-5270b017-52f9-4386-b357-4ec976ba2348 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-5270b017-52f9-4386-b357-4ec976ba2348 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15d7990-ec25-4a11-ac6c-0c7b872daf4b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5270b017-52f9-4386-b357-4ec976ba2348 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 00:59:19 user nova-compute[74850]: No targets found.
Nov 14 00:59:19 user nova-compute[74850]: iSNS:
Nov 14 00:59:19 user nova-compute[74850]: No targets found.
Nov 14 00:59:19 user nova-compute[74850]: STATIC:
Nov 14 00:59:19 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a
Nov 14 00:59:19 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:59:19 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:59:19 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1
Nov 14 00:59:19 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:59:19 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:59:19 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d
Nov 14 00:59:19 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:59:19 user nova-compute[74850]:                 Iface Name: default
Nov 14 00:59:19 user nova-compute[74850]: FIRMWARE:
Nov 14 00:59:19 user nova-compute[74850]: No targets found.
Nov 14 00:59:19 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5270b017-52f9-4386-b357-4ec976ba2348 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 00:59:19 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 00:59:19 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5270b017-52f9-4386-b357-4ec976ba2348 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f9796f-8658-4779-a598-1580ea140c9e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e94028-e6d8-4f6f-a9ab-0f5674482beb]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5270b017-52f9-4386-b357-4ec976ba2348 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:59:19 user nova-compute[74850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 00:59:19 user nova-compute[74850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)
Nov 14 00:59:19 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5270b017-52f9-4386-b357-4ec976ba2348 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a (non-flash)
Nov 14 00:59:19 user nova-compute[74850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 00:59:19 user nova-compute[74850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)
Nov 14 00:59:19 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5270b017-52f9-4386-b357-4ec976ba2348 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a1c7b7880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a'): ({'sde'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-5270b017-52f9-4386-b357-4ec976ba2348 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Removing single pathed devices sde {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6dc3e79-07f2-41a2-948e-c290ecfe3d8c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3f25fa-1b01-427f-b142-b70f25946987]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-5270b017-52f9-4386-b357-4ec976ba2348 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Flushing IO for device /dev/sde {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d03cfa1-3463-4978-9617-04f3f9828ad8]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-5270b017-52f9-4386-b357-4ec976ba2348 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcf963d-a8a7-4d37-b017-acc05ca11d07]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-5270b017-52f9-4386-b357-4ec976ba2348 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-5270b017-52f9-4386-b357-4ec976ba2348 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] SCSI volumes sde have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5270b017-52f9-4386-b357-4ec976ba2348 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfb438e-1d26-410f-be3f-fe0ac5e746a8]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5270b017-52f9-4386-b357-4ec976ba2348 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[60229e3d-1b78-45cd-b423-4517756cb6a0]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5270b017-52f9-4386-b357-4ec976ba2348 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a, portal: 172.16.0.220,3260]
Nov 14 00:59:19 user nova-compute[74850]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a, portal: 172.16.0.220,3260] successful.
Nov 14 00:59:19 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5967bf1-73b3-46b7-ab8b-f48f9198036a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[855e77cd-b9ec-4580-a24f-f08bf57b76be]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5270b017-52f9-4386-b357-4ec976ba2348 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-5270b017-52f9-4386-b357-4ec976ba2348 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5270b017-52f9-4386-b357-4ec976ba2348 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] <== disconnect_volume: return (300ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:59:19 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5270b017-52f9-4386-b357-4ec976ba2348 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 00:59:20 user nova-compute[74850]: DEBUG nova.objects.instance [None req-5270b017-52f9-4386-b357-4ec976ba2348 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lazy-loading 'flavor' on Instance uuid 211c1477-8a76-4ecd-a7c8-dc0b5903d38c {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:59:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5270b017-52f9-4386-b357-4ec976ba2348 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.687s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:59:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:30 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:30 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-951fbbd8-f01f-4d94-b8a1-8096a7ee14ef tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:59:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-951fbbd8-f01f-4d94-b8a1-8096a7ee14ef tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:59:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-951fbbd8-f01f-4d94-b8a1-8096a7ee14ef tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:59:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-951fbbd8-f01f-4d94-b8a1-8096a7ee14ef tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:59:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-951fbbd8-f01f-4d94-b8a1-8096a7ee14ef tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:59:48 user nova-compute[74850]: INFO nova.compute.manager [None req-951fbbd8-f01f-4d94-b8a1-8096a7ee14ef tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Terminating instance
Nov 14 00:59:48 user nova-compute[74850]: DEBUG nova.compute.manager [None req-951fbbd8-f01f-4d94-b8a1-8096a7ee14ef tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 00:59:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:49 user nova-compute[74850]: DEBUG nova.compute.manager [req-f2fd17ca-54b6-43ea-a495-2e4bc968f2c5 req-30fc6986-140b-45aa-a27e-6b18a0a90e6c service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Received event network-vif-unplugged-5a111053-6390-4a23-97c2-9171e744c3c7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:59:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f2fd17ca-54b6-43ea-a495-2e4bc968f2c5 req-30fc6986-140b-45aa-a27e-6b18a0a90e6c service nova] Acquiring lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:59:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f2fd17ca-54b6-43ea-a495-2e4bc968f2c5 req-30fc6986-140b-45aa-a27e-6b18a0a90e6c service nova] Lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:59:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f2fd17ca-54b6-43ea-a495-2e4bc968f2c5 req-30fc6986-140b-45aa-a27e-6b18a0a90e6c service nova] Lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:59:49 user nova-compute[74850]: DEBUG nova.compute.manager [req-f2fd17ca-54b6-43ea-a495-2e4bc968f2c5 req-30fc6986-140b-45aa-a27e-6b18a0a90e6c service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] No waiting events found dispatching network-vif-unplugged-5a111053-6390-4a23-97c2-9171e744c3c7 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:59:49 user nova-compute[74850]: DEBUG nova.compute.manager [req-f2fd17ca-54b6-43ea-a495-2e4bc968f2c5 req-30fc6986-140b-45aa-a27e-6b18a0a90e6c service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Received event network-vif-unplugged-5a111053-6390-4a23-97c2-9171e744c3c7 for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 00:59:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:49 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Instance destroyed successfully.
Nov 14 00:59:49 user nova-compute[74850]: DEBUG nova.objects.instance [None req-951fbbd8-f01f-4d94-b8a1-8096a7ee14ef tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lazy-loading 'resources' on Instance uuid 211c1477-8a76-4ecd-a7c8-dc0b5903d38c {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:59:49 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-951fbbd8-f01f-4d94-b8a1-8096a7ee14ef tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1861720430',display_name='tempest-ServerRescueNegativeTestJSON-server-1861720430',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1861720430',id=25,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1R4v8zKtyosS53OifNAB7kqp6eZmbuqDbYYyccqJkmGYh7Qj/Z0gVko0VLZsVSZ9mFQ9vPph+SAXAMe6TVaSwOY0UjEI/J86dVqOxg1LLdfUZg+8Hx9p8XFQmsZUZe9w==',key_name='tempest-keypair-344758225',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:55:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e933e8bc63bd442d882ff59243bd7faa',ramdisk_id='',reservation_id='r-tu15g70v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-103787426',owner_user_name='tempest-ServerRescueNegativeTestJSON-103787426-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:57:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84158c07e3344e01bf82e0e25e2a7244',uuid=211c1477-8a76-4ecd-a7c8-dc0b5903d38c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a111053-6390-4a23-97c2-9171e744c3c7", "address": "fa:16:3e:52:fd:39", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a111053-63", "ovs_interfaceid": "5a111053-6390-4a23-97c2-9171e744c3c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:59:49 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-951fbbd8-f01f-4d94-b8a1-8096a7ee14ef tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Converting VIF {"id": "5a111053-6390-4a23-97c2-9171e744c3c7", "address": "fa:16:3e:52:fd:39", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a111053-63", "ovs_interfaceid": "5a111053-6390-4a23-97c2-9171e744c3c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:59:49 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-951fbbd8-f01f-4d94-b8a1-8096a7ee14ef tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:fd:39,bridge_name='br-int',has_traffic_filtering=True,id=5a111053-6390-4a23-97c2-9171e744c3c7,network=Network(4bb9b9bb-4485-4fed-bf0e-f549b29f09da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a111053-63') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:59:49 user nova-compute[74850]: DEBUG os_vif [None req-951fbbd8-f01f-4d94-b8a1-8096a7ee14ef tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:fd:39,bridge_name='br-int',has_traffic_filtering=True,id=5a111053-6390-4a23-97c2-9171e744c3c7,network=Network(4bb9b9bb-4485-4fed-bf0e-f549b29f09da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a111053-63') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:59:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a111053-63, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:59:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:59:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bff96806-f247-4ef6-a612-adee580f2b8c) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:59:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:59:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:49 user nova-compute[74850]: INFO os_vif [None req-951fbbd8-f01f-4d94-b8a1-8096a7ee14ef tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:fd:39,bridge_name='br-int',has_traffic_filtering=True,id=5a111053-6390-4a23-97c2-9171e744c3c7,network=Network(4bb9b9bb-4485-4fed-bf0e-f549b29f09da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a111053-63')
Nov 14 00:59:49 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-951fbbd8-f01f-4d94-b8a1-8096a7ee14ef tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Deleting instance files /opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c_del
Nov 14 00:59:49 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-951fbbd8-f01f-4d94-b8a1-8096a7ee14ef tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Deletion of /opt/stack/data/nova/instances/211c1477-8a76-4ecd-a7c8-dc0b5903d38c_del complete
Nov 14 00:59:49 user nova-compute[74850]: INFO nova.compute.manager [None req-951fbbd8-f01f-4d94-b8a1-8096a7ee14ef tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 14 00:59:49 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-951fbbd8-f01f-4d94-b8a1-8096a7ee14ef tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 00:59:49 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 00:59:49 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 00:59:49 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:59:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:59:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:59:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:59:49 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 00:59:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2749d176-9c59-493e-b3c3-af5980329041/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2749d176-9c59-493e-b3c3-af5980329041/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2749d176-9c59-493e-b3c3-af5980329041/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "603a931e-3bde-4a7f-b3d7-0993ab535e4c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:59:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "603a931e-3bde-4a7f-b3d7-0993ab535e4c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:59:51 user nova-compute[74850]: DEBUG nova.compute.manager [req-d8bf3da4-643e-4e5e-a7a3-e2e004718ae7 req-b62f1e46-2d03-4b71-aea2-6117ad654d8c service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Received event network-vif-deleted-5a111053-6390-4a23-97c2-9171e744c3c7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:59:51 user nova-compute[74850]: INFO nova.compute.manager [req-d8bf3da4-643e-4e5e-a7a3-e2e004718ae7 req-b62f1e46-2d03-4b71-aea2-6117ad654d8c service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Neutron deleted interface 5a111053-6390-4a23-97c2-9171e744c3c7; detaching it from the instance and deleting it from the info cache
Nov 14 00:59:51 user nova-compute[74850]: DEBUG nova.network.neutron [req-d8bf3da4-643e-4e5e-a7a3-e2e004718ae7 req-b62f1e46-2d03-4b71-aea2-6117ad654d8c service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:59:51 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:59:51 user nova-compute[74850]: DEBUG nova.compute.manager [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 00:59:51 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Took 1.30 seconds to deallocate network for instance.
Nov 14 00:59:51 user nova-compute[74850]: DEBUG nova.compute.manager [req-d8bf3da4-643e-4e5e-a7a3-e2e004718ae7 req-b62f1e46-2d03-4b71-aea2-6117ad654d8c service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Detach interface failed, port_id=5a111053-6390-4a23-97c2-9171e744c3c7, reason: Instance 211c1477-8a76-4ecd-a7c8-dc0b5903d38c could not be found. {{(pid=74850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 00:59:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-951fbbd8-f01f-4d94-b8a1-8096a7ee14ef tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:59:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-951fbbd8-f01f-4d94-b8a1-8096a7ee14ef tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:59:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:59:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2749d176-9c59-493e-b3c3-af5980329041/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:51 user nova-compute[74850]: DEBUG nova.compute.manager [req-a0116c0c-df60-40d5-a79d-b1261a260a1b req-b6de2681-5025-4813-94ab-b7fe96b4adce service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Received event network-vif-plugged-5a111053-6390-4a23-97c2-9171e744c3c7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:59:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a0116c0c-df60-40d5-a79d-b1261a260a1b req-b6de2681-5025-4813-94ab-b7fe96b4adce service nova] Acquiring lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:59:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a0116c0c-df60-40d5-a79d-b1261a260a1b req-b6de2681-5025-4813-94ab-b7fe96b4adce service nova] Lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:59:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a0116c0c-df60-40d5-a79d-b1261a260a1b req-b6de2681-5025-4813-94ab-b7fe96b4adce service nova] Lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:59:51 user nova-compute[74850]: DEBUG nova.compute.manager [req-a0116c0c-df60-40d5-a79d-b1261a260a1b req-b6de2681-5025-4813-94ab-b7fe96b4adce service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] No waiting events found dispatching network-vif-plugged-5a111053-6390-4a23-97c2-9171e744c3c7 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:59:51 user nova-compute[74850]: WARNING nova.compute.manager [req-a0116c0c-df60-40d5-a79d-b1261a260a1b req-b6de2681-5025-4813-94ab-b7fe96b4adce service nova] [instance: 211c1477-8a76-4ecd-a7c8-dc0b5903d38c] Received unexpected event network-vif-plugged-5a111053-6390-4a23-97c2-9171e744c3c7 for instance with vm_state deleted and task_state None.
Nov 14 00:59:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:51 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-951fbbd8-f01f-4d94-b8a1-8096a7ee14ef tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:59:51 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-951fbbd8-f01f-4d94-b8a1-8096a7ee14ef tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:59:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-951fbbd8-f01f-4d94-b8a1-8096a7ee14ef tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:59:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.386s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:59:51 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 00:59:51 user nova-compute[74850]: INFO nova.compute.claims [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Claim successful on node user
Nov 14 00:59:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:51 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:59:51 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-951fbbd8-f01f-4d94-b8a1-8096a7ee14ef tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Deleted allocations for instance 211c1477-8a76-4ecd-a7c8-dc0b5903d38c
Nov 14 00:59:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-951fbbd8-f01f-4d94-b8a1-8096a7ee14ef tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "211c1477-8a76-4ecd-a7c8-dc0b5903d38c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.842s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:59:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:51 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:59:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:52 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:59:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:59:52 user nova-compute[74850]: DEBUG nova.compute.manager [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 00:59:52 user nova-compute[74850]: DEBUG nova.compute.manager [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 00:59:52 user nova-compute[74850]: DEBUG nova.network.neutron [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 00:59:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:52 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 00:59:52 user nova-compute[74850]: DEBUG nova.compute.manager [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 00:59:52 user nova-compute[74850]: DEBUG nova.policy [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c91ddcee4e54a769eb626c816596bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb1eb4b5fc841d1952b8db9ae05e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 00:59:52 user nova-compute[74850]: INFO nova.virt.block_device [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Booting with volume snapshot bdd3ad3a-83c4-42e5-a48b-05f0a1f017f8 at /dev/vda
Nov 14 00:59:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:59:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/702746f7-305f-4eac-a71a-6c08b7cbccd8/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/702746f7-305f-4eac-a71a-6c08b7cbccd8/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/702746f7-305f-4eac-a71a-6c08b7cbccd8/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:52 user nova-compute[74850]: DEBUG nova.network.neutron [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Successfully created port: 1fcd413f-b86c-4cc7-b741-b596ef83394e {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:59:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/702746f7-305f-4eac-a71a-6c08b7cbccd8/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json" returned: 0 in 0.326s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:53 user nova-compute[74850]: DEBUG nova.network.neutron [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Successfully updated port: 1fcd413f-b86c-4cc7-b741-b596ef83394e {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:59:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "refresh_cache-603a931e-3bde-4a7f-b3d7-0993ab535e4c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:59:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquired lock "refresh_cache-603a931e-3bde-4a7f-b3d7-0993ab535e4c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:59:53 user nova-compute[74850]: DEBUG nova.network.neutron [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:59:53 user nova-compute[74850]: DEBUG nova.compute.manager [req-e5a64d77-a845-4846-8ea1-4da292571c96 req-74687ec7-25da-4948-9e0c-37cc95b232f2 service nova] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Received event network-changed-1fcd413f-b86c-4cc7-b741-b596ef83394e {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:59:53 user nova-compute[74850]: DEBUG nova.compute.manager [req-e5a64d77-a845-4846-8ea1-4da292571c96 req-74687ec7-25da-4948-9e0c-37cc95b232f2 service nova] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Refreshing instance network info cache due to event network-changed-1fcd413f-b86c-4cc7-b741-b596ef83394e. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:59:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e5a64d77-a845-4846-8ea1-4da292571c96 req-74687ec7-25da-4948-9e0c-37cc95b232f2 service nova] Acquiring lock "refresh_cache-603a931e-3bde-4a7f-b3d7-0993ab535e4c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:59:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:53 user nova-compute[74850]: DEBUG nova.network.neutron [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:59:53 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:59:54 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:59:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=8012MB free_disk=25.10466766357422GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 00:59:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:59:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:59:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance a70d0196-f90e-47c4-be67-bf7ef4c3d8c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:59:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 1879be4c-9226-4c8c-a56c-f8e37398851b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:59:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 748d0da7-bbb9-4e86-aae3-e48b1fa04c14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:59:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance c7952bff-87d6-46c1-a6d4-7729dc4893ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:59:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 702746f7-305f-4eac-a71a-6c08b7cbccd8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:59:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 782a85d0-b427-4ee2-8d6c-778602f00bcd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:59:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 2749d176-9c59-493e-b3c3-af5980329041 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:59:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:59:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 603a931e-3bde-4a7f-b3d7-0993ab535e4c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:59:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 00:59:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 00:59:54 user nova-compute[74850]: DEBUG nova.network.neutron [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Updating instance_info_cache with network_info: [{"id": "1fcd413f-b86c-4cc7-b741-b596ef83394e", "address": "fa:16:3e:ef:54:e4", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fcd413f-b8", "ovs_interfaceid": "1fcd413f-b86c-4cc7-b741-b596ef83394e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:59:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Releasing lock "refresh_cache-603a931e-3bde-4a7f-b3d7-0993ab535e4c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:59:54 user nova-compute[74850]: DEBUG nova.compute.manager [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Instance network_info: |[{"id": "1fcd413f-b86c-4cc7-b741-b596ef83394e", "address": "fa:16:3e:ef:54:e4", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fcd413f-b8", "ovs_interfaceid": "1fcd413f-b86c-4cc7-b741-b596ef83394e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 00:59:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e5a64d77-a845-4846-8ea1-4da292571c96 req-74687ec7-25da-4948-9e0c-37cc95b232f2 service nova] Acquired lock "refresh_cache-603a931e-3bde-4a7f-b3d7-0993ab535e4c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:59:54 user nova-compute[74850]: DEBUG nova.network.neutron [req-e5a64d77-a845-4846-8ea1-4da292571c96 req-74687ec7-25da-4948-9e0c-37cc95b232f2 service nova] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Refreshing network info cache for port 1fcd413f-b86c-4cc7-b741-b596ef83394e {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:59:54 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:59:54 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:59:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 00:59:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.409s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:59:54 user nova-compute[74850]: DEBUG nova.network.neutron [req-e5a64d77-a845-4846-8ea1-4da292571c96 req-74687ec7-25da-4948-9e0c-37cc95b232f2 service nova] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Updated VIF entry in instance network info cache for port 1fcd413f-b86c-4cc7-b741-b596ef83394e. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:59:54 user nova-compute[74850]: DEBUG nova.network.neutron [req-e5a64d77-a845-4846-8ea1-4da292571c96 req-74687ec7-25da-4948-9e0c-37cc95b232f2 service nova] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Updating instance_info_cache with network_info: [{"id": "1fcd413f-b86c-4cc7-b741-b596ef83394e", "address": "fa:16:3e:ef:54:e4", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fcd413f-b8", "ovs_interfaceid": "1fcd413f-b86c-4cc7-b741-b596ef83394e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:59:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e5a64d77-a845-4846-8ea1-4da292571c96 req-74687ec7-25da-4948-9e0c-37cc95b232f2 service nova] Releasing lock "refresh_cache-603a931e-3bde-4a7f-b3d7-0993ab535e4c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:59:54 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:59:56 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:59:56 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:59:56 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:59:56 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:59:57 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:59:57 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 00:59:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "refresh_cache-748d0da7-bbb9-4e86-aae3-e48b1fa04c14" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:59:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquired lock "refresh_cache-748d0da7-bbb9-4e86-aae3-e48b1fa04c14" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:59:58 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Forcefully refreshing network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 00:59:58 user nova-compute[74850]: DEBUG os_brick.utils [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:59:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:58 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb5c594-5e1e-415d-8cb2-77e346a26194]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:59:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:58 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b7739f-14d2-488d-98c6-a54933ce9c09]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:59:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:59:58 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3477d9c0-ab52-4946-b1db-6e5441e4586a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:59:58 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30d1a16-e336-4901-8af3-f8e22abbc822]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:59:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:59:58 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 00:59:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:59:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:59:58 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 00:59:58 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[42aaad58-eab4-4647-a677-c763461bb15f]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:59:58 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 00:59:58 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 00:59:58 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 00:59:58 user nova-compute[74850]: DEBUG os_brick.utils [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:59:58 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Updating existing volume attachment record: 92ff162d-839e-4780-b89a-8e2acb4d1954 {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 00:59:58 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Updating instance_info_cache with network_info: [{"id": "11d8d21f-e53e-4277-a1d1-36e99c3bcd62", "address": "fa:16:3e:f2:d6:a0", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d8d21f-e5", "ovs_interfaceid": "11d8d21f-e53e-4277-a1d1-36e99c3bcd62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:59:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Releasing lock "refresh_cache-748d0da7-bbb9-4e86-aae3-e48b1fa04c14" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:59:58 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Updated the network info_cache for instance {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 00:59:58 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:59:58 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 00:59:58 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:59:58 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:59:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG nova.compute.manager [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 01:00:02 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Creating image(s)
Nov 14 01:00:02 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Did not create local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Ensure instance console log exists: /opt/stack/data/nova/instances/603a931e-3bde-4a7f-b3d7-0993ab535e4c/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Start _get_guest_xml network_info=[{"id": "1fcd413f-b86c-4cc7-b741-b596ef83394e", "address": "fa:16:3e:ef:54:e4", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fcd413f-b8", "ovs_interfaceid": "1fcd413f-b86c-4cc7-b741-b596ef83394e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '92ff162d-839e-4780-b89a-8e2acb4d1954', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLCnOYTg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '603a931e-3bde-4a7f-b3d7-0993ab535e4c', 'attached_at': '', 'detached_at': '', 'volume_id': '61df958c-9f96-4dbd-8e9e-e338907d8739', 'serial': '61df958c-9f96-4dbd-8e9e-e338907d8739'}, 'volume_type': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 01:00:02 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:00:02 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:00:02 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLCnOYTg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:00:02 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:00:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:00:02 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:00:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:00:02 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 01:00:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5eb07d-3b58-47ef-a3e1-dc7d787b4f1c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 01:00:02 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7b4664-58cf-48b8-ab08-3e34c635625e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739] added
Nov 14 01:00:02 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[52715e17-f83e-44fe-8199-d56fccb98a43]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[04744dea-1e28-4125-be86-e629923ee5d6]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rLCnOYTg {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rLCnOYTg" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc884d47-eef5-48f7-a0a6-0bdac4138834]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rLCnOYTg'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55fb8a0-5f27-4530-9c6a-2d68d6985a47]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5848c4-7aa0-4dde-9724-ff628fa6ba6e]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:00:02 user nova-compute[74850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)
Nov 14 01:00:02 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:00:02 user nova-compute[74850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)
Nov 14 01:00:02 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c24b2d1-f68c-439b-8e66-62e7164db7f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739, portal: 172.16.0.220,3260]
Nov 14 01:00:02 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739, portal: 172.16.0.220,3260] successful.
Nov 14 01:00:02 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fff8461-2fec-4372-9de5-f95571e7740f]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8606f1-80c8-4095-a65a-e8c53c279e45]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:00:02 user nova-compute[74850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)
Nov 14 01:00:02 user nova-compute[74850]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 (non-flash)
Nov 14 01:00:02 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:00:02 user nova-compute[74850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)
Nov 14 01:00:02 user nova-compute[74850]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 (non-flash)
Nov 14 01:00:02 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1568e1a-0073-4dad-800a-ea6cc32fbd80]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:00:02 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: None {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:00:03 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:00:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLCnOYTg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 01:00:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:00:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23830343832303464', 'path': '/dev/sdc'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:00:03 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830343832303464', 'path': '/dev/sdc'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 01:00:03 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1339112381',display_name='tempest-TestVolumeBootPattern-server-1339112381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1339112381',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdb1eb4b5fc841d1952b8db9ae05e446',ramdisk_id='',reservation_id='r-u2ruc9od',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1536334624',owner_user_name='tempest-TestVolumeBootPattern-1536334624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:59:52Z,user_data=None,user_id='6c91ddcee4e54a769eb626c816596bed',uuid=603a931e-3bde-4a7f-b3d7-0993ab535e4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fcd413f-b86c-4cc7-b741-b596ef83394e", "address": "fa:16:3e:ef:54:e4", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fcd413f-b8", "ovs_interfaceid": "1fcd413f-b86c-4cc7-b741-b596ef83394e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 01:00:03 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Converting VIF {"id": "1fcd413f-b86c-4cc7-b741-b596ef83394e", "address": "fa:16:3e:ef:54:e4", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fcd413f-b8", "ovs_interfaceid": "1fcd413f-b86c-4cc7-b741-b596ef83394e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:00:03 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:54:e4,bridge_name='br-int',has_traffic_filtering=True,id=1fcd413f-b86c-4cc7-b741-b596ef83394e,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fcd413f-b8') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:00:03 user nova-compute[74850]: DEBUG nova.objects.instance [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lazy-loading 'pci_devices' on Instance uuid 603a931e-3bde-4a7f-b3d7-0993ab535e4c {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:00:03 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 01:00:03 user nova-compute[74850]:   <uuid>603a931e-3bde-4a7f-b3d7-0993ab535e4c</uuid>
Nov 14 01:00:03 user nova-compute[74850]:   <name>instance-00000021</name>
Nov 14 01:00:03 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 01:00:03 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 01:00:03 user nova-compute[74850]:   <metadata>
Nov 14 01:00:03 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 01:00:03 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 01:00:03 user nova-compute[74850]:       <nova:name>tempest-TestVolumeBootPattern-server-1339112381</nova:name>
Nov 14 01:00:03 user nova-compute[74850]:       <nova:creationTime>2023-11-14 01:00:02</nova:creationTime>
Nov 14 01:00:03 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 01:00:03 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 01:00:03 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 01:00:03 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 01:00:03 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 01:00:03 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 01:00:03 user nova-compute[74850]:       </nova:flavor>
Nov 14 01:00:03 user nova-compute[74850]:       <nova:owner>
Nov 14 01:00:03 user nova-compute[74850]:         <nova:user uuid="6c91ddcee4e54a769eb626c816596bed">tempest-TestVolumeBootPattern-1536334624-project-member</nova:user>
Nov 14 01:00:03 user nova-compute[74850]:         <nova:project uuid="fdb1eb4b5fc841d1952b8db9ae05e446">tempest-TestVolumeBootPattern-1536334624</nova:project>
Nov 14 01:00:03 user nova-compute[74850]:       </nova:owner>
Nov 14 01:00:03 user nova-compute[74850]:       <nova:ports>
Nov 14 01:00:03 user nova-compute[74850]:         <nova:port uuid="1fcd413f-b86c-4cc7-b741-b596ef83394e">
Nov 14 01:00:03 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 01:00:03 user nova-compute[74850]:         </nova:port>
Nov 14 01:00:03 user nova-compute[74850]:       </nova:ports>
Nov 14 01:00:03 user nova-compute[74850]:     </nova:instance>
Nov 14 01:00:03 user nova-compute[74850]:   </metadata>
Nov 14 01:00:03 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 01:00:03 user nova-compute[74850]:     <system>
Nov 14 01:00:03 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 01:00:03 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 01:00:03 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 01:00:03 user nova-compute[74850]:       <entry name="serial">603a931e-3bde-4a7f-b3d7-0993ab535e4c</entry>
Nov 14 01:00:03 user nova-compute[74850]:       <entry name="uuid">603a931e-3bde-4a7f-b3d7-0993ab535e4c</entry>
Nov 14 01:00:03 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 01:00:03 user nova-compute[74850]:     </system>
Nov 14 01:00:03 user nova-compute[74850]:   </sysinfo>
Nov 14 01:00:03 user nova-compute[74850]:   <os>
Nov 14 01:00:03 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 01:00:03 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 01:00:03 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 01:00:03 user nova-compute[74850]:   </os>
Nov 14 01:00:03 user nova-compute[74850]:   <features>
Nov 14 01:00:03 user nova-compute[74850]:     <acpi/>
Nov 14 01:00:03 user nova-compute[74850]:     <apic/>
Nov 14 01:00:03 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 01:00:03 user nova-compute[74850]:   </features>
Nov 14 01:00:03 user nova-compute[74850]:   <clock offset="utc">
Nov 14 01:00:03 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 01:00:03 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 01:00:03 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 01:00:03 user nova-compute[74850]:   </clock>
Nov 14 01:00:03 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 01:00:03 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 01:00:03 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 01:00:03 user nova-compute[74850]:   </cpu>
Nov 14 01:00:03 user nova-compute[74850]:   <devices>
Nov 14 01:00:03 user nova-compute[74850]:     <disk type="block" device="disk">
Nov 14 01:00:03 user nova-compute[74850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:00:03 user nova-compute[74850]:       <source dev="/dev/sdc"/>
Nov 14 01:00:03 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 01:00:03 user nova-compute[74850]:       <serial>61df958c-9f96-4dbd-8e9e-e338907d8739</serial>
Nov 14 01:00:03 user nova-compute[74850]:     </disk>
Nov 14 01:00:03 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 01:00:03 user nova-compute[74850]:       <mac address="fa:16:3e:ef:54:e4"/>
Nov 14 01:00:03 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:00:03 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 01:00:03 user nova-compute[74850]:       <target dev="tap1fcd413f-b8"/>
Nov 14 01:00:03 user nova-compute[74850]:     </interface>
Nov 14 01:00:03 user nova-compute[74850]:     <serial type="pty">
Nov 14 01:00:03 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/603a931e-3bde-4a7f-b3d7-0993ab535e4c/console.log" append="off"/>
Nov 14 01:00:03 user nova-compute[74850]:     </serial>
Nov 14 01:00:03 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 01:00:03 user nova-compute[74850]:     <video>
Nov 14 01:00:03 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:00:03 user nova-compute[74850]:     </video>
Nov 14 01:00:03 user nova-compute[74850]:     <rng model="virtio">
Nov 14 01:00:03 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 01:00:03 user nova-compute[74850]:     </rng>
Nov 14 01:00:03 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 01:00:03 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 01:00:03 user nova-compute[74850]:       <stats period="10"/>
Nov 14 01:00:03 user nova-compute[74850]:     </memballoon>
Nov 14 01:00:03 user nova-compute[74850]:   </devices>
Nov 14 01:00:03 user nova-compute[74850]: </domain>
Nov 14 01:00:03 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 01:00:03 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1339112381',display_name='tempest-TestVolumeBootPattern-server-1339112381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1339112381',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdb1eb4b5fc841d1952b8db9ae05e446',ramdisk_id='',reservation_id='r-u2ruc9od',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1536334624',owner_user_name='tempest-TestVolumeBootPattern-1536334624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:59:52Z,user_data=None,user_id='6c91ddcee4e54a769eb626c816596bed',uuid=603a931e-3bde-4a7f-b3d7-0993ab535e4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fcd413f-b86c-4cc7-b741-b596ef83394e", "address": "fa:16:3e:ef:54:e4", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fcd413f-b8", "ovs_interfaceid": "1fcd413f-b86c-4cc7-b741-b596ef83394e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 01:00:03 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Converting VIF {"id": "1fcd413f-b86c-4cc7-b741-b596ef83394e", "address": "fa:16:3e:ef:54:e4", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fcd413f-b8", "ovs_interfaceid": "1fcd413f-b86c-4cc7-b741-b596ef83394e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:00:03 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:54:e4,bridge_name='br-int',has_traffic_filtering=True,id=1fcd413f-b86c-4cc7-b741-b596ef83394e,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fcd413f-b8') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:00:03 user nova-compute[74850]: DEBUG os_vif [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:54:e4,bridge_name='br-int',has_traffic_filtering=True,id=1fcd413f-b86c-4cc7-b741-b596ef83394e,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fcd413f-b8') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 01:00:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:00:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 01:00:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9a88754d-d2b9-57d2-945d-4cce425b411d', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:00:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:00:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1fcd413f-b8, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:00:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1fcd413f-b8, col_values=(('qos', UUID('09b4276f-4710-4662-9404-c5282cb3efa9')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:00:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1fcd413f-b8, col_values=(('external_ids', {'iface-id': '1fcd413f-b86c-4cc7-b741-b596ef83394e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:54:e4', 'vm-uuid': '603a931e-3bde-4a7f-b3d7-0993ab535e4c'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:00:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:00:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:03 user nova-compute[74850]: INFO os_vif [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:54:e4,bridge_name='br-int',has_traffic_filtering=True,id=1fcd413f-b86c-4cc7-b741-b596ef83394e,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fcd413f-b8')
Nov 14 01:00:03 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:00:03 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] No VIF found with MAC fa:16:3e:ef:54:e4, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:00:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:05 user nova-compute[74850]: DEBUG nova.compute.manager [req-a48a5334-6a72-4b62-a081-35fb73095b49 req-cc5c6465-5f16-4dac-8fda-b9fed35dd26e service nova] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Received event network-vif-plugged-1fcd413f-b86c-4cc7-b741-b596ef83394e {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:00:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a48a5334-6a72-4b62-a081-35fb73095b49 req-cc5c6465-5f16-4dac-8fda-b9fed35dd26e service nova] Acquiring lock "603a931e-3bde-4a7f-b3d7-0993ab535e4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:00:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a48a5334-6a72-4b62-a081-35fb73095b49 req-cc5c6465-5f16-4dac-8fda-b9fed35dd26e service nova] Lock "603a931e-3bde-4a7f-b3d7-0993ab535e4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:00:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a48a5334-6a72-4b62-a081-35fb73095b49 req-cc5c6465-5f16-4dac-8fda-b9fed35dd26e service nova] Lock "603a931e-3bde-4a7f-b3d7-0993ab535e4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:00:05 user nova-compute[74850]: DEBUG nova.compute.manager [req-a48a5334-6a72-4b62-a081-35fb73095b49 req-cc5c6465-5f16-4dac-8fda-b9fed35dd26e service nova] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] No waiting events found dispatching network-vif-plugged-1fcd413f-b86c-4cc7-b741-b596ef83394e {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:00:05 user nova-compute[74850]: WARNING nova.compute.manager [req-a48a5334-6a72-4b62-a081-35fb73095b49 req-cc5c6465-5f16-4dac-8fda-b9fed35dd26e service nova] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Received unexpected event network-vif-plugged-1fcd413f-b86c-4cc7-b741-b596ef83394e for instance with vm_state building and task_state spawning.
Nov 14 01:00:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:07 user nova-compute[74850]: DEBUG nova.compute.manager [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 01:00:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 01:00:07 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Instance spawned successfully.
Nov 14 01:00:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 01:00:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:00:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:00:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:00:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:00:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:00:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:00:07 user nova-compute[74850]: DEBUG nova.compute.manager [req-fd643652-888c-4e56-83e7-ec9811adbab2 req-b6a5e75a-f519-4c3c-9eb8-7d7f9b2a596f service nova] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Received event network-vif-plugged-1fcd413f-b86c-4cc7-b741-b596ef83394e {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:00:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fd643652-888c-4e56-83e7-ec9811adbab2 req-b6a5e75a-f519-4c3c-9eb8-7d7f9b2a596f service nova] Acquiring lock "603a931e-3bde-4a7f-b3d7-0993ab535e4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:00:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fd643652-888c-4e56-83e7-ec9811adbab2 req-b6a5e75a-f519-4c3c-9eb8-7d7f9b2a596f service nova] Lock "603a931e-3bde-4a7f-b3d7-0993ab535e4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:00:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fd643652-888c-4e56-83e7-ec9811adbab2 req-b6a5e75a-f519-4c3c-9eb8-7d7f9b2a596f service nova] Lock "603a931e-3bde-4a7f-b3d7-0993ab535e4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:00:07 user nova-compute[74850]: DEBUG nova.compute.manager [req-fd643652-888c-4e56-83e7-ec9811adbab2 req-b6a5e75a-f519-4c3c-9eb8-7d7f9b2a596f service nova] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] No waiting events found dispatching network-vif-plugged-1fcd413f-b86c-4cc7-b741-b596ef83394e {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:00:07 user nova-compute[74850]: WARNING nova.compute.manager [req-fd643652-888c-4e56-83e7-ec9811adbab2 req-b6a5e75a-f519-4c3c-9eb8-7d7f9b2a596f service nova] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Received unexpected event network-vif-plugged-1fcd413f-b86c-4cc7-b741-b596ef83394e for instance with vm_state building and task_state spawning.
Nov 14 01:00:07 user nova-compute[74850]: INFO nova.compute.manager [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Took 5.01 seconds to spawn the instance on the hypervisor.
Nov 14 01:00:07 user nova-compute[74850]: DEBUG nova.compute.manager [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 01:00:07 user nova-compute[74850]: INFO nova.compute.manager [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Took 16.29 seconds to build instance.
Nov 14 01:00:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-866a9b29-ada0-4c78-967a-8832dd604e7e tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "603a931e-3bde-4a7f-b3d7-0993ab535e4c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.386s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:00:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:13 user nova-compute[74850]: INFO nova.compute.manager [None req-5e4e59d4-6f1e-4a5f-bf20-b9f07c51315c tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Unrescuing
Nov 14 01:00:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5e4e59d4-6f1e-4a5f-bf20-b9f07c51315c tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "refresh_cache-702746f7-305f-4eac-a71a-6c08b7cbccd8" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:00:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5e4e59d4-6f1e-4a5f-bf20-b9f07c51315c tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquired lock "refresh_cache-702746f7-305f-4eac-a71a-6c08b7cbccd8" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:00:13 user nova-compute[74850]: DEBUG nova.network.neutron [None req-5e4e59d4-6f1e-4a5f-bf20-b9f07c51315c tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 01:00:13 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:14 user nova-compute[74850]: DEBUG nova.network.neutron [None req-5e4e59d4-6f1e-4a5f-bf20-b9f07c51315c tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Updating instance_info_cache with network_info: [{"id": "39232b36-eca6-4dac-880c-43aafa9f1719", "address": "fa:16:3e:ac:57:e7", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39232b36-ec", "ovs_interfaceid": "39232b36-eca6-4dac-880c-43aafa9f1719", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:00:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5e4e59d4-6f1e-4a5f-bf20-b9f07c51315c tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Releasing lock "refresh_cache-702746f7-305f-4eac-a71a-6c08b7cbccd8" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:00:14 user nova-compute[74850]: DEBUG nova.objects.instance [None req-5e4e59d4-6f1e-4a5f-bf20-b9f07c51315c tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lazy-loading 'flavor' on Instance uuid 702746f7-305f-4eac-a71a-6c08b7cbccd8 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:00:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:14 user nova-compute[74850]: DEBUG nova.compute.manager [req-8dd1974b-1202-4f08-99e3-20ce22341e7b req-e8e4a86f-4dfa-48f8-9a72-9199190fa5cd service nova] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Received event network-vif-unplugged-39232b36-eca6-4dac-880c-43aafa9f1719 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:00:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-8dd1974b-1202-4f08-99e3-20ce22341e7b req-e8e4a86f-4dfa-48f8-9a72-9199190fa5cd service nova] Acquiring lock "702746f7-305f-4eac-a71a-6c08b7cbccd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:00:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-8dd1974b-1202-4f08-99e3-20ce22341e7b req-e8e4a86f-4dfa-48f8-9a72-9199190fa5cd service nova] Lock "702746f7-305f-4eac-a71a-6c08b7cbccd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:00:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-8dd1974b-1202-4f08-99e3-20ce22341e7b req-e8e4a86f-4dfa-48f8-9a72-9199190fa5cd service nova] Lock "702746f7-305f-4eac-a71a-6c08b7cbccd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:00:14 user nova-compute[74850]: DEBUG nova.compute.manager [req-8dd1974b-1202-4f08-99e3-20ce22341e7b req-e8e4a86f-4dfa-48f8-9a72-9199190fa5cd service nova] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] No waiting events found dispatching network-vif-unplugged-39232b36-eca6-4dac-880c-43aafa9f1719 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:00:14 user nova-compute[74850]: WARNING nova.compute.manager [req-8dd1974b-1202-4f08-99e3-20ce22341e7b req-e8e4a86f-4dfa-48f8-9a72-9199190fa5cd service nova] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Received unexpected event network-vif-unplugged-39232b36-eca6-4dac-880c-43aafa9f1719 for instance with vm_state rescued and task_state unrescuing.
Nov 14 01:00:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:14 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Instance destroyed successfully.
Nov 14 01:00:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:16 user nova-compute[74850]: DEBUG nova.compute.manager [req-60424fba-5e96-42c1-9f1d-2fc6ece99b61 req-aaa1f216-f673-4f74-9c5b-7eb11ab7911f service nova] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Received event network-vif-plugged-39232b36-eca6-4dac-880c-43aafa9f1719 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:00:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-60424fba-5e96-42c1-9f1d-2fc6ece99b61 req-aaa1f216-f673-4f74-9c5b-7eb11ab7911f service nova] Acquiring lock "702746f7-305f-4eac-a71a-6c08b7cbccd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:00:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-60424fba-5e96-42c1-9f1d-2fc6ece99b61 req-aaa1f216-f673-4f74-9c5b-7eb11ab7911f service nova] Lock "702746f7-305f-4eac-a71a-6c08b7cbccd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:00:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-60424fba-5e96-42c1-9f1d-2fc6ece99b61 req-aaa1f216-f673-4f74-9c5b-7eb11ab7911f service nova] Lock "702746f7-305f-4eac-a71a-6c08b7cbccd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:00:16 user nova-compute[74850]: DEBUG nova.compute.manager [req-60424fba-5e96-42c1-9f1d-2fc6ece99b61 req-aaa1f216-f673-4f74-9c5b-7eb11ab7911f service nova] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] No waiting events found dispatching network-vif-plugged-39232b36-eca6-4dac-880c-43aafa9f1719 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:00:16 user nova-compute[74850]: WARNING nova.compute.manager [req-60424fba-5e96-42c1-9f1d-2fc6ece99b61 req-aaa1f216-f673-4f74-9c5b-7eb11ab7911f service nova] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Received unexpected event network-vif-plugged-39232b36-eca6-4dac-880c-43aafa9f1719 for instance with vm_state rescued and task_state unrescuing.
Nov 14 01:00:16 user nova-compute[74850]: DEBUG nova.compute.manager [req-60424fba-5e96-42c1-9f1d-2fc6ece99b61 req-aaa1f216-f673-4f74-9c5b-7eb11ab7911f service nova] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Received event network-vif-plugged-39232b36-eca6-4dac-880c-43aafa9f1719 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:00:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-60424fba-5e96-42c1-9f1d-2fc6ece99b61 req-aaa1f216-f673-4f74-9c5b-7eb11ab7911f service nova] Acquiring lock "702746f7-305f-4eac-a71a-6c08b7cbccd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:00:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-60424fba-5e96-42c1-9f1d-2fc6ece99b61 req-aaa1f216-f673-4f74-9c5b-7eb11ab7911f service nova] Lock "702746f7-305f-4eac-a71a-6c08b7cbccd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:00:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-60424fba-5e96-42c1-9f1d-2fc6ece99b61 req-aaa1f216-f673-4f74-9c5b-7eb11ab7911f service nova] Lock "702746f7-305f-4eac-a71a-6c08b7cbccd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:00:16 user nova-compute[74850]: DEBUG nova.compute.manager [req-60424fba-5e96-42c1-9f1d-2fc6ece99b61 req-aaa1f216-f673-4f74-9c5b-7eb11ab7911f service nova] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] No waiting events found dispatching network-vif-plugged-39232b36-eca6-4dac-880c-43aafa9f1719 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:00:16 user nova-compute[74850]: WARNING nova.compute.manager [req-60424fba-5e96-42c1-9f1d-2fc6ece99b61 req-aaa1f216-f673-4f74-9c5b-7eb11ab7911f service nova] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Received unexpected event network-vif-plugged-39232b36-eca6-4dac-880c-43aafa9f1719 for instance with vm_state rescued and task_state unrescuing.
Nov 14 01:00:18 user nova-compute[74850]: DEBUG nova.compute.manager [None req-5e4e59d4-6f1e-4a5f-bf20-b9f07c51315c tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 01:00:18 user nova-compute[74850]: DEBUG nova.compute.manager [req-f069e0ef-6d45-4f66-915c-9b5018580890 req-54363d9c-ddb0-4171-878e-61b301d45a17 service nova] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Received event network-vif-plugged-39232b36-eca6-4dac-880c-43aafa9f1719 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:00:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f069e0ef-6d45-4f66-915c-9b5018580890 req-54363d9c-ddb0-4171-878e-61b301d45a17 service nova] Acquiring lock "702746f7-305f-4eac-a71a-6c08b7cbccd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:00:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f069e0ef-6d45-4f66-915c-9b5018580890 req-54363d9c-ddb0-4171-878e-61b301d45a17 service nova] Lock "702746f7-305f-4eac-a71a-6c08b7cbccd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:00:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f069e0ef-6d45-4f66-915c-9b5018580890 req-54363d9c-ddb0-4171-878e-61b301d45a17 service nova] Lock "702746f7-305f-4eac-a71a-6c08b7cbccd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:00:18 user nova-compute[74850]: DEBUG nova.compute.manager [req-f069e0ef-6d45-4f66-915c-9b5018580890 req-54363d9c-ddb0-4171-878e-61b301d45a17 service nova] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] No waiting events found dispatching network-vif-plugged-39232b36-eca6-4dac-880c-43aafa9f1719 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:00:18 user nova-compute[74850]: WARNING nova.compute.manager [req-f069e0ef-6d45-4f66-915c-9b5018580890 req-54363d9c-ddb0-4171-878e-61b301d45a17 service nova] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Received unexpected event network-vif-plugged-39232b36-eca6-4dac-880c-43aafa9f1719 for instance with vm_state active and task_state None.
Nov 14 01:00:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:26 user nova-compute[74850]: DEBUG nova.compute.manager [req-0a126668-0e9e-4b80-9275-857acd1a24d9 req-8e984e02-d57c-4bff-b903-c994b4cf0010 service nova] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Received event network-changed-021a5c27-b8d3-492f-b536-69e13aae8216 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:00:26 user nova-compute[74850]: DEBUG nova.compute.manager [req-0a126668-0e9e-4b80-9275-857acd1a24d9 req-8e984e02-d57c-4bff-b903-c994b4cf0010 service nova] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Refreshing instance network info cache due to event network-changed-021a5c27-b8d3-492f-b536-69e13aae8216. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:00:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-0a126668-0e9e-4b80-9275-857acd1a24d9 req-8e984e02-d57c-4bff-b903-c994b4cf0010 service nova] Acquiring lock "refresh_cache-2749d176-9c59-493e-b3c3-af5980329041" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:00:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-0a126668-0e9e-4b80-9275-857acd1a24d9 req-8e984e02-d57c-4bff-b903-c994b4cf0010 service nova] Acquired lock "refresh_cache-2749d176-9c59-493e-b3c3-af5980329041" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:00:26 user nova-compute[74850]: DEBUG nova.network.neutron [req-0a126668-0e9e-4b80-9275-857acd1a24d9 req-8e984e02-d57c-4bff-b903-c994b4cf0010 service nova] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Refreshing network info cache for port 021a5c27-b8d3-492f-b536-69e13aae8216 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:00:26 user nova-compute[74850]: DEBUG nova.network.neutron [req-0a126668-0e9e-4b80-9275-857acd1a24d9 req-8e984e02-d57c-4bff-b903-c994b4cf0010 service nova] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Updated VIF entry in instance network info cache for port 021a5c27-b8d3-492f-b536-69e13aae8216. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:00:26 user nova-compute[74850]: DEBUG nova.network.neutron [req-0a126668-0e9e-4b80-9275-857acd1a24d9 req-8e984e02-d57c-4bff-b903-c994b4cf0010 service nova] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Updating instance_info_cache with network_info: [{"id": "021a5c27-b8d3-492f-b536-69e13aae8216", "address": "fa:16:3e:77:48:ae", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021a5c27-b8", "ovs_interfaceid": "021a5c27-b8d3-492f-b536-69e13aae8216", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:00:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-0a126668-0e9e-4b80-9275-857acd1a24d9 req-8e984e02-d57c-4bff-b903-c994b4cf0010 service nova] Releasing lock "refresh_cache-2749d176-9c59-493e-b3c3-af5980329041" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:00:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "2749d176-9c59-493e-b3c3-af5980329041" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:00:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "2749d176-9c59-493e-b3c3-af5980329041" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:00:28 user nova-compute[74850]: DEBUG nova.objects.instance [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lazy-loading 'flavor' on Instance uuid 2749d176-9c59-493e-b3c3-af5980329041 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:00:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "2749d176-9c59-493e-b3c3-af5980329041" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:00:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "2749d176-9c59-493e-b3c3-af5980329041" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:00:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "2749d176-9c59-493e-b3c3-af5980329041" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:00:28 user nova-compute[74850]: INFO nova.compute.manager [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Attaching volume 9157061b-8883-48dd-9a75-473a4d8b32ed to /dev/vdb
Nov 14 01:00:29 user nova-compute[74850]: DEBUG os_brick.utils [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:00:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[85819086-6ce8-48dd-8214-de8243b85b1d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:00:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73dc8ce-0885-489e-bc51-d44130eae30d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:00:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30338c0-0d09-4250-89fb-48242689c661]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:00:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c864f4-4dd6-4604-94bd-f4289d68fff4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:00:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:00:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 01:00:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:00:29 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 01:00:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0196e333-99a1-4186-adc9-cf9669f66573]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:00:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 01:00:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 01:00:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 01:00:29 user nova-compute[74850]: DEBUG os_brick.utils [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:00:29 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Updating existing volume attachment record: b63b183a-b415-4a42-b70d-4197c98058fe {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 01:00:30 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GYVDUWaQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:00:33 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:00:33 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:00:33 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:00:33 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:00:33 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 01:00:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae1e6f1-8e67-4192-ab00-ec6a8f03bef1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 01:00:33 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfca93b-24d9-4e81-830f-6ca3371db8f2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed] added
Nov 14 01:00:33 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db980d1-a90a-4d65-ae52-dfce61a0ff44]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42ccc0b-5efc-48cf-88fc-beca7c7017d2]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GYVDUWaQ {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GYVDUWaQ" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[01941bcf-4277-45d0-8de3-564cfa7bcf95]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GYVDUWaQ'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68b5e67-cd33-42a9-bd2b-92a5eb02f4f7]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[853e5f23-4933-4fd1-9fdc-a2e51d91e3fc]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:00:33 user nova-compute[74850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)
Nov 14 01:00:33 user nova-compute[74850]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 (non-flash)
Nov 14 01:00:33 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:00:33 user nova-compute[74850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)
Nov 14 01:00:33 user nova-compute[74850]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 (non-flash)
Nov 14 01:00:33 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e53a19-7d12-4ac8-a134-10f9f2b5e5e5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed, portal: 172.16.0.220,3260]
Nov 14 01:00:33 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed, portal: 172.16.0.220,3260] successful.
Nov 14 01:00:33 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1597dd8-efd1-4c06-a3e0-228f4016c46c]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e140496-5e49-4bad-9da2-12c2a8d8f3fb]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:00:33 user nova-compute[74850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)
Nov 14 01:00:33 user nova-compute[74850]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 (non-flash)
Nov 14 01:00:33 user nova-compute[74850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)
Nov 14 01:00:33 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:00:33 user nova-compute[74850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)
Nov 14 01:00:33 user nova-compute[74850]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 (non-flash)
Nov 14 01:00:33 user nova-compute[74850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)
Nov 14 01:00:33 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[27554257-fccf-490e-8218-8008284eb781]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: None {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:00:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:34 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:00:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GYVDUWaQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 01:00:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:00:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23464346538313532', 'path': '/dev/sdd'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:00:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464346538313532', 'path': '/dev/sdd'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 01:00:34 user nova-compute[74850]: DEBUG nova.objects.instance [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lazy-loading 'flavor' on Instance uuid 2749d176-9c59-493e-b3c3-af5980329041 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:00:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 01:00:34 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:00:34 user nova-compute[74850]:   <source dev="/dev/sdd"/>
Nov 14 01:00:34 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:00:34 user nova-compute[74850]:   <serial>9157061b-8883-48dd-9a75-473a4d8b32ed</serial>
Nov 14 01:00:34 user nova-compute[74850]: </disk>
Nov 14 01:00:34 user nova-compute[74850]:  {{(pid=74850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 01:00:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:00:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:00:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] No VIF found with MAC fa:16:3e:77:48:ae, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:00:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4a1dff60-4566-44b2-b040-b14372013c1a tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "2749d176-9c59-493e-b3c3-af5980329041" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.112s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:00:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "f34cc4c3-1c5d-46d7-92ea-571cb8458b96" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:00:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "f34cc4c3-1c5d-46d7-92ea-571cb8458b96" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:00:38 user nova-compute[74850]: DEBUG nova.compute.manager [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 01:00:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:00:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:00:38 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 01:00:38 user nova-compute[74850]: INFO nova.compute.claims [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Claim successful on node user
Nov 14 01:00:38 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:00:38 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:00:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:00:38 user nova-compute[74850]: DEBUG nova.compute.manager [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 01:00:38 user nova-compute[74850]: DEBUG nova.compute.manager [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 01:00:38 user nova-compute[74850]: DEBUG nova.network.neutron [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 01:00:38 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 01:00:38 user nova-compute[74850]: DEBUG nova.compute.manager [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 01:00:38 user nova-compute[74850]: DEBUG nova.policy [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb027592ab214b57b389227a97576a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f609057d1e44679838d565d80cade3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 01:00:38 user nova-compute[74850]: DEBUG nova.compute.manager [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 01:00:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 01:00:38 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Creating image(s)
Nov 14 01:00:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "/opt/stack/data/nova/instances/f34cc4c3-1c5d-46d7-92ea-571cb8458b96/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:00:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "/opt/stack/data/nova/instances/f34cc4c3-1c5d-46d7-92ea-571cb8458b96/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:00:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "/opt/stack/data/nova/instances/f34cc4c3-1c5d-46d7-92ea-571cb8458b96/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:00:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.170s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:00:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:00:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.174s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/f34cc4c3-1c5d-46d7-92ea-571cb8458b96/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/f34cc4c3-1c5d-46d7-92ea-571cb8458b96/disk 1073741824" returned: 0 in 0.047s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:00:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.168s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:39 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f34cc4c3-1c5d-46d7-92ea-571cb8458b96/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 01:00:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34cc4c3-1c5d-46d7-92ea-571cb8458b96/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:39 user nova-compute[74850]: DEBUG nova.network.neutron [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Successfully created port: 516d15ad-46ae-45f4-b6b5-0082495e79ea {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 01:00:39 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34cc4c3-1c5d-46d7-92ea-571cb8458b96/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:39 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Cannot resize image /opt/stack/data/nova/instances/f34cc4c3-1c5d-46d7-92ea-571cb8458b96/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 01:00:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 01:00:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Ensure instance console log exists: /opt/stack/data/nova/instances/f34cc4c3-1c5d-46d7-92ea-571cb8458b96/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 01:00:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:00:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:00:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG nova.network.neutron [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Successfully updated port: 516d15ad-46ae-45f4-b6b5-0082495e79ea {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "refresh_cache-f34cc4c3-1c5d-46d7-92ea-571cb8458b96" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquired lock "refresh_cache-f34cc4c3-1c5d-46d7-92ea-571cb8458b96" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG nova.network.neutron [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG nova.network.neutron [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG nova.compute.manager [req-5c14c803-4b55-49fa-9b0e-5813c7d11897 req-e7023b7c-a0b0-46ae-8240-92c13b9751bc service nova] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Received event network-changed-516d15ad-46ae-45f4-b6b5-0082495e79ea {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG nova.compute.manager [req-5c14c803-4b55-49fa-9b0e-5813c7d11897 req-e7023b7c-a0b0-46ae-8240-92c13b9751bc service nova] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Refreshing instance network info cache due to event network-changed-516d15ad-46ae-45f4-b6b5-0082495e79ea. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5c14c803-4b55-49fa-9b0e-5813c7d11897 req-e7023b7c-a0b0-46ae-8240-92c13b9751bc service nova] Acquiring lock "refresh_cache-f34cc4c3-1c5d-46d7-92ea-571cb8458b96" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG nova.network.neutron [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Updating instance_info_cache with network_info: [{"id": "516d15ad-46ae-45f4-b6b5-0082495e79ea", "address": "fa:16:3e:b2:d1:a6", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap516d15ad-46", "ovs_interfaceid": "516d15ad-46ae-45f4-b6b5-0082495e79ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Releasing lock "refresh_cache-f34cc4c3-1c5d-46d7-92ea-571cb8458b96" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG nova.compute.manager [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Instance network_info: |[{"id": "516d15ad-46ae-45f4-b6b5-0082495e79ea", "address": "fa:16:3e:b2:d1:a6", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap516d15ad-46", "ovs_interfaceid": "516d15ad-46ae-45f4-b6b5-0082495e79ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5c14c803-4b55-49fa-9b0e-5813c7d11897 req-e7023b7c-a0b0-46ae-8240-92c13b9751bc service nova] Acquired lock "refresh_cache-f34cc4c3-1c5d-46d7-92ea-571cb8458b96" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG nova.network.neutron [req-5c14c803-4b55-49fa-9b0e-5813c7d11897 req-e7023b7c-a0b0-46ae-8240-92c13b9751bc service nova] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Refreshing network info cache for port 516d15ad-46ae-45f4-b6b5-0082495e79ea {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Start _get_guest_xml network_info=[{"id": "516d15ad-46ae-45f4-b6b5-0082495e79ea", "address": "fa:16:3e:b2:d1:a6", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap516d15ad-46", "ovs_interfaceid": "516d15ad-46ae-45f4-b6b5-0082495e79ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 01:00:40 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:00:40 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:00:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:00:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1830912571',display_name='tempest-AttachVolumeNegativeTest-server-1830912571',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1830912571',id=34,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkoxB5DhtdGTVGTn5hhiFej2lflNPEw2Wiyls01JCrc1DF8MQA7DH6Rs9IQhjbSq2VnsX+CE34QgqLZOTYEDpg1ufsIkn/EV9/OiHe+XBf7kaxM5ZqP/unXTyRGyFCZFQ==',key_name='tempest-keypair-1784207057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35f609057d1e44679838d565d80cade3',ramdisk_id='',reservation_id='r-salecyhh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1995397455',owner_user_name='tempest-AttachVolumeNegativeTest-1995397455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:00:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb027592ab214b57b389227a97576a43',uuid=f34cc4c3-1c5d-46d7-92ea-571cb8458b96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "516d15ad-46ae-45f4-b6b5-0082495e79ea", "address": "fa:16:3e:b2:d1:a6", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap516d15ad-46", "ovs_interfaceid": "516d15ad-46ae-45f4-b6b5-0082495e79ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Converting VIF {"id": "516d15ad-46ae-45f4-b6b5-0082495e79ea", "address": "fa:16:3e:b2:d1:a6", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap516d15ad-46", "ovs_interfaceid": "516d15ad-46ae-45f4-b6b5-0082495e79ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:d1:a6,bridge_name='br-int',has_traffic_filtering=True,id=516d15ad-46ae-45f4-b6b5-0082495e79ea,network=Network(11208f55-0e63-4c33-a12c-e061c8061eec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap516d15ad-46') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG nova.objects.instance [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lazy-loading 'pci_devices' on Instance uuid f34cc4c3-1c5d-46d7-92ea-571cb8458b96 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] End _get_guest_xml xml=<domain type="kvm">
Nov 14 01:00:40 user nova-compute[74850]:   <uuid>f34cc4c3-1c5d-46d7-92ea-571cb8458b96</uuid>
Nov 14 01:00:40 user nova-compute[74850]:   <name>instance-00000022</name>
Nov 14 01:00:40 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 01:00:40 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 01:00:40 user nova-compute[74850]:   <metadata>
Nov 14 01:00:40 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 01:00:40 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 01:00:40 user nova-compute[74850]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1830912571</nova:name>
Nov 14 01:00:40 user nova-compute[74850]:       <nova:creationTime>2023-11-14 01:00:40</nova:creationTime>
Nov 14 01:00:40 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 01:00:40 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 01:00:40 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 01:00:40 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 01:00:40 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 01:00:40 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 01:00:40 user nova-compute[74850]:       </nova:flavor>
Nov 14 01:00:40 user nova-compute[74850]:       <nova:owner>
Nov 14 01:00:40 user nova-compute[74850]:         <nova:user uuid="fb027592ab214b57b389227a97576a43">tempest-AttachVolumeNegativeTest-1995397455-project-member</nova:user>
Nov 14 01:00:40 user nova-compute[74850]:         <nova:project uuid="35f609057d1e44679838d565d80cade3">tempest-AttachVolumeNegativeTest-1995397455</nova:project>
Nov 14 01:00:40 user nova-compute[74850]:       </nova:owner>
Nov 14 01:00:40 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 01:00:40 user nova-compute[74850]:       <nova:ports>
Nov 14 01:00:40 user nova-compute[74850]:         <nova:port uuid="516d15ad-46ae-45f4-b6b5-0082495e79ea">
Nov 14 01:00:40 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 01:00:40 user nova-compute[74850]:         </nova:port>
Nov 14 01:00:40 user nova-compute[74850]:       </nova:ports>
Nov 14 01:00:40 user nova-compute[74850]:     </nova:instance>
Nov 14 01:00:40 user nova-compute[74850]:   </metadata>
Nov 14 01:00:40 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 01:00:40 user nova-compute[74850]:     <system>
Nov 14 01:00:40 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 01:00:40 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 01:00:40 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 01:00:40 user nova-compute[74850]:       <entry name="serial">f34cc4c3-1c5d-46d7-92ea-571cb8458b96</entry>
Nov 14 01:00:40 user nova-compute[74850]:       <entry name="uuid">f34cc4c3-1c5d-46d7-92ea-571cb8458b96</entry>
Nov 14 01:00:40 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 01:00:40 user nova-compute[74850]:     </system>
Nov 14 01:00:40 user nova-compute[74850]:   </sysinfo>
Nov 14 01:00:40 user nova-compute[74850]:   <os>
Nov 14 01:00:40 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 01:00:40 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 01:00:40 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 01:00:40 user nova-compute[74850]:   </os>
Nov 14 01:00:40 user nova-compute[74850]:   <features>
Nov 14 01:00:40 user nova-compute[74850]:     <acpi/>
Nov 14 01:00:40 user nova-compute[74850]:     <apic/>
Nov 14 01:00:40 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 01:00:40 user nova-compute[74850]:   </features>
Nov 14 01:00:40 user nova-compute[74850]:   <clock offset="utc">
Nov 14 01:00:40 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 01:00:40 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 01:00:40 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 01:00:40 user nova-compute[74850]:   </clock>
Nov 14 01:00:40 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 01:00:40 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 01:00:40 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 01:00:40 user nova-compute[74850]:   </cpu>
Nov 14 01:00:40 user nova-compute[74850]:   <devices>
Nov 14 01:00:40 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 01:00:40 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 01:00:40 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/f34cc4c3-1c5d-46d7-92ea-571cb8458b96/disk"/>
Nov 14 01:00:40 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 01:00:40 user nova-compute[74850]:     </disk>
Nov 14 01:00:40 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 01:00:40 user nova-compute[74850]:       <mac address="fa:16:3e:b2:d1:a6"/>
Nov 14 01:00:40 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:00:40 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 01:00:40 user nova-compute[74850]:       <target dev="tap516d15ad-46"/>
Nov 14 01:00:40 user nova-compute[74850]:     </interface>
Nov 14 01:00:40 user nova-compute[74850]:     <serial type="pty">
Nov 14 01:00:40 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/f34cc4c3-1c5d-46d7-92ea-571cb8458b96/console.log" append="off"/>
Nov 14 01:00:40 user nova-compute[74850]:     </serial>
Nov 14 01:00:40 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 01:00:40 user nova-compute[74850]:     <video>
Nov 14 01:00:40 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:00:40 user nova-compute[74850]:     </video>
Nov 14 01:00:40 user nova-compute[74850]:     <rng model="virtio">
Nov 14 01:00:40 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 01:00:40 user nova-compute[74850]:     </rng>
Nov 14 01:00:40 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 01:00:40 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 01:00:40 user nova-compute[74850]:       <stats period="10"/>
Nov 14 01:00:40 user nova-compute[74850]:     </memballoon>
Nov 14 01:00:40 user nova-compute[74850]:   </devices>
Nov 14 01:00:40 user nova-compute[74850]: </domain>
Nov 14 01:00:40 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:00:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1830912571',display_name='tempest-AttachVolumeNegativeTest-server-1830912571',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1830912571',id=34,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkoxB5DhtdGTVGTn5hhiFej2lflNPEw2Wiyls01JCrc1DF8MQA7DH6Rs9IQhjbSq2VnsX+CE34QgqLZOTYEDpg1ufsIkn/EV9/OiHe+XBf7kaxM5ZqP/unXTyRGyFCZFQ==',key_name='tempest-keypair-1784207057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35f609057d1e44679838d565d80cade3',ramdisk_id='',reservation_id='r-salecyhh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1995397455',owner_user_name='tempest-AttachVolumeNegativeTest-1995397455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:00:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb027592ab214b57b389227a97576a43',uuid=f34cc4c3-1c5d-46d7-92ea-571cb8458b96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "516d15ad-46ae-45f4-b6b5-0082495e79ea", "address": "fa:16:3e:b2:d1:a6", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap516d15ad-46", "ovs_interfaceid": "516d15ad-46ae-45f4-b6b5-0082495e79ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Converting VIF {"id": "516d15ad-46ae-45f4-b6b5-0082495e79ea", "address": "fa:16:3e:b2:d1:a6", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap516d15ad-46", "ovs_interfaceid": "516d15ad-46ae-45f4-b6b5-0082495e79ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:d1:a6,bridge_name='br-int',has_traffic_filtering=True,id=516d15ad-46ae-45f4-b6b5-0082495e79ea,network=Network(11208f55-0e63-4c33-a12c-e061c8061eec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap516d15ad-46') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG os_vif [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:d1:a6,bridge_name='br-int',has_traffic_filtering=True,id=516d15ad-46ae-45f4-b6b5-0082495e79ea,network=Network(11208f55-0e63-4c33-a12c-e061c8061eec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap516d15ad-46') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f3db8620-6058-5407-be60-8b5424d77711', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap516d15ad-46, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap516d15ad-46, col_values=(('qos', UUID('877b1194-eec0-4fca-bc45-6e6595fb958f')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap516d15ad-46, col_values=(('external_ids', {'iface-id': '516d15ad-46ae-45f4-b6b5-0082495e79ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:d1:a6', 'vm-uuid': 'f34cc4c3-1c5d-46d7-92ea-571cb8458b96'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:40 user nova-compute[74850]: INFO os_vif [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:d1:a6,bridge_name='br-int',has_traffic_filtering=True,id=516d15ad-46ae-45f4-b6b5-0082495e79ea,network=Network(11208f55-0e63-4c33-a12c-e061c8061eec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap516d15ad-46')
Nov 14 01:00:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] No VIF found with MAC fa:16:3e:b2:d1:a6, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG nova.network.neutron [req-5c14c803-4b55-49fa-9b0e-5813c7d11897 req-e7023b7c-a0b0-46ae-8240-92c13b9751bc service nova] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Updated VIF entry in instance network info cache for port 516d15ad-46ae-45f4-b6b5-0082495e79ea. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG nova.network.neutron [req-5c14c803-4b55-49fa-9b0e-5813c7d11897 req-e7023b7c-a0b0-46ae-8240-92c13b9751bc service nova] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Updating instance_info_cache with network_info: [{"id": "516d15ad-46ae-45f4-b6b5-0082495e79ea", "address": "fa:16:3e:b2:d1:a6", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap516d15ad-46", "ovs_interfaceid": "516d15ad-46ae-45f4-b6b5-0082495e79ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:00:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5c14c803-4b55-49fa-9b0e-5813c7d11897 req-e7023b7c-a0b0-46ae-8240-92c13b9751bc service nova] Releasing lock "refresh_cache-f34cc4c3-1c5d-46d7-92ea-571cb8458b96" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:00:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:42 user nova-compute[74850]: DEBUG nova.compute.manager [req-04ad70ce-9e63-4ed9-94ce-522b97109b37 req-ce2953c5-714b-440c-9b6c-144ea9e35ff0 service nova] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Received event network-vif-plugged-516d15ad-46ae-45f4-b6b5-0082495e79ea {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:00:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-04ad70ce-9e63-4ed9-94ce-522b97109b37 req-ce2953c5-714b-440c-9b6c-144ea9e35ff0 service nova] Acquiring lock "f34cc4c3-1c5d-46d7-92ea-571cb8458b96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:00:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-04ad70ce-9e63-4ed9-94ce-522b97109b37 req-ce2953c5-714b-440c-9b6c-144ea9e35ff0 service nova] Lock "f34cc4c3-1c5d-46d7-92ea-571cb8458b96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:00:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-04ad70ce-9e63-4ed9-94ce-522b97109b37 req-ce2953c5-714b-440c-9b6c-144ea9e35ff0 service nova] Lock "f34cc4c3-1c5d-46d7-92ea-571cb8458b96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:00:42 user nova-compute[74850]: DEBUG nova.compute.manager [req-04ad70ce-9e63-4ed9-94ce-522b97109b37 req-ce2953c5-714b-440c-9b6c-144ea9e35ff0 service nova] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] No waiting events found dispatching network-vif-plugged-516d15ad-46ae-45f4-b6b5-0082495e79ea {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:00:42 user nova-compute[74850]: WARNING nova.compute.manager [req-04ad70ce-9e63-4ed9-94ce-522b97109b37 req-ce2953c5-714b-440c-9b6c-144ea9e35ff0 service nova] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Received unexpected event network-vif-plugged-516d15ad-46ae-45f4-b6b5-0082495e79ea for instance with vm_state building and task_state spawning.
Nov 14 01:00:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:43 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e8b6c3a1-e5da-4aad-b03c-2902154d4602 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "1879be4c-9226-4c8c-a56c-f8e37398851b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:00:43 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e8b6c3a1-e5da-4aad-b03c-2902154d4602 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "1879be4c-9226-4c8c-a56c-f8e37398851b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:00:43 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e8b6c3a1-e5da-4aad-b03c-2902154d4602 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "1879be4c-9226-4c8c-a56c-f8e37398851b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:00:43 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e8b6c3a1-e5da-4aad-b03c-2902154d4602 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "1879be4c-9226-4c8c-a56c-f8e37398851b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:00:43 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e8b6c3a1-e5da-4aad-b03c-2902154d4602 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "1879be4c-9226-4c8c-a56c-f8e37398851b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:00:43 user nova-compute[74850]: INFO nova.compute.manager [None req-e8b6c3a1-e5da-4aad-b03c-2902154d4602 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Terminating instance
Nov 14 01:00:43 user nova-compute[74850]: DEBUG nova.compute.manager [None req-e8b6c3a1-e5da-4aad-b03c-2902154d4602 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 01:00:43 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:43 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:43 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:00:43 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74850) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG nova.compute.manager [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG nova.compute.manager [req-f8e8dbd8-e7dc-4df5-8991-0f0eb6b9bbbc req-d8f16e31-364e-48f9-b3f9-7661971f8f79 service nova] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Received event network-vif-unplugged-ff543781-9ab0-418a-ab62-1a74ee0ed1a9 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f8e8dbd8-e7dc-4df5-8991-0f0eb6b9bbbc req-d8f16e31-364e-48f9-b3f9-7661971f8f79 service nova] Acquiring lock "1879be4c-9226-4c8c-a56c-f8e37398851b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f8e8dbd8-e7dc-4df5-8991-0f0eb6b9bbbc req-d8f16e31-364e-48f9-b3f9-7661971f8f79 service nova] Lock "1879be4c-9226-4c8c-a56c-f8e37398851b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f8e8dbd8-e7dc-4df5-8991-0f0eb6b9bbbc req-d8f16e31-364e-48f9-b3f9-7661971f8f79 service nova] Lock "1879be4c-9226-4c8c-a56c-f8e37398851b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG nova.compute.manager [req-f8e8dbd8-e7dc-4df5-8991-0f0eb6b9bbbc req-d8f16e31-364e-48f9-b3f9-7661971f8f79 service nova] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] No waiting events found dispatching network-vif-unplugged-ff543781-9ab0-418a-ab62-1a74ee0ed1a9 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG nova.compute.manager [req-f8e8dbd8-e7dc-4df5-8991-0f0eb6b9bbbc req-d8f16e31-364e-48f9-b3f9-7661971f8f79 service nova] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Received event network-vif-unplugged-ff543781-9ab0-418a-ab62-1a74ee0ed1a9 for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:44 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Instance spawned successfully.
Nov 14 01:00:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:00:44 user nova-compute[74850]: INFO nova.compute.manager [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Took 5.37 seconds to spawn the instance on the hypervisor.
Nov 14 01:00:44 user nova-compute[74850]: DEBUG nova.compute.manager [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG nova.compute.manager [req-31152fd0-4e74-4b4a-a901-8b92b0ca0838 req-49de56b7-c08f-40c3-a2b7-8c2cf5a47cc2 service nova] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Received event network-vif-plugged-516d15ad-46ae-45f4-b6b5-0082495e79ea {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-31152fd0-4e74-4b4a-a901-8b92b0ca0838 req-49de56b7-c08f-40c3-a2b7-8c2cf5a47cc2 service nova] Acquiring lock "f34cc4c3-1c5d-46d7-92ea-571cb8458b96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-31152fd0-4e74-4b4a-a901-8b92b0ca0838 req-49de56b7-c08f-40c3-a2b7-8c2cf5a47cc2 service nova] Lock "f34cc4c3-1c5d-46d7-92ea-571cb8458b96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-31152fd0-4e74-4b4a-a901-8b92b0ca0838 req-49de56b7-c08f-40c3-a2b7-8c2cf5a47cc2 service nova] Lock "f34cc4c3-1c5d-46d7-92ea-571cb8458b96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG nova.compute.manager [req-31152fd0-4e74-4b4a-a901-8b92b0ca0838 req-49de56b7-c08f-40c3-a2b7-8c2cf5a47cc2 service nova] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] No waiting events found dispatching network-vif-plugged-516d15ad-46ae-45f4-b6b5-0082495e79ea {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:00:44 user nova-compute[74850]: WARNING nova.compute.manager [req-31152fd0-4e74-4b4a-a901-8b92b0ca0838 req-49de56b7-c08f-40c3-a2b7-8c2cf5a47cc2 service nova] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Received unexpected event network-vif-plugged-516d15ad-46ae-45f4-b6b5-0082495e79ea for instance with vm_state building and task_state spawning.
Nov 14 01:00:44 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Instance destroyed successfully.
Nov 14 01:00:44 user nova-compute[74850]: DEBUG nova.objects.instance [None req-e8b6c3a1-e5da-4aad-b03c-2902154d4602 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lazy-loading 'resources' on Instance uuid 1879be4c-9226-4c8c-a56c-f8e37398851b {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-e8b6c3a1-e5da-4aad-b03c-2902154d4602 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-298091161',display_name='tempest-ServerRescueNegativeTestJSON-server-298091161',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-298091161',id=3,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:46:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e933e8bc63bd442d882ff59243bd7faa',ramdisk_id='',reservation_id='r-t20jwzvz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-103787426',owner_user_name='tempest-ServerRescueNegativeTestJSON-103787426-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:46:43Z,user_data=None,user_id='84158c07e3344e01bf82e0e25e2a7244',uuid=1879be4c-9226-4c8c-a56c-f8e37398851b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "ff543781-9ab0-418a-ab62-1a74ee0ed1a9", "address": "fa:16:3e:04:e7:ab", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff543781-9a", "ovs_interfaceid": "ff543781-9ab0-418a-ab62-1a74ee0ed1a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-e8b6c3a1-e5da-4aad-b03c-2902154d4602 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Converting VIF {"id": "ff543781-9ab0-418a-ab62-1a74ee0ed1a9", "address": "fa:16:3e:04:e7:ab", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff543781-9a", "ovs_interfaceid": "ff543781-9ab0-418a-ab62-1a74ee0ed1a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-e8b6c3a1-e5da-4aad-b03c-2902154d4602 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:e7:ab,bridge_name='br-int',has_traffic_filtering=True,id=ff543781-9ab0-418a-ab62-1a74ee0ed1a9,network=Network(4bb9b9bb-4485-4fed-bf0e-f549b29f09da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff543781-9a') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG os_vif [None req-e8b6c3a1-e5da-4aad-b03c-2902154d4602 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:e7:ab,bridge_name='br-int',has_traffic_filtering=True,id=ff543781-9ab0-418a-ab62-1a74ee0ed1a9,network=Network(4bb9b9bb-4485-4fed-bf0e-f549b29f09da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff543781-9a') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff543781-9a, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=52de8f71-8f30-4d03-81f1-5699bd7a3342) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:00:44 user nova-compute[74850]: INFO nova.compute.manager [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Took 6.18 seconds to build instance.
Nov 14 01:00:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:44 user nova-compute[74850]: INFO os_vif [None req-e8b6c3a1-e5da-4aad-b03c-2902154d4602 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:e7:ab,bridge_name='br-int',has_traffic_filtering=True,id=ff543781-9ab0-418a-ab62-1a74ee0ed1a9,network=Network(4bb9b9bb-4485-4fed-bf0e-f549b29f09da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff543781-9a')
Nov 14 01:00:44 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-e8b6c3a1-e5da-4aad-b03c-2902154d4602 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Deleting instance files /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b_del
Nov 14 01:00:44 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-e8b6c3a1-e5da-4aad-b03c-2902154d4602 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Deletion of /opt/stack/data/nova/instances/1879be4c-9226-4c8c-a56c-f8e37398851b_del complete
Nov 14 01:00:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fbddec69-8287-4927-ac72-9705fc8dc978 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "f34cc4c3-1c5d-46d7-92ea-571cb8458b96" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.290s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:00:44 user nova-compute[74850]: INFO nova.compute.manager [None req-e8b6c3a1-e5da-4aad-b03c-2902154d4602 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 14 01:00:44 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-e8b6c3a1-e5da-4aad-b03c-2902154d4602 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG nova.compute.manager [req-14719c80-d055-4f81-b6f0-022a964cc3e4 req-6973bf9d-e483-403c-bda8-f85f9bc55d28 service nova] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Received event network-vif-deleted-ff543781-9ab0-418a-ab62-1a74ee0ed1a9 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:00:44 user nova-compute[74850]: INFO nova.compute.manager [req-14719c80-d055-4f81-b6f0-022a964cc3e4 req-6973bf9d-e483-403c-bda8-f85f9bc55d28 service nova] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Neutron deleted interface ff543781-9ab0-418a-ab62-1a74ee0ed1a9; detaching it from the instance and deleting it from the info cache
Nov 14 01:00:44 user nova-compute[74850]: DEBUG nova.network.neutron [req-14719c80-d055-4f81-b6f0-022a964cc3e4 req-6973bf9d-e483-403c-bda8-f85f9bc55d28 service nova] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:00:44 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Took 0.46 seconds to deallocate network for instance.
Nov 14 01:00:44 user nova-compute[74850]: DEBUG nova.compute.manager [req-14719c80-d055-4f81-b6f0-022a964cc3e4 req-6973bf9d-e483-403c-bda8-f85f9bc55d28 service nova] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Detach interface failed, port_id=ff543781-9ab0-418a-ab62-1a74ee0ed1a9, reason: Instance 1879be4c-9226-4c8c-a56c-f8e37398851b could not be found. {{(pid=74850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e8b6c3a1-e5da-4aad-b03c-2902154d4602 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:00:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e8b6c3a1-e5da-4aad-b03c-2902154d4602 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:00:45 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-e8b6c3a1-e5da-4aad-b03c-2902154d4602 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:00:45 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-e8b6c3a1-e5da-4aad-b03c-2902154d4602 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:00:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e8b6c3a1-e5da-4aad-b03c-2902154d4602 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:00:45 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-e8b6c3a1-e5da-4aad-b03c-2902154d4602 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Deleted allocations for instance 1879be4c-9226-4c8c-a56c-f8e37398851b
Nov 14 01:00:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e8b6c3a1-e5da-4aad-b03c-2902154d4602 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "1879be4c-9226-4c8c-a56c-f8e37398851b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.704s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:00:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:46 user nova-compute[74850]: DEBUG nova.compute.manager [req-001f5f6c-bf83-4585-a7e5-e622ab6b6607 req-13ec057f-776b-496e-beab-1f4ebb70116b service nova] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Received event network-vif-plugged-ff543781-9ab0-418a-ab62-1a74ee0ed1a9 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:00:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-001f5f6c-bf83-4585-a7e5-e622ab6b6607 req-13ec057f-776b-496e-beab-1f4ebb70116b service nova] Acquiring lock "1879be4c-9226-4c8c-a56c-f8e37398851b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:00:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-001f5f6c-bf83-4585-a7e5-e622ab6b6607 req-13ec057f-776b-496e-beab-1f4ebb70116b service nova] Lock "1879be4c-9226-4c8c-a56c-f8e37398851b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:00:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-001f5f6c-bf83-4585-a7e5-e622ab6b6607 req-13ec057f-776b-496e-beab-1f4ebb70116b service nova] Lock "1879be4c-9226-4c8c-a56c-f8e37398851b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:00:46 user nova-compute[74850]: DEBUG nova.compute.manager [req-001f5f6c-bf83-4585-a7e5-e622ab6b6607 req-13ec057f-776b-496e-beab-1f4ebb70116b service nova] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] No waiting events found dispatching network-vif-plugged-ff543781-9ab0-418a-ab62-1a74ee0ed1a9 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:00:46 user nova-compute[74850]: WARNING nova.compute.manager [req-001f5f6c-bf83-4585-a7e5-e622ab6b6607 req-13ec057f-776b-496e-beab-1f4ebb70116b service nova] [instance: 1879be4c-9226-4c8c-a56c-f8e37398851b] Received unexpected event network-vif-plugged-ff543781-9ab0-418a-ab62-1a74ee0ed1a9 for instance with vm_state deleted and task_state None.
Nov 14 01:00:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:00:50 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:00:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:00:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:00:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:00:50 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 01:00:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2749d176-9c59-493e-b3c3-af5980329041/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2749d176-9c59-493e-b3c3-af5980329041/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2749d176-9c59-493e-b3c3-af5980329041/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2749d176-9c59-493e-b3c3-af5980329041/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:00:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:00:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:00:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:00:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34cc4c3-1c5d-46d7-92ea-571cb8458b96/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34cc4c3-1c5d-46d7-92ea-571cb8458b96/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34cc4c3-1c5d-46d7-92ea-571cb8458b96/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:00:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34cc4c3-1c5d-46d7-92ea-571cb8458b96/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:00:54 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:00:54 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:00:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=7999MB free_disk=25.12982940673828GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 01:00:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:00:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:00:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance a70d0196-f90e-47c4-be67-bf7ef4c3d8c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:00:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 748d0da7-bbb9-4e86-aae3-e48b1fa04c14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:00:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance c7952bff-87d6-46c1-a6d4-7729dc4893ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:00:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 702746f7-305f-4eac-a71a-6c08b7cbccd8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:00:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 782a85d0-b427-4ee2-8d6c-778602f00bcd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:00:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 2749d176-9c59-493e-b3c3-af5980329041 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:00:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:00:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 603a931e-3bde-4a7f-b3d7-0993ab535e4c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:00:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance f34cc4c3-1c5d-46d7-92ea-571cb8458b96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:00:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 01:00:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 01:00:54 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:00:54 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:00:54 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:00:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 01:00:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.414s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:00:57 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:00:57 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:00:57 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:00:58 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:00:58 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:00:58 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:00:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:00:59 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:00:59 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 01:01:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "refresh_cache-c7952bff-87d6-46c1-a6d4-7729dc4893ff" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:01:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquired lock "refresh_cache-c7952bff-87d6-46c1-a6d4-7729dc4893ff" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:01:00 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Forcefully refreshing network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 01:01:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:00 user nova-compute[74850]: DEBUG nova.compute.manager [req-3b090632-2280-4936-8c23-3cd05dcb7d6c req-800a3830-66d8-4ebc-bb19-e3417565ac5d service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Received event network-changed-ee3e224b-fade-4ac4-bb64-1bf1a4df045c {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:01:00 user nova-compute[74850]: DEBUG nova.compute.manager [req-3b090632-2280-4936-8c23-3cd05dcb7d6c req-800a3830-66d8-4ebc-bb19-e3417565ac5d service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Refreshing instance network info cache due to event network-changed-ee3e224b-fade-4ac4-bb64-1bf1a4df045c. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:01:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3b090632-2280-4936-8c23-3cd05dcb7d6c req-800a3830-66d8-4ebc-bb19-e3417565ac5d service nova] Acquiring lock "refresh_cache-7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:01:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3b090632-2280-4936-8c23-3cd05dcb7d6c req-800a3830-66d8-4ebc-bb19-e3417565ac5d service nova] Acquired lock "refresh_cache-7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:01:00 user nova-compute[74850]: DEBUG nova.network.neutron [req-3b090632-2280-4936-8c23-3cd05dcb7d6c req-800a3830-66d8-4ebc-bb19-e3417565ac5d service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Refreshing network info cache for port ee3e224b-fade-4ac4-bb64-1bf1a4df045c {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:01:00 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Updating instance_info_cache with network_info: [{"id": "de35d2a9-b199-4dbc-8394-915938223e27", "address": "fa:16:3e:b9:56:80", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde35d2a9-b1", "ovs_interfaceid": "de35d2a9-b199-4dbc-8394-915938223e27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:01:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Releasing lock "refresh_cache-c7952bff-87d6-46c1-a6d4-7729dc4893ff" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:01:00 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Updated the network info_cache for instance {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 01:01:00 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:01:00 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 01:01:01 user nova-compute[74850]: DEBUG nova.network.neutron [req-3b090632-2280-4936-8c23-3cd05dcb7d6c req-800a3830-66d8-4ebc-bb19-e3417565ac5d service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Updated VIF entry in instance network info cache for port ee3e224b-fade-4ac4-bb64-1bf1a4df045c. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:01:01 user nova-compute[74850]: DEBUG nova.network.neutron [req-3b090632-2280-4936-8c23-3cd05dcb7d6c req-800a3830-66d8-4ebc-bb19-e3417565ac5d service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Updating instance_info_cache with network_info: [{"id": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "address": "fa:16:3e:06:ff:75", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3e224b-fa", "ovs_interfaceid": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:01:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3b090632-2280-4936-8c23-3cd05dcb7d6c req-800a3830-66d8-4ebc-bb19-e3417565ac5d service nova] Releasing lock "refresh_cache-7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:01:01 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:01:01 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:01:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-90be87df-0551-4b2d-83a9-caa495f078ea tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:01:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-90be87df-0551-4b2d-83a9-caa495f078ea tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:01:03 user nova-compute[74850]: INFO nova.compute.manager [None req-90be87df-0551-4b2d-83a9-caa495f078ea tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Shelving
Nov 14 01:01:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:03 user nova-compute[74850]: DEBUG nova.compute.manager [req-91148783-b60a-4498-bfe7-51ed8a1e6e45 req-51478eba-d1d6-4691-b11b-33f63dc7e077 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Received event network-vif-unplugged-ee3e224b-fade-4ac4-bb64-1bf1a4df045c {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:01:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-91148783-b60a-4498-bfe7-51ed8a1e6e45 req-51478eba-d1d6-4691-b11b-33f63dc7e077 service nova] Acquiring lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:01:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-91148783-b60a-4498-bfe7-51ed8a1e6e45 req-51478eba-d1d6-4691-b11b-33f63dc7e077 service nova] Lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:01:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-91148783-b60a-4498-bfe7-51ed8a1e6e45 req-51478eba-d1d6-4691-b11b-33f63dc7e077 service nova] Lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:01:03 user nova-compute[74850]: DEBUG nova.compute.manager [req-91148783-b60a-4498-bfe7-51ed8a1e6e45 req-51478eba-d1d6-4691-b11b-33f63dc7e077 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] No waiting events found dispatching network-vif-unplugged-ee3e224b-fade-4ac4-bb64-1bf1a4df045c {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:01:03 user nova-compute[74850]: WARNING nova.compute.manager [req-91148783-b60a-4498-bfe7-51ed8a1e6e45 req-51478eba-d1d6-4691-b11b-33f63dc7e077 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Received unexpected event network-vif-unplugged-ee3e224b-fade-4ac4-bb64-1bf1a4df045c for instance with vm_state active and task_state shelving.
Nov 14 01:01:03 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:01:03 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Cleaning up deleted instances {{(pid=74850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 01:01:03 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] There are 0 instances to clean {{(pid=74850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 01:01:04 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Instance destroyed successfully.
Nov 14 01:01:04 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-90be87df-0551-4b2d-83a9-caa495f078ea tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Beginning cold snapshot process
Nov 14 01:01:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:04 user nova-compute[74850]: DEBUG nova.privsep.utils [None req-90be87df-0551-4b2d-83a9-caa495f078ea tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74850) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 01:01:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-90be87df-0551-4b2d-83a9-caa495f078ea tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/disk /opt/stack/data/nova/instances/snapshots/tmpn5y4o9e_/1ca92b8165a24e64a1c2b1e8ef1c5c97 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-90be87df-0551-4b2d-83a9-caa495f078ea tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/disk /opt/stack/data/nova/instances/snapshots/tmpn5y4o9e_/1ca92b8165a24e64a1c2b1e8ef1c5c97" returned: 0 in 0.805s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:05 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-90be87df-0551-4b2d-83a9-caa495f078ea tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Snapshot extracted, beginning image upload
Nov 14 01:01:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:05 user nova-compute[74850]: DEBUG nova.compute.manager [req-b77671f9-5c66-4350-89b7-cc0e3bd07d4c req-a2c6158c-7044-4677-b455-9fafd1527600 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Received event network-vif-plugged-ee3e224b-fade-4ac4-bb64-1bf1a4df045c {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:01:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b77671f9-5c66-4350-89b7-cc0e3bd07d4c req-a2c6158c-7044-4677-b455-9fafd1527600 service nova] Acquiring lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:01:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b77671f9-5c66-4350-89b7-cc0e3bd07d4c req-a2c6158c-7044-4677-b455-9fafd1527600 service nova] Lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:01:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b77671f9-5c66-4350-89b7-cc0e3bd07d4c req-a2c6158c-7044-4677-b455-9fafd1527600 service nova] Lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:01:05 user nova-compute[74850]: DEBUG nova.compute.manager [req-b77671f9-5c66-4350-89b7-cc0e3bd07d4c req-a2c6158c-7044-4677-b455-9fafd1527600 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] No waiting events found dispatching network-vif-plugged-ee3e224b-fade-4ac4-bb64-1bf1a4df045c {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:01:05 user nova-compute[74850]: WARNING nova.compute.manager [req-b77671f9-5c66-4350-89b7-cc0e3bd07d4c req-a2c6158c-7044-4677-b455-9fafd1527600 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Received unexpected event network-vif-plugged-ee3e224b-fade-4ac4-bb64-1bf1a4df045c for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 01:01:06 user nova-compute[74850]: DEBUG nova.objects.instance [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lazy-loading 'flavor' on Instance uuid 782a85d0-b427-4ee2-8d6c-778602f00bcd {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:01:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "refresh_cache-782a85d0-b427-4ee2-8d6c-778602f00bcd" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:01:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquired lock "refresh_cache-782a85d0-b427-4ee2-8d6c-778602f00bcd" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:01:06 user nova-compute[74850]: DEBUG nova.network.neutron [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 01:01:06 user nova-compute[74850]: DEBUG nova.objects.instance [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lazy-loading 'info_cache' on Instance uuid 782a85d0-b427-4ee2-8d6c-778602f00bcd {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:01:06 user nova-compute[74850]: DEBUG nova.objects.base [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Object Instance<782a85d0-b427-4ee2-8d6c-778602f00bcd> lazy-loaded attributes: flavor,info_cache {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG nova.network.neutron [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Updating instance_info_cache with network_info: [{"id": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "address": "fa:16:3e:70:96:bf", "network": {"id": "75650b3d-1169-46fa-a1cf-7ae51dd28e18", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227679489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3e629e632d444faf3898681aaafa79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744a9e-48", "ovs_interfaceid": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Releasing lock "refresh_cache-782a85d0-b427-4ee2-8d6c-778602f00bcd" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:01:07 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Instance destroyed successfully.
Nov 14 01:01:07 user nova-compute[74850]: DEBUG nova.objects.instance [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lazy-loading 'resources' on Instance uuid 782a85d0-b427-4ee2-8d6c-778602f00bcd {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG nova.objects.base [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Object Instance<782a85d0-b427-4ee2-8d6c-778602f00bcd> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:57:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-931477227',display_name='tempest-AttachVolumeTestJSON-server-931477227',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-931477227',id=30,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqGPtaAqtRvdnzrU67gWLSZdIWQoykWaBYabKPElkLS5sz5jLsrZV0zgILMNEA+Yd/7TrkBFbU+t9G+drRSGt2wGNzDluZHtIgMdrMvm4dKLEvsHluVt5xKssaIW0AwAg==',key_name='tempest-keypair-1840551366',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:57:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0c3e629e632d444faf3898681aaafa79',ramdisk_id='',reservation_id='r-iuno8cu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1639440895',owner_user_name='tempest-AttachVolumeTestJSON-1639440895-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:59:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b677f8f7b06431cbeac4cbdfa2dcbf5',uuid=782a85d0-b427-4ee2-8d6c-778602f00bcd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "address": "fa:16:3e:70:96:bf", "network": {"id": "75650b3d-1169-46fa-a1cf-7ae51dd28e18", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227679489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3e629e632d444faf3898681aaafa79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744a9e-48", "ovs_interfaceid": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Converting VIF {"id": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "address": "fa:16:3e:70:96:bf", "network": {"id": "75650b3d-1169-46fa-a1cf-7ae51dd28e18", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227679489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3e629e632d444faf3898681aaafa79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744a9e-48", "ovs_interfaceid": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:96:bf,bridge_name='br-int',has_traffic_filtering=True,id=b4744a9e-4848-49b9-9f58-7d29e0ecb9c7,network=Network(75650b3d-1169-46fa-a1cf-7ae51dd28e18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4744a9e-48') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG os_vif [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:96:bf,bridge_name='br-int',has_traffic_filtering=True,id=b4744a9e-4848-49b9-9f58-7d29e0ecb9c7,network=Network(75650b3d-1169-46fa-a1cf-7ae51dd28e18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4744a9e-48') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4744a9e-48, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2ad9ace5-62fb-4065-9241-de41ac0867d9) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:07 user nova-compute[74850]: INFO os_vif [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:96:bf,bridge_name='br-int',has_traffic_filtering=True,id=b4744a9e-4848-49b9-9f58-7d29e0ecb9c7,network=Network(75650b3d-1169-46fa-a1cf-7ae51dd28e18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4744a9e-48')
Nov 14 01:01:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ePJdMtNr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:01:07 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:01:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[220dcc4f-f4f0-49cd-81eb-dd29a282ad1f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 01:01:07 user nova-compute[74850]: No targets found.
Nov 14 01:01:07 user nova-compute[74850]: iSNS:
Nov 14 01:01:07 user nova-compute[74850]: No targets found.
Nov 14 01:01:07 user nova-compute[74850]: STATIC:
Nov 14 01:01:07 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1
Nov 14 01:01:07 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:01:07 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:01:07 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d
Nov 14 01:01:07 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:01:07 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:01:07 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739
Nov 14 01:01:07 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:01:07 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:01:07 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed
Nov 14 01:01:07 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:01:07 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:01:07 user nova-compute[74850]: FIRMWARE:
Nov 14 01:01:07 user nova-compute[74850]: No targets found.
Nov 14 01:01:07 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 01:01:07 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 01:01:07 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[16082352-54bf-4336-98e8-095ae080df47]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e951333-bda7-44b0-86ed-03176ecc470f]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:01:07 user nova-compute[74850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)
Nov 14 01:01:07 user nova-compute[74850]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 (non-flash)
Nov 14 01:01:07 user nova-compute[74850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)
Nov 14 01:01:07 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:01:07 user nova-compute[74850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)
Nov 14 01:01:07 user nova-compute[74850]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 (non-flash)
Nov 14 01:01:07 user nova-compute[74850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)
Nov 14 01:01:07 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a1c7709d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1'): ({'sdb'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Removing single pathed devices sdb {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd7eab4-2cfd-4d63-b517-9fadc1d06fa7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:07 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-90be87df-0551-4b2d-83a9-caa495f078ea tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Snapshot image upload complete
Nov 14 01:01:07 user nova-compute[74850]: DEBUG nova.compute.manager [None req-90be87df-0551-4b2d-83a9-caa495f078ea tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[780f3ab6-c6f5-4534-ae33-8d45671c0b98]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Flushing IO for device /dev/sdb {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[242f470b-7159-4bd5-ae86-ba21af1a8a0e]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc436c9-13b6-41b6-a2b3-669bac9a00b3]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:07 user nova-compute[74850]: INFO nova.compute.manager [None req-90be87df-0551-4b2d-83a9-caa495f078ea tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Shelve offloading
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3114c6b-e5e8-4295-9026-882cd79e658f]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:07 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Instance destroyed successfully.
Nov 14 01:01:07 user nova-compute[74850]: DEBUG nova.compute.manager [None req-90be87df-0551-4b2d-83a9-caa495f078ea tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-90be87df-0551-4b2d-83a9-caa495f078ea tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "refresh_cache-7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-90be87df-0551-4b2d-83a9-caa495f078ea tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquired lock "refresh_cache-7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG nova.network.neutron [None req-90be87df-0551-4b2d-83a9-caa495f078ea tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83f699d-3edf-4ac8-8d72-f55c1d7cbd25]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1, portal: 172.16.0.220,3260]
Nov 14 01:01:07 user nova-compute[74850]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1, portal: 172.16.0.220,3260] successful.
Nov 14 01:01:07 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[95778763-8522-4177-9147-d82e46738d1f]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] <== disconnect_volume: return (337ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Start _get_guest_xml network_info=[{"id": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "address": "fa:16:3e:70:96:bf", "network": {"id": "75650b3d-1169-46fa-a1cf-7ae51dd28e18", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227679489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3e629e632d444faf3898681aaafa79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744a9e-48", "ovs_interfaceid": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '7012802f-fc42-40f0-bbc6-12e3e6db4e21', 'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ePJdMtNr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '782a85d0-b427-4ee2-8d6c-778602f00bcd', 'attached_at': '', 'detached_at': '', 'volume_id': '40c8987b-4ae1-4338-b6da-3d4612c015e1', 'serial': '40c8987b-4ae1-4338-b6da-3d4612c015e1'}, 'volume_type': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG nova.objects.instance [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lazy-loading 'numa_topology' on Instance uuid 782a85d0-b427-4ee2-8d6c-778602f00bcd {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG nova.objects.base [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Object Instance<782a85d0-b427-4ee2-8d6c-778602f00bcd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 01:01:07 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:01:07 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:01:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG nova.objects.instance [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lazy-loading 'vcpu_model' on Instance uuid 782a85d0-b427-4ee2-8d6c-778602f00bcd {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG nova.objects.base [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Object Instance<782a85d0-b427-4ee2-8d6c-778602f00bcd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ePJdMtNr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:01:07 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:01:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:01:07 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:01:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:01:07 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a06c128-a1ea-40e1-81b3-97ee1b7ba656]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 01:01:07 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe7ca3d-8756-453b-81d0-58a14c2ddc5a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1] added
Nov 14 01:01:07 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:01:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[792872af-d373-4498-b4a1-8405fb2f8984]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5087967c-291c-4ed4-b65a-72a01e0e3e14]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ePJdMtNr {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ePJdMtNr" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[30abd3f4-aef4-467b-9244-bdf836d05dbc]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ePJdMtNr'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[712d9572-7e31-4c40-85a8-ab99419cd8f8]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c661303-8969-458c-8364-75c142f6b447]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:01:08 user nova-compute[74850]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 (non-flash)
Nov 14 01:01:08 user nova-compute[74850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)
Nov 14 01:01:08 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:01:08 user nova-compute[74850]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 (non-flash)
Nov 14 01:01:08 user nova-compute[74850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)
Nov 14 01:01:08 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG nova.network.neutron [None req-90be87df-0551-4b2d-83a9-caa495f078ea tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Updating instance_info_cache with network_info: [{"id": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "address": "fa:16:3e:06:ff:75", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3e224b-fa", "ovs_interfaceid": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9275bec7-9165-4e1c-8403-24ba161c04ff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1, portal: 172.16.0.220,3260]
Nov 14 01:01:08 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1, portal: 172.16.0.220,3260] successful.
Nov 14 01:01:08 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-90be87df-0551-4b2d-83a9-caa495f078ea tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Releasing lock "refresh_cache-7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1d06db-5c55-4360-874e-01556f929a62]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4d85c0-5a22-4ef9-b107-1fddcd5cf9a2]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:01:08 user nova-compute[74850]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 (non-flash)
Nov 14 01:01:08 user nova-compute[74850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)
Nov 14 01:01:08 user nova-compute[74850]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)
Nov 14 01:01:08 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:01:08 user nova-compute[74850]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 (non-flash)
Nov 14 01:01:08 user nova-compute[74850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)
Nov 14 01:01:08 user nova-compute[74850]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)
Nov 14 01:01:08 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5296206a-3a5a-4251-8383-76e029a4ccb5]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ePJdMtNr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 01:01:08 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Instance destroyed successfully.
Nov 14 01:01:08 user nova-compute[74850]: DEBUG nova.objects.instance [None req-90be87df-0551-4b2d-83a9-caa495f078ea tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lazy-loading 'resources' on Instance uuid 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-90be87df-0551-4b2d-83a9-caa495f078ea tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:59:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-589429054',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-589429054',id=32,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlYimApQkMypM1Jjvk0FBuh/aRLC/vPd/t+SoVKgbKU6stO3sCw/jpQFU3J/aANjVRSOq807ChnwPcFRUlfzkxpk30iEXkNZZFCxlyV6ZflIjFflWG7QN4jpLjTPyifHw==',key_name='tempest-keypair-553908575',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:59:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e396f5de82e54abfa812bf8a7e89b0c4',ramdisk_id='',reservation_id='r-s21f41qa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-270753956',owner_user_name='tempest-AttachVolumeShelveTestJSON-270753956-project-member',shelved_at='2023-11-14T01:01:07.653305',shelved_host='user',shelved_image_id='5047e287-fdef-4d7d-9a92-fcea553cea55'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T01:01:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe8332d8221a49db86a402c5851b4882',uuid=7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "address": "fa:16:3e:06:ff:75", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3e224b-fa", "ovs_interfaceid": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-90be87df-0551-4b2d-83a9-caa495f078ea tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Converting VIF {"id": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "address": "fa:16:3e:06:ff:75", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3e224b-fa", "ovs_interfaceid": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-90be87df-0551-4b2d-83a9-caa495f078ea tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:ff:75,bridge_name='br-int',has_traffic_filtering=True,id=ee3e224b-fade-4ac4-bb64-1bf1a4df045c,network=Network(dfd22096-9f0c-4e0f-aac4-06c224b5b9f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee3e224b-fa') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG os_vif [None req-90be87df-0551-4b2d-83a9-caa495f078ea tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:ff:75,bridge_name='br-int',has_traffic_filtering=True,id=ee3e224b-fade-4ac4-bb64-1bf1a4df045c,network=Network(dfd22096-9f0c-4e0f-aac4-06c224b5b9f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee3e224b-fa') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee3e224b-fa, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG nova.compute.manager [req-6f7f6aaf-97f0-41e7-b738-b6b80cd08868 req-4d737a99-dd64-4f03-bead-74b21c46be99 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Received event network-changed-ee3e224b-fade-4ac4-bb64-1bf1a4df045c {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG nova.compute.manager [req-6f7f6aaf-97f0-41e7-b738-b6b80cd08868 req-4d737a99-dd64-4f03-bead-74b21c46be99 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Refreshing instance network info cache due to event network-changed-ee3e224b-fade-4ac4-bb64-1bf1a4df045c. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6f7f6aaf-97f0-41e7-b738-b6b80cd08868 req-4d737a99-dd64-4f03-bead-74b21c46be99 service nova] Acquiring lock "refresh_cache-7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6f7f6aaf-97f0-41e7-b738-b6b80cd08868 req-4d737a99-dd64-4f03-bead-74b21c46be99 service nova] Acquired lock "refresh_cache-7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG nova.network.neutron [req-6f7f6aaf-97f0-41e7-b738-b6b80cd08868 req-4d737a99-dd64-4f03-bead-74b21c46be99 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Refreshing network info cache for port ee3e224b-fade-4ac4-bb64-1bf1a4df045c {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2998ca86-4a66-42ea-954b-7393a9ae2848) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:01:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:01:08 user nova-compute[74850]: INFO os_vif [None req-90be87df-0551-4b2d-83a9-caa495f078ea tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:ff:75,bridge_name='br-int',has_traffic_filtering=True,id=ee3e224b-fade-4ac4-bb64-1bf1a4df045c,network=Network(dfd22096-9f0c-4e0f-aac4-06c224b5b9f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee3e224b-fa')
Nov 14 01:01:08 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-90be87df-0551-4b2d-83a9-caa495f078ea tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Deleting instance files /opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e_del
Nov 14 01:01:08 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-90be87df-0551-4b2d-83a9-caa495f078ea tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Deletion of /opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e_del complete
Nov 14 01:01:08 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-90be87df-0551-4b2d-83a9-caa495f078ea tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Deleted allocations for instance 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e
Nov 14 01:01:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-90be87df-0551-4b2d-83a9-caa495f078ea tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:01:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-90be87df-0551-4b2d-83a9-caa495f078ea tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:01:09 user nova-compute[74850]: DEBUG nova.objects.instance [None req-90be87df-0551-4b2d-83a9-caa495f078ea tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lazy-loading 'numa_topology' on Instance uuid 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:01:09 user nova-compute[74850]: DEBUG nova.objects.base [None req-90be87df-0551-4b2d-83a9-caa495f078ea tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Object Instance<7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e> lazy-loaded attributes: resources,numa_topology {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 01:01:09 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-90be87df-0551-4b2d-83a9-caa495f078ea tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:01:09 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:01:09 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23634313532396465', 'path': '/dev/sdb'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:01:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634313532396465', 'path': '/dev/sdb'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 01:01:09 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-90be87df-0551-4b2d-83a9-caa495f078ea tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:01:09 user nova-compute[74850]: DEBUG nova.network.neutron [req-6f7f6aaf-97f0-41e7-b738-b6b80cd08868 req-4d737a99-dd64-4f03-bead-74b21c46be99 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Updated VIF entry in instance network info cache for port ee3e224b-fade-4ac4-bb64-1bf1a4df045c. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:01:09 user nova-compute[74850]: DEBUG nova.network.neutron [req-6f7f6aaf-97f0-41e7-b738-b6b80cd08868 req-4d737a99-dd64-4f03-bead-74b21c46be99 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Updating instance_info_cache with network_info: [{"id": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "address": "fa:16:3e:06:ff:75", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapee3e224b-fa", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:01:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-90be87df-0551-4b2d-83a9-caa495f078ea tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.458s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:01:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:57:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-931477227',display_name='tempest-AttachVolumeTestJSON-server-931477227',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-931477227',id=30,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqGPtaAqtRvdnzrU67gWLSZdIWQoykWaBYabKPElkLS5sz5jLsrZV0zgILMNEA+Yd/7TrkBFbU+t9G+drRSGt2wGNzDluZHtIgMdrMvm4dKLEvsHluVt5xKssaIW0AwAg==',key_name='tempest-keypair-1840551366',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:57:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0c3e629e632d444faf3898681aaafa79',ramdisk_id='',reservation_id='r-iuno8cu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1639440895',owner_user_name='tempest-AttachVolumeTestJSON-1639440895-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:59:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b677f8f7b06431cbeac4cbdfa2dcbf5',uuid=782a85d0-b427-4ee2-8d6c-778602f00bcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "address": "fa:16:3e:70:96:bf", "network": {"id": "75650b3d-1169-46fa-a1cf-7ae51dd28e18", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227679489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3e629e632d444faf3898681aaafa79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744a9e-48", "ovs_interfaceid": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 01:01:09 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Converting VIF {"id": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "address": "fa:16:3e:70:96:bf", "network": {"id": "75650b3d-1169-46fa-a1cf-7ae51dd28e18", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227679489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3e629e632d444faf3898681aaafa79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744a9e-48", "ovs_interfaceid": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:01:09 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:96:bf,bridge_name='br-int',has_traffic_filtering=True,id=b4744a9e-4848-49b9-9f58-7d29e0ecb9c7,network=Network(75650b3d-1169-46fa-a1cf-7ae51dd28e18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4744a9e-48') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:01:09 user nova-compute[74850]: DEBUG nova.objects.instance [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lazy-loading 'pci_devices' on Instance uuid 782a85d0-b427-4ee2-8d6c-778602f00bcd {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:01:09 user nova-compute[74850]: DEBUG nova.objects.base [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Object Instance<782a85d0-b427-4ee2-8d6c-778602f00bcd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 01:01:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] End _get_guest_xml xml=<domain type="kvm">
Nov 14 01:01:09 user nova-compute[74850]:   <uuid>782a85d0-b427-4ee2-8d6c-778602f00bcd</uuid>
Nov 14 01:01:09 user nova-compute[74850]:   <name>instance-0000001e</name>
Nov 14 01:01:09 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 01:01:09 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 01:01:09 user nova-compute[74850]:   <metadata>
Nov 14 01:01:09 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 01:01:09 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 01:01:09 user nova-compute[74850]:       <nova:name>tempest-AttachVolumeTestJSON-server-931477227</nova:name>
Nov 14 01:01:09 user nova-compute[74850]:       <nova:creationTime>2023-11-14 01:01:07</nova:creationTime>
Nov 14 01:01:09 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 01:01:09 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 01:01:09 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 01:01:09 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 01:01:09 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 01:01:09 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 01:01:09 user nova-compute[74850]:       </nova:flavor>
Nov 14 01:01:09 user nova-compute[74850]:       <nova:owner>
Nov 14 01:01:09 user nova-compute[74850]:         <nova:user uuid="4b677f8f7b06431cbeac4cbdfa2dcbf5">tempest-AttachVolumeTestJSON-1639440895-project-member</nova:user>
Nov 14 01:01:09 user nova-compute[74850]:         <nova:project uuid="0c3e629e632d444faf3898681aaafa79">tempest-AttachVolumeTestJSON-1639440895</nova:project>
Nov 14 01:01:09 user nova-compute[74850]:       </nova:owner>
Nov 14 01:01:09 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 01:01:09 user nova-compute[74850]:       <nova:ports>
Nov 14 01:01:09 user nova-compute[74850]:         <nova:port uuid="b4744a9e-4848-49b9-9f58-7d29e0ecb9c7">
Nov 14 01:01:09 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 01:01:09 user nova-compute[74850]:         </nova:port>
Nov 14 01:01:09 user nova-compute[74850]:       </nova:ports>
Nov 14 01:01:09 user nova-compute[74850]:     </nova:instance>
Nov 14 01:01:09 user nova-compute[74850]:   </metadata>
Nov 14 01:01:09 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 01:01:09 user nova-compute[74850]:     <system>
Nov 14 01:01:09 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 01:01:09 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 01:01:09 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 01:01:09 user nova-compute[74850]:       <entry name="serial">782a85d0-b427-4ee2-8d6c-778602f00bcd</entry>
Nov 14 01:01:09 user nova-compute[74850]:       <entry name="uuid">782a85d0-b427-4ee2-8d6c-778602f00bcd</entry>
Nov 14 01:01:09 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 01:01:09 user nova-compute[74850]:     </system>
Nov 14 01:01:09 user nova-compute[74850]:   </sysinfo>
Nov 14 01:01:09 user nova-compute[74850]:   <os>
Nov 14 01:01:09 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 01:01:09 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 01:01:09 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 01:01:09 user nova-compute[74850]:   </os>
Nov 14 01:01:09 user nova-compute[74850]:   <features>
Nov 14 01:01:09 user nova-compute[74850]:     <acpi/>
Nov 14 01:01:09 user nova-compute[74850]:     <apic/>
Nov 14 01:01:09 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 01:01:09 user nova-compute[74850]:   </features>
Nov 14 01:01:09 user nova-compute[74850]:   <clock offset="utc">
Nov 14 01:01:09 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 01:01:09 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 01:01:09 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 01:01:09 user nova-compute[74850]:   </clock>
Nov 14 01:01:09 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 01:01:09 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 01:01:09 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 01:01:09 user nova-compute[74850]:   </cpu>
Nov 14 01:01:09 user nova-compute[74850]:   <devices>
Nov 14 01:01:09 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 01:01:09 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 01:01:09 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk"/>
Nov 14 01:01:09 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 01:01:09 user nova-compute[74850]:     </disk>
Nov 14 01:01:09 user nova-compute[74850]:     <disk type="block" device="disk">
Nov 14 01:01:09 user nova-compute[74850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:01:09 user nova-compute[74850]:       <source dev="/dev/sdb"/>
Nov 14 01:01:09 user nova-compute[74850]:       <target dev="vdb" bus="virtio"/>
Nov 14 01:01:09 user nova-compute[74850]:       <serial>40c8987b-4ae1-4338-b6da-3d4612c015e1</serial>
Nov 14 01:01:09 user nova-compute[74850]:     </disk>
Nov 14 01:01:09 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 01:01:09 user nova-compute[74850]:       <mac address="fa:16:3e:70:96:bf"/>
Nov 14 01:01:09 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:01:09 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 01:01:09 user nova-compute[74850]:       <target dev="tapb4744a9e-48"/>
Nov 14 01:01:09 user nova-compute[74850]:     </interface>
Nov 14 01:01:09 user nova-compute[74850]:     <serial type="pty">
Nov 14 01:01:09 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/console.log" append="off"/>
Nov 14 01:01:09 user nova-compute[74850]:     </serial>
Nov 14 01:01:09 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 01:01:09 user nova-compute[74850]:     <video>
Nov 14 01:01:09 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:01:09 user nova-compute[74850]:     </video>
Nov 14 01:01:09 user nova-compute[74850]:     <rng model="virtio">
Nov 14 01:01:09 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 01:01:09 user nova-compute[74850]:     </rng>
Nov 14 01:01:09 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 01:01:09 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 01:01:09 user nova-compute[74850]:       <stats period="10"/>
Nov 14 01:01:09 user nova-compute[74850]:     </memballoon>
Nov 14 01:01:09 user nova-compute[74850]:   </devices>
Nov 14 01:01:09 user nova-compute[74850]: </domain>
Nov 14 01:01:09 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 01:01:09 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6f7f6aaf-97f0-41e7-b738-b6b80cd08868 req-4d737a99-dd64-4f03-bead-74b21c46be99 service nova] Releasing lock "refresh_cache-7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:01:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-90be87df-0551-4b2d-83a9-caa495f078ea tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.032s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:01:09 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:09 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:09 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:01:09 user nova-compute[74850]: DEBUG nova.objects.instance [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lazy-loading 'trusted_certs' on Instance uuid 782a85d0-b427-4ee2-8d6c-778602f00bcd {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:01:09 user nova-compute[74850]: DEBUG nova.objects.base [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Object Instance<782a85d0-b427-4ee2-8d6c-778602f00bcd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 01:01:09 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "6f0cb80d-dfec-4278-81ff-0e292bad880a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "6f0cb80d-dfec-4278-81ff-0e292bad880a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.195s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Checking if we can resize image /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG nova.compute.manager [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 01:01:10 user nova-compute[74850]: INFO nova.compute.claims [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Claim successful on node user
Nov 14 01:01:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Cannot resize image /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG nova.objects.instance [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lazy-loading 'migration_context' on Instance uuid 782a85d0-b427-4ee2-8d6c-778602f00bcd {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG nova.objects.base [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Object Instance<782a85d0-b427-4ee2-8d6c-778602f00bcd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:57:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-931477227',display_name='tempest-AttachVolumeTestJSON-server-931477227',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-931477227',id=30,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqGPtaAqtRvdnzrU67gWLSZdIWQoykWaBYabKPElkLS5sz5jLsrZV0zgILMNEA+Yd/7TrkBFbU+t9G+drRSGt2wGNzDluZHtIgMdrMvm4dKLEvsHluVt5xKssaIW0AwAg==',key_name='tempest-keypair-1840551366',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:57:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='0c3e629e632d444faf3898681aaafa79',ramdisk_id='',reservation_id='r-iuno8cu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1639440895',owner_user_name='tempest-AttachVolumeTestJSON-1639440895-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:59:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b677f8f7b06431cbeac4cbdfa2dcbf5',uuid=782a85d0-b427-4ee2-8d6c-778602f00bcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "address": "fa:16:3e:70:96:bf", "network": {"id": "75650b3d-1169-46fa-a1cf-7ae51dd28e18", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227679489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3e629e632d444faf3898681aaafa79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744a9e-48", "ovs_interfaceid": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Converting VIF {"id": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "address": "fa:16:3e:70:96:bf", "network": {"id": "75650b3d-1169-46fa-a1cf-7ae51dd28e18", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227679489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3e629e632d444faf3898681aaafa79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744a9e-48", "ovs_interfaceid": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:96:bf,bridge_name='br-int',has_traffic_filtering=True,id=b4744a9e-4848-49b9-9f58-7d29e0ecb9c7,network=Network(75650b3d-1169-46fa-a1cf-7ae51dd28e18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4744a9e-48') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG os_vif [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:96:bf,bridge_name='br-int',has_traffic_filtering=True,id=b4744a9e-4848-49b9-9f58-7d29e0ecb9c7,network=Network(75650b3d-1169-46fa-a1cf-7ae51dd28e18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4744a9e-48') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cd61ce09-cb12-585b-b714-5c8b7381bd2b', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4744a9e-48, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb4744a9e-48, col_values=(('qos', UUID('704d1741-10d2-41be-98d7-f3c791000117')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb4744a9e-48, col_values=(('external_ids', {'iface-id': 'b4744a9e-4848-49b9-9f58-7d29e0ecb9c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:96:bf', 'vm-uuid': '782a85d0-b427-4ee2-8d6c-778602f00bcd'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:10 user nova-compute[74850]: INFO os_vif [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:96:bf,bridge_name='br-int',has_traffic_filtering=True,id=b4744a9e-4848-49b9-9f58-7d29e0ecb9c7,network=Network(75650b3d-1169-46fa-a1cf-7ae51dd28e18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4744a9e-48')
Nov 14 01:01:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.409s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG nova.compute.manager [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG nova.compute.manager [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG nova.network.neutron [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 01:01:10 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 01:01:10 user nova-compute[74850]: DEBUG nova.compute.manager [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG nova.policy [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dab7bcadfc32457e8bfa6fa81cba2702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d09cd8d15a4b058988fa348d7fdc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 01:01:10 user nova-compute[74850]: INFO nova.virt.block_device [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Booting with volume 0061b40f-c802-454f-b38b-b74cc014fc2d at /dev/vda
Nov 14 01:01:10 user nova-compute[74850]: DEBUG os_brick.utils [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a62a9f9-7fcf-4ff3-8f5d-0d7ceb4f54c3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a68f0f-d179-4c67-8758-1365f53e126a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89c944e-ab7a-493f-a68a-fc1fecd6e1a5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[878c73b7-fd05-4066-b729-3e025948a37e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:01:10 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 01:01:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6a2be4-fb33-4941-9452-f74941c1e6cc]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 01:01:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 01:01:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 01:01:11 user nova-compute[74850]: DEBUG os_brick.utils [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:01:11 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Updating existing volume attachment record: 1ce01e1d-7fed-4e21-b7fd-e8295cd800c5 {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 01:01:11 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:01:11 user nova-compute[74850]: DEBUG nova.network.neutron [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Successfully created port: 430fc00c-2c5c-4139-8344-47c701006287 {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 01:01:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:11 user nova-compute[74850]: DEBUG nova.compute.manager [req-01d2f652-75af-457c-b1ee-8e5227ae7bb0 req-08ea2ba1-bffb-48ed-820f-d95b0174ce78 service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Received event network-vif-plugged-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:01:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-01d2f652-75af-457c-b1ee-8e5227ae7bb0 req-08ea2ba1-bffb-48ed-820f-d95b0174ce78 service nova] Acquiring lock "782a85d0-b427-4ee2-8d6c-778602f00bcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:01:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-01d2f652-75af-457c-b1ee-8e5227ae7bb0 req-08ea2ba1-bffb-48ed-820f-d95b0174ce78 service nova] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:01:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-01d2f652-75af-457c-b1ee-8e5227ae7bb0 req-08ea2ba1-bffb-48ed-820f-d95b0174ce78 service nova] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:01:11 user nova-compute[74850]: DEBUG nova.compute.manager [req-01d2f652-75af-457c-b1ee-8e5227ae7bb0 req-08ea2ba1-bffb-48ed-820f-d95b0174ce78 service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] No waiting events found dispatching network-vif-plugged-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:01:11 user nova-compute[74850]: WARNING nova.compute.manager [req-01d2f652-75af-457c-b1ee-8e5227ae7bb0 req-08ea2ba1-bffb-48ed-820f-d95b0174ce78 service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Received unexpected event network-vif-plugged-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 for instance with vm_state stopped and task_state powering-on.
Nov 14 01:01:12 user nova-compute[74850]: DEBUG nova.network.neutron [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Successfully updated port: 430fc00c-2c5c-4139-8344-47c701006287 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "refresh_cache-6f0cb80d-dfec-4278-81ff-0e292bad880a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquired lock "refresh_cache-6f0cb80d-dfec-4278-81ff-0e292bad880a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG nova.network.neutron [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 01:01:12 user nova-compute[74850]: WARNING nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] While synchronizing instance power states, found 9 instances in the database and 8 instances on the hypervisor.
Nov 14 01:01:12 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Triggering sync for uuid a70d0196-f90e-47c4-be67-bf7ef4c3d8c4 {{(pid=74850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Triggering sync for uuid 748d0da7-bbb9-4e86-aae3-e48b1fa04c14 {{(pid=74850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Triggering sync for uuid c7952bff-87d6-46c1-a6d4-7729dc4893ff {{(pid=74850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Triggering sync for uuid 702746f7-305f-4eac-a71a-6c08b7cbccd8 {{(pid=74850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Triggering sync for uuid 782a85d0-b427-4ee2-8d6c-778602f00bcd {{(pid=74850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Triggering sync for uuid 2749d176-9c59-493e-b3c3-af5980329041 {{(pid=74850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Triggering sync for uuid 603a931e-3bde-4a7f-b3d7-0993ab535e4c {{(pid=74850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Triggering sync for uuid f34cc4c3-1c5d-46d7-92ea-571cb8458b96 {{(pid=74850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Triggering sync for uuid 6f0cb80d-dfec-4278-81ff-0e292bad880a {{(pid=74850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "748d0da7-bbb9-4e86-aae3-e48b1fa04c14" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "748d0da7-bbb9-4e86-aae3-e48b1fa04c14" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "c7952bff-87d6-46c1-a6d4-7729dc4893ff" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "c7952bff-87d6-46c1-a6d4-7729dc4893ff" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "702746f7-305f-4eac-a71a-6c08b7cbccd8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "702746f7-305f-4eac-a71a-6c08b7cbccd8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "782a85d0-b427-4ee2-8d6c-778602f00bcd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:01:12 user nova-compute[74850]: INFO nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] During sync_power_state the instance has a pending task (powering-on). Skip.
Nov 14 01:01:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "2749d176-9c59-493e-b3c3-af5980329041" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "2749d176-9c59-493e-b3c3-af5980329041" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "603a931e-3bde-4a7f-b3d7-0993ab535e4c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "603a931e-3bde-4a7f-b3d7-0993ab535e4c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "f34cc4c3-1c5d-46d7-92ea-571cb8458b96" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "f34cc4c3-1c5d-46d7-92ea-571cb8458b96" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "6f0cb80d-dfec-4278-81ff-0e292bad880a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "748d0da7-bbb9-4e86-aae3-e48b1fa04c14" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "702746f7-305f-4eac-a71a-6c08b7cbccd8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "603a931e-3bde-4a7f-b3d7-0993ab535e4c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG nova.network.neutron [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "2749d176-9c59-493e-b3c3-af5980329041" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "f34cc4c3-1c5d-46d7-92ea-571cb8458b96" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG nova.compute.manager [req-5a988e23-b159-432e-aee7-be78c4518065 req-deee5aea-098f-4f3a-994b-f6c81b520e25 service nova] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Received event network-changed-430fc00c-2c5c-4139-8344-47c701006287 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG nova.compute.manager [req-5a988e23-b159-432e-aee7-be78c4518065 req-deee5aea-098f-4f3a-994b-f6c81b520e25 service nova] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Refreshing instance network info cache due to event network-changed-430fc00c-2c5c-4139-8344-47c701006287. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5a988e23-b159-432e-aee7-be78c4518065 req-deee5aea-098f-4f3a-994b-f6c81b520e25 service nova] Acquiring lock "refresh_cache-6f0cb80d-dfec-4278-81ff-0e292bad880a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "c7952bff-87d6-46c1-a6d4-7729dc4893ff" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG nova.network.neutron [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Updating instance_info_cache with network_info: [{"id": "430fc00c-2c5c-4139-8344-47c701006287", "address": "fa:16:3e:ff:f2:a3", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap430fc00c-2c", "ovs_interfaceid": "430fc00c-2c5c-4139-8344-47c701006287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Releasing lock "refresh_cache-6f0cb80d-dfec-4278-81ff-0e292bad880a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG nova.compute.manager [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Instance network_info: |[{"id": "430fc00c-2c5c-4139-8344-47c701006287", "address": "fa:16:3e:ff:f2:a3", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap430fc00c-2c", "ovs_interfaceid": "430fc00c-2c5c-4139-8344-47c701006287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5a988e23-b159-432e-aee7-be78c4518065 req-deee5aea-098f-4f3a-994b-f6c81b520e25 service nova] Acquired lock "refresh_cache-6f0cb80d-dfec-4278-81ff-0e292bad880a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG nova.network.neutron [req-5a988e23-b159-432e-aee7-be78c4518065 req-deee5aea-098f-4f3a-994b-f6c81b520e25 service nova] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Refreshing network info cache for port 430fc00c-2c5c-4139-8344-47c701006287 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG nova.network.neutron [req-5a988e23-b159-432e-aee7-be78c4518065 req-deee5aea-098f-4f3a-994b-f6c81b520e25 service nova] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Updated VIF entry in instance network info cache for port 430fc00c-2c5c-4139-8344-47c701006287. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG nova.network.neutron [req-5a988e23-b159-432e-aee7-be78c4518065 req-deee5aea-098f-4f3a-994b-f6c81b520e25 service nova] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Updating instance_info_cache with network_info: [{"id": "430fc00c-2c5c-4139-8344-47c701006287", "address": "fa:16:3e:ff:f2:a3", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap430fc00c-2c", "ovs_interfaceid": "430fc00c-2c5c-4139-8344-47c701006287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:01:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5a988e23-b159-432e-aee7-be78c4518065 req-deee5aea-098f-4f3a-994b-f6c81b520e25 service nova] Releasing lock "refresh_cache-6f0cb80d-dfec-4278-81ff-0e292bad880a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:01:13 user nova-compute[74850]: DEBUG nova.compute.manager [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 01:01:13 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Instance rebooted successfully.
Nov 14 01:01:13 user nova-compute[74850]: DEBUG nova.compute.manager [None req-f3c7af9c-f92d-4719-8ec9-849033729bd5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 01:01:14 user nova-compute[74850]: DEBUG nova.compute.manager [req-f05f19ab-62bd-402b-9b15-7f3c91e927f6 req-8d9c8552-4e17-4da9-81b7-41377754a0d6 service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Received event network-vif-plugged-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:01:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f05f19ab-62bd-402b-9b15-7f3c91e927f6 req-8d9c8552-4e17-4da9-81b7-41377754a0d6 service nova] Acquiring lock "782a85d0-b427-4ee2-8d6c-778602f00bcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:01:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f05f19ab-62bd-402b-9b15-7f3c91e927f6 req-8d9c8552-4e17-4da9-81b7-41377754a0d6 service nova] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:01:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f05f19ab-62bd-402b-9b15-7f3c91e927f6 req-8d9c8552-4e17-4da9-81b7-41377754a0d6 service nova] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:01:14 user nova-compute[74850]: DEBUG nova.compute.manager [req-f05f19ab-62bd-402b-9b15-7f3c91e927f6 req-8d9c8552-4e17-4da9-81b7-41377754a0d6 service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] No waiting events found dispatching network-vif-plugged-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:01:14 user nova-compute[74850]: WARNING nova.compute.manager [req-f05f19ab-62bd-402b-9b15-7f3c91e927f6 req-8d9c8552-4e17-4da9-81b7-41377754a0d6 service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Received unexpected event network-vif-plugged-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 for instance with vm_state active and task_state None.
Nov 14 01:01:15 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG nova.compute.manager [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 01:01:15 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Creating image(s)
Nov 14 01:01:15 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Did not create local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Ensure instance console log exists: /opt/stack/data/nova/instances/6f0cb80d-dfec-4278-81ff-0e292bad880a/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Start _get_guest_xml network_info=[{"id": "430fc00c-2c5c-4139-8344-47c701006287", "address": "fa:16:3e:ff:f2:a3", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap430fc00c-2c", "ovs_interfaceid": "430fc00c-2c5c-4139-8344-47c701006287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '1ce01e1d-7fed-4e21-b7fd-e8295cd800c5', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IPjahxlF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6f0cb80d-dfec-4278-81ff-0e292bad880a', 'attached_at': '', 'detached_at': '', 'volume_id': '0061b40f-c802-454f-b38b-b74cc014fc2d', 'serial': '0061b40f-c802-454f-b38b-b74cc014fc2d'}, 'volume_type': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 01:01:15 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:01:15 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:01:15 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IPjahxlF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:01:15 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:01:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:01:15 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:01:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:01:15 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 01:01:15 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9233380-3a79-43d7-b098-950fc15150d7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 01:01:15 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[43bbef21-ec69-4592-9996-c423a27ef9aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d] added
Nov 14 01:01:15 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cc4e6e-a461-45bc-816b-59e4041df156]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92703d9-fe53-4533-99cb-cfa505593e89]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IPjahxlF {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IPjahxlF" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b428c2-dbfd-4969-962c-f370cb92576d]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IPjahxlF'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16beb0e-f5d3-4c9b-a02c-01181c8aa68c]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11ac105-265b-42af-98c7-c43251b38437]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:01:15 user nova-compute[74850]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 (non-flash)
Nov 14 01:01:15 user nova-compute[74850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)
Nov 14 01:01:15 user nova-compute[74850]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)
Nov 14 01:01:15 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:01:15 user nova-compute[74850]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 (non-flash)
Nov 14 01:01:15 user nova-compute[74850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)
Nov 14 01:01:15 user nova-compute[74850]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)
Nov 14 01:01:15 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd5cb76-6aef-4bbe-b7b7-4f7552eb4bf5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d, portal: 172.16.0.220,3260]
Nov 14 01:01:15 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d, portal: 172.16.0.220,3260] successful.
Nov 14 01:01:15 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae2ef8e-1c80-4159-b9a4-08e1015736e3]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[445b009e-0689-454b-a071-59f186ac697b]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:01:15 user nova-compute[74850]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 (non-flash)
Nov 14 01:01:15 user nova-compute[74850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)
Nov 14 01:01:15 user nova-compute[74850]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)
Nov 14 01:01:15 user nova-compute[74850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:01:15 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:01:15 user nova-compute[74850]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 (non-flash)
Nov 14 01:01:15 user nova-compute[74850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)
Nov 14 01:01:15 user nova-compute[74850]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)
Nov 14 01:01:15 user nova-compute[74850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:01:15 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db3585c-ac35-457e-9567-b85f7f4868ce]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:01:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IPjahxlF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 01:01:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:01:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26635313330396361', 'path': '/dev/sde'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:01:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635313330396361', 'path': '/dev/sde'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 01:01:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:01:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-314685057',display_name='tempest-ServerActionsTestOtherA-server-314685057',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-314685057',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEDBs7Es/72p/FM9xIVe3NSPFzUvxLUb0JwmaT04oo+hgQgHwN4cwLNmRX2VhLFhce2UGzsRv1c1pV/ZeRW8oCrRJ/Tmr/k2YN/XTGeAv4iUUyvZpvQioCuIlgWRqA+LA==',key_name='tempest-keypair-638803187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67d09cd8d15a4b058988fa348d7fdc2e',ramdisk_id='',reservation_id='r-n0nc986k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1680693726',owner_user_name='tempest-ServerActionsTestOtherA-1680693726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:01:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dab7bcadfc32457e8bfa6fa81cba2702',uuid=6f0cb80d-dfec-4278-81ff-0e292bad880a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "430fc00c-2c5c-4139-8344-47c701006287", "address": "fa:16:3e:ff:f2:a3", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap430fc00c-2c", "ovs_interfaceid": "430fc00c-2c5c-4139-8344-47c701006287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 01:01:16 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Converting VIF {"id": "430fc00c-2c5c-4139-8344-47c701006287", "address": "fa:16:3e:ff:f2:a3", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap430fc00c-2c", "ovs_interfaceid": "430fc00c-2c5c-4139-8344-47c701006287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:01:16 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:f2:a3,bridge_name='br-int',has_traffic_filtering=True,id=430fc00c-2c5c-4139-8344-47c701006287,network=Network(6e563565-dc0c-4f19-9030-742bf28811d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap430fc00c-2c') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:01:16 user nova-compute[74850]: DEBUG nova.objects.instance [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f0cb80d-dfec-4278-81ff-0e292bad880a {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:01:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 01:01:16 user nova-compute[74850]:   <uuid>6f0cb80d-dfec-4278-81ff-0e292bad880a</uuid>
Nov 14 01:01:16 user nova-compute[74850]:   <name>instance-00000023</name>
Nov 14 01:01:16 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 01:01:16 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 01:01:16 user nova-compute[74850]:   <metadata>
Nov 14 01:01:16 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 01:01:16 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 01:01:16 user nova-compute[74850]:       <nova:name>tempest-ServerActionsTestOtherA-server-314685057</nova:name>
Nov 14 01:01:16 user nova-compute[74850]:       <nova:creationTime>2023-11-14 01:01:15</nova:creationTime>
Nov 14 01:01:16 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 01:01:16 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 01:01:16 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 01:01:16 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 01:01:16 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 01:01:16 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 01:01:16 user nova-compute[74850]:       </nova:flavor>
Nov 14 01:01:16 user nova-compute[74850]:       <nova:owner>
Nov 14 01:01:16 user nova-compute[74850]:         <nova:user uuid="dab7bcadfc32457e8bfa6fa81cba2702">tempest-ServerActionsTestOtherA-1680693726-project-member</nova:user>
Nov 14 01:01:16 user nova-compute[74850]:         <nova:project uuid="67d09cd8d15a4b058988fa348d7fdc2e">tempest-ServerActionsTestOtherA-1680693726</nova:project>
Nov 14 01:01:16 user nova-compute[74850]:       </nova:owner>
Nov 14 01:01:16 user nova-compute[74850]:       <nova:ports>
Nov 14 01:01:16 user nova-compute[74850]:         <nova:port uuid="430fc00c-2c5c-4139-8344-47c701006287">
Nov 14 01:01:16 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 01:01:16 user nova-compute[74850]:         </nova:port>
Nov 14 01:01:16 user nova-compute[74850]:       </nova:ports>
Nov 14 01:01:16 user nova-compute[74850]:     </nova:instance>
Nov 14 01:01:16 user nova-compute[74850]:   </metadata>
Nov 14 01:01:16 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 01:01:16 user nova-compute[74850]:     <system>
Nov 14 01:01:16 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 01:01:16 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 01:01:16 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 01:01:16 user nova-compute[74850]:       <entry name="serial">6f0cb80d-dfec-4278-81ff-0e292bad880a</entry>
Nov 14 01:01:16 user nova-compute[74850]:       <entry name="uuid">6f0cb80d-dfec-4278-81ff-0e292bad880a</entry>
Nov 14 01:01:16 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 01:01:16 user nova-compute[74850]:     </system>
Nov 14 01:01:16 user nova-compute[74850]:   </sysinfo>
Nov 14 01:01:16 user nova-compute[74850]:   <os>
Nov 14 01:01:16 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 01:01:16 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 01:01:16 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 01:01:16 user nova-compute[74850]:   </os>
Nov 14 01:01:16 user nova-compute[74850]:   <features>
Nov 14 01:01:16 user nova-compute[74850]:     <acpi/>
Nov 14 01:01:16 user nova-compute[74850]:     <apic/>
Nov 14 01:01:16 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 01:01:16 user nova-compute[74850]:   </features>
Nov 14 01:01:16 user nova-compute[74850]:   <clock offset="utc">
Nov 14 01:01:16 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 01:01:16 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 01:01:16 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 01:01:16 user nova-compute[74850]:   </clock>
Nov 14 01:01:16 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 01:01:16 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 01:01:16 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 01:01:16 user nova-compute[74850]:   </cpu>
Nov 14 01:01:16 user nova-compute[74850]:   <devices>
Nov 14 01:01:16 user nova-compute[74850]:     <disk type="block" device="disk">
Nov 14 01:01:16 user nova-compute[74850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:01:16 user nova-compute[74850]:       <source dev="/dev/sde"/>
Nov 14 01:01:16 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 01:01:16 user nova-compute[74850]:       <serial>0061b40f-c802-454f-b38b-b74cc014fc2d</serial>
Nov 14 01:01:16 user nova-compute[74850]:     </disk>
Nov 14 01:01:16 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 01:01:16 user nova-compute[74850]:       <mac address="fa:16:3e:ff:f2:a3"/>
Nov 14 01:01:16 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:01:16 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 01:01:16 user nova-compute[74850]:       <target dev="tap430fc00c-2c"/>
Nov 14 01:01:16 user nova-compute[74850]:     </interface>
Nov 14 01:01:16 user nova-compute[74850]:     <serial type="pty">
Nov 14 01:01:16 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/6f0cb80d-dfec-4278-81ff-0e292bad880a/console.log" append="off"/>
Nov 14 01:01:16 user nova-compute[74850]:     </serial>
Nov 14 01:01:16 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 01:01:16 user nova-compute[74850]:     <video>
Nov 14 01:01:16 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:01:16 user nova-compute[74850]:     </video>
Nov 14 01:01:16 user nova-compute[74850]:     <rng model="virtio">
Nov 14 01:01:16 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 01:01:16 user nova-compute[74850]:     </rng>
Nov 14 01:01:16 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 01:01:16 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 01:01:16 user nova-compute[74850]:       <stats period="10"/>
Nov 14 01:01:16 user nova-compute[74850]:     </memballoon>
Nov 14 01:01:16 user nova-compute[74850]:   </devices>
Nov 14 01:01:16 user nova-compute[74850]: </domain>
Nov 14 01:01:16 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 01:01:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:01:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-314685057',display_name='tempest-ServerActionsTestOtherA-server-314685057',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-314685057',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEDBs7Es/72p/FM9xIVe3NSPFzUvxLUb0JwmaT04oo+hgQgHwN4cwLNmRX2VhLFhce2UGzsRv1c1pV/ZeRW8oCrRJ/Tmr/k2YN/XTGeAv4iUUyvZpvQioCuIlgWRqA+LA==',key_name='tempest-keypair-638803187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67d09cd8d15a4b058988fa348d7fdc2e',ramdisk_id='',reservation_id='r-n0nc986k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1680693726',owner_user_name='tempest-ServerActionsTestOtherA-1680693726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:01:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dab7bcadfc32457e8bfa6fa81cba2702',uuid=6f0cb80d-dfec-4278-81ff-0e292bad880a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "430fc00c-2c5c-4139-8344-47c701006287", "address": "fa:16:3e:ff:f2:a3", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap430fc00c-2c", "ovs_interfaceid": "430fc00c-2c5c-4139-8344-47c701006287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 01:01:16 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Converting VIF {"id": "430fc00c-2c5c-4139-8344-47c701006287", "address": "fa:16:3e:ff:f2:a3", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap430fc00c-2c", "ovs_interfaceid": "430fc00c-2c5c-4139-8344-47c701006287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:01:16 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:f2:a3,bridge_name='br-int',has_traffic_filtering=True,id=430fc00c-2c5c-4139-8344-47c701006287,network=Network(6e563565-dc0c-4f19-9030-742bf28811d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap430fc00c-2c') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:01:16 user nova-compute[74850]: DEBUG os_vif [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:f2:a3,bridge_name='br-int',has_traffic_filtering=True,id=430fc00c-2c5c-4139-8344-47c701006287,network=Network(6e563565-dc0c-4f19-9030-742bf28811d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap430fc00c-2c') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 01:01:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:01:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 01:01:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '84373182-1d4f-5d9e-8a48-adff3c2bef95', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:01:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:01:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap430fc00c-2c, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:01:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap430fc00c-2c, col_values=(('qos', UUID('2dd7f27b-09c3-4db0-9bfe-8d3fd50112a0')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:01:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap430fc00c-2c, col_values=(('external_ids', {'iface-id': '430fc00c-2c5c-4139-8344-47c701006287', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:f2:a3', 'vm-uuid': '6f0cb80d-dfec-4278-81ff-0e292bad880a'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:01:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:01:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:16 user nova-compute[74850]: INFO os_vif [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:f2:a3,bridge_name='br-int',has_traffic_filtering=True,id=430fc00c-2c5c-4139-8344-47c701006287,network=Network(6e563565-dc0c-4f19-9030-742bf28811d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap430fc00c-2c')
Nov 14 01:01:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:01:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] No VIF found with MAC fa:16:3e:ff:f2:a3, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:01:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:18 user nova-compute[74850]: DEBUG nova.compute.manager [req-1f020698-c31b-4fb2-9650-13b94666e3b3 req-2726be64-62fe-4def-96f5-f9a32d84eeec service nova] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Received event network-vif-plugged-430fc00c-2c5c-4139-8344-47c701006287 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:01:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-1f020698-c31b-4fb2-9650-13b94666e3b3 req-2726be64-62fe-4def-96f5-f9a32d84eeec service nova] Acquiring lock "6f0cb80d-dfec-4278-81ff-0e292bad880a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:01:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-1f020698-c31b-4fb2-9650-13b94666e3b3 req-2726be64-62fe-4def-96f5-f9a32d84eeec service nova] Lock "6f0cb80d-dfec-4278-81ff-0e292bad880a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:01:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-1f020698-c31b-4fb2-9650-13b94666e3b3 req-2726be64-62fe-4def-96f5-f9a32d84eeec service nova] Lock "6f0cb80d-dfec-4278-81ff-0e292bad880a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:01:18 user nova-compute[74850]: DEBUG nova.compute.manager [req-1f020698-c31b-4fb2-9650-13b94666e3b3 req-2726be64-62fe-4def-96f5-f9a32d84eeec service nova] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] No waiting events found dispatching network-vif-plugged-430fc00c-2c5c-4139-8344-47c701006287 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:01:18 user nova-compute[74850]: WARNING nova.compute.manager [req-1f020698-c31b-4fb2-9650-13b94666e3b3 req-2726be64-62fe-4def-96f5-f9a32d84eeec service nova] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Received unexpected event network-vif-plugged-430fc00c-2c5c-4139-8344-47c701006287 for instance with vm_state building and task_state spawning.
Nov 14 01:01:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:20 user nova-compute[74850]: DEBUG nova.compute.manager [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 01:01:20 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 01:01:20 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Instance spawned successfully.
Nov 14 01:01:20 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 01:01:20 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:01:20 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:01:20 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:01:20 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:01:20 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:01:20 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:01:20 user nova-compute[74850]: DEBUG nova.compute.manager [req-778eff8d-4eb2-4bf3-a561-bea1a47d2872 req-3495f930-9d52-4008-84d3-a60022276e1c service nova] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Received event network-vif-plugged-430fc00c-2c5c-4139-8344-47c701006287 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:01:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-778eff8d-4eb2-4bf3-a561-bea1a47d2872 req-3495f930-9d52-4008-84d3-a60022276e1c service nova] Acquiring lock "6f0cb80d-dfec-4278-81ff-0e292bad880a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:01:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-778eff8d-4eb2-4bf3-a561-bea1a47d2872 req-3495f930-9d52-4008-84d3-a60022276e1c service nova] Lock "6f0cb80d-dfec-4278-81ff-0e292bad880a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:01:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-778eff8d-4eb2-4bf3-a561-bea1a47d2872 req-3495f930-9d52-4008-84d3-a60022276e1c service nova] Lock "6f0cb80d-dfec-4278-81ff-0e292bad880a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:01:20 user nova-compute[74850]: DEBUG nova.compute.manager [req-778eff8d-4eb2-4bf3-a561-bea1a47d2872 req-3495f930-9d52-4008-84d3-a60022276e1c service nova] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] No waiting events found dispatching network-vif-plugged-430fc00c-2c5c-4139-8344-47c701006287 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:01:20 user nova-compute[74850]: WARNING nova.compute.manager [req-778eff8d-4eb2-4bf3-a561-bea1a47d2872 req-3495f930-9d52-4008-84d3-a60022276e1c service nova] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Received unexpected event network-vif-plugged-430fc00c-2c5c-4139-8344-47c701006287 for instance with vm_state building and task_state spawning.
Nov 14 01:01:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:20 user nova-compute[74850]: INFO nova.compute.manager [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Took 5.05 seconds to spawn the instance on the hypervisor.
Nov 14 01:01:20 user nova-compute[74850]: DEBUG nova.compute.manager [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 01:01:20 user nova-compute[74850]: INFO nova.compute.manager [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Took 10.42 seconds to build instance.
Nov 14 01:01:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-250c1e2c-c15d-4e44-8819-45111392b9d9 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "6f0cb80d-dfec-4278-81ff-0e292bad880a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.558s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:01:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "6f0cb80d-dfec-4278-81ff-0e292bad880a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 8.578s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:01:20 user nova-compute[74850]: INFO nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Nov 14 01:01:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "6f0cb80d-dfec-4278-81ff-0e292bad880a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:01:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:01:30 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ed0c75e2-8e59-44c7-8a14-5b2ab8803042 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:01:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ed0c75e2-8e59-44c7-8a14-5b2ab8803042 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:01:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ed0c75e2-8e59-44c7-8a14-5b2ab8803042 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:01:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ed0c75e2-8e59-44c7-8a14-5b2ab8803042 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:01:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ed0c75e2-8e59-44c7-8a14-5b2ab8803042 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:01:34 user nova-compute[74850]: INFO nova.compute.manager [None req-ed0c75e2-8e59-44c7-8a14-5b2ab8803042 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Terminating instance
Nov 14 01:01:34 user nova-compute[74850]: DEBUG nova.compute.manager [None req-ed0c75e2-8e59-44c7-8a14-5b2ab8803042 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 01:01:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:34 user nova-compute[74850]: DEBUG nova.compute.manager [req-fb09d6af-a001-4356-b535-3a89acfd98c3 req-3e2290f1-1ef3-48af-9bea-dec66039a565 service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Received event network-vif-unplugged-f0de03a3-fd19-4cd1-a408-5168dcf267d7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:01:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fb09d6af-a001-4356-b535-3a89acfd98c3 req-3e2290f1-1ef3-48af-9bea-dec66039a565 service nova] Acquiring lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:01:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fb09d6af-a001-4356-b535-3a89acfd98c3 req-3e2290f1-1ef3-48af-9bea-dec66039a565 service nova] Lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:01:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fb09d6af-a001-4356-b535-3a89acfd98c3 req-3e2290f1-1ef3-48af-9bea-dec66039a565 service nova] Lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:01:34 user nova-compute[74850]: DEBUG nova.compute.manager [req-fb09d6af-a001-4356-b535-3a89acfd98c3 req-3e2290f1-1ef3-48af-9bea-dec66039a565 service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] No waiting events found dispatching network-vif-unplugged-f0de03a3-fd19-4cd1-a408-5168dcf267d7 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:01:34 user nova-compute[74850]: DEBUG nova.compute.manager [req-fb09d6af-a001-4356-b535-3a89acfd98c3 req-3e2290f1-1ef3-48af-9bea-dec66039a565 service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Received event network-vif-unplugged-f0de03a3-fd19-4cd1-a408-5168dcf267d7 for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 01:01:34 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Instance destroyed successfully.
Nov 14 01:01:34 user nova-compute[74850]: DEBUG nova.objects.instance [None req-ed0c75e2-8e59-44c7-8a14-5b2ab8803042 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lazy-loading 'resources' on Instance uuid a70d0196-f90e-47c4-be67-bf7ef4c3d8c4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:01:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-ed0c75e2-8e59-44c7-8a14-5b2ab8803042 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:44:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1788047839',display_name='tempest-ServerRescueNegativeTestJSON-server-1788047839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1788047839',id=1,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:49:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e933e8bc63bd442d882ff59243bd7faa',ramdisk_id='',reservation_id='r-ex3095uo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-103787426',owner_user_name='tempest-ServerRescueNegativeTestJSON-103787426-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:51:27Z,user_data=None,user_id='84158c07e3344e01bf82e0e25e2a7244',uuid=a70d0196-f90e-47c4-be67-bf7ef4c3d8c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0de03a3-fd19-4cd1-a408-5168dcf267d7", "address": "fa:16:3e:44:d7:64", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0de03a3-fd", "ovs_interfaceid": "f0de03a3-fd19-4cd1-a408-5168dcf267d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 01:01:34 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-ed0c75e2-8e59-44c7-8a14-5b2ab8803042 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Converting VIF {"id": "f0de03a3-fd19-4cd1-a408-5168dcf267d7", "address": "fa:16:3e:44:d7:64", "network": {"id": "4bb9b9bb-4485-4fed-bf0e-f549b29f09da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-782172658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e933e8bc63bd442d882ff59243bd7faa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0de03a3-fd", "ovs_interfaceid": "f0de03a3-fd19-4cd1-a408-5168dcf267d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:01:34 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-ed0c75e2-8e59-44c7-8a14-5b2ab8803042 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:d7:64,bridge_name='br-int',has_traffic_filtering=True,id=f0de03a3-fd19-4cd1-a408-5168dcf267d7,network=Network(4bb9b9bb-4485-4fed-bf0e-f549b29f09da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0de03a3-fd') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:01:34 user nova-compute[74850]: DEBUG os_vif [None req-ed0c75e2-8e59-44c7-8a14-5b2ab8803042 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:d7:64,bridge_name='br-int',has_traffic_filtering=True,id=f0de03a3-fd19-4cd1-a408-5168dcf267d7,network=Network(4bb9b9bb-4485-4fed-bf0e-f549b29f09da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0de03a3-fd') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 01:01:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0de03a3-fd, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:01:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:01:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3eb51dcf-9360-42e7-b69a-6ecc3702eaaf) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:01:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:34 user nova-compute[74850]: INFO os_vif [None req-ed0c75e2-8e59-44c7-8a14-5b2ab8803042 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:d7:64,bridge_name='br-int',has_traffic_filtering=True,id=f0de03a3-fd19-4cd1-a408-5168dcf267d7,network=Network(4bb9b9bb-4485-4fed-bf0e-f549b29f09da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0de03a3-fd')
Nov 14 01:01:34 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-ed0c75e2-8e59-44c7-8a14-5b2ab8803042 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Deleting instance files /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4_del
Nov 14 01:01:34 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-ed0c75e2-8e59-44c7-8a14-5b2ab8803042 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Deletion of /opt/stack/data/nova/instances/a70d0196-f90e-47c4-be67-bf7ef4c3d8c4_del complete
Nov 14 01:01:34 user nova-compute[74850]: INFO nova.compute.manager [None req-ed0c75e2-8e59-44c7-8a14-5b2ab8803042 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 14 01:01:34 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-ed0c75e2-8e59-44c7-8a14-5b2ab8803042 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 01:01:34 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 01:01:34 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 01:01:35 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:01:35 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Took 0.43 seconds to deallocate network for instance.
Nov 14 01:01:35 user nova-compute[74850]: DEBUG nova.compute.manager [req-3a2888be-f78b-4527-b2e5-b77d13ac6591 req-7fad14ee-a2b5-4fc3-a23d-74fafb6e5c26 service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Received event network-vif-deleted-f0de03a3-fd19-4cd1-a408-5168dcf267d7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:01:35 user nova-compute[74850]: INFO nova.compute.manager [req-3a2888be-f78b-4527-b2e5-b77d13ac6591 req-7fad14ee-a2b5-4fc3-a23d-74fafb6e5c26 service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Neutron deleted interface f0de03a3-fd19-4cd1-a408-5168dcf267d7; detaching it from the instance and deleting it from the info cache
Nov 14 01:01:35 user nova-compute[74850]: DEBUG nova.network.neutron [req-3a2888be-f78b-4527-b2e5-b77d13ac6591 req-7fad14ee-a2b5-4fc3-a23d-74fafb6e5c26 service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:01:35 user nova-compute[74850]: DEBUG nova.compute.manager [req-3a2888be-f78b-4527-b2e5-b77d13ac6591 req-7fad14ee-a2b5-4fc3-a23d-74fafb6e5c26 service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Detach interface failed, port_id=f0de03a3-fd19-4cd1-a408-5168dcf267d7, reason: Instance a70d0196-f90e-47c4-be67-bf7ef4c3d8c4 could not be found. {{(pid=74850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 01:01:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ed0c75e2-8e59-44c7-8a14-5b2ab8803042 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:01:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ed0c75e2-8e59-44c7-8a14-5b2ab8803042 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:01:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:35 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-ed0c75e2-8e59-44c7-8a14-5b2ab8803042 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:01:35 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-ed0c75e2-8e59-44c7-8a14-5b2ab8803042 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:01:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ed0c75e2-8e59-44c7-8a14-5b2ab8803042 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.275s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:01:35 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-ed0c75e2-8e59-44c7-8a14-5b2ab8803042 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Deleted allocations for instance a70d0196-f90e-47c4-be67-bf7ef4c3d8c4
Nov 14 01:01:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ed0c75e2-8e59-44c7-8a14-5b2ab8803042 tempest-ServerRescueNegativeTestJSON-103787426 tempest-ServerRescueNegativeTestJSON-103787426-project-member] Lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.578s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:01:36 user nova-compute[74850]: DEBUG nova.compute.manager [req-4a5870b9-0b47-4b3a-8a60-26f36a4cc53c req-4de5d859-b062-49ac-9469-c0adbbdb3024 service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Received event network-vif-plugged-f0de03a3-fd19-4cd1-a408-5168dcf267d7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:01:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-4a5870b9-0b47-4b3a-8a60-26f36a4cc53c req-4de5d859-b062-49ac-9469-c0adbbdb3024 service nova] Acquiring lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:01:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-4a5870b9-0b47-4b3a-8a60-26f36a4cc53c req-4de5d859-b062-49ac-9469-c0adbbdb3024 service nova] Lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:01:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-4a5870b9-0b47-4b3a-8a60-26f36a4cc53c req-4de5d859-b062-49ac-9469-c0adbbdb3024 service nova] Lock "a70d0196-f90e-47c4-be67-bf7ef4c3d8c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:01:36 user nova-compute[74850]: DEBUG nova.compute.manager [req-4a5870b9-0b47-4b3a-8a60-26f36a4cc53c req-4de5d859-b062-49ac-9469-c0adbbdb3024 service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] No waiting events found dispatching network-vif-plugged-f0de03a3-fd19-4cd1-a408-5168dcf267d7 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:01:36 user nova-compute[74850]: WARNING nova.compute.manager [req-4a5870b9-0b47-4b3a-8a60-26f36a4cc53c req-4de5d859-b062-49ac-9469-c0adbbdb3024 service nova] [instance: a70d0196-f90e-47c4-be67-bf7ef4c3d8c4] Received unexpected event network-vif-plugged-f0de03a3-fd19-4cd1-a408-5168dcf267d7 for instance with vm_state deleted and task_state None.
Nov 14 01:01:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "603a931e-3bde-4a7f-b3d7-0993ab535e4c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:01:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "603a931e-3bde-4a7f-b3d7-0993ab535e4c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:01:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "603a931e-3bde-4a7f-b3d7-0993ab535e4c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:01:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "603a931e-3bde-4a7f-b3d7-0993ab535e4c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:01:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "603a931e-3bde-4a7f-b3d7-0993ab535e4c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:01:41 user nova-compute[74850]: INFO nova.compute.manager [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Terminating instance
Nov 14 01:01:41 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 01:01:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:41 user nova-compute[74850]: DEBUG nova.compute.manager [req-d80819cc-a388-49ff-a411-dd64a2f83b8d req-d5e61d3e-30bc-47cf-8a4a-f0cc73872b81 service nova] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Received event network-vif-unplugged-1fcd413f-b86c-4cc7-b741-b596ef83394e {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:01:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d80819cc-a388-49ff-a411-dd64a2f83b8d req-d5e61d3e-30bc-47cf-8a4a-f0cc73872b81 service nova] Acquiring lock "603a931e-3bde-4a7f-b3d7-0993ab535e4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:01:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d80819cc-a388-49ff-a411-dd64a2f83b8d req-d5e61d3e-30bc-47cf-8a4a-f0cc73872b81 service nova] Lock "603a931e-3bde-4a7f-b3d7-0993ab535e4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:01:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d80819cc-a388-49ff-a411-dd64a2f83b8d req-d5e61d3e-30bc-47cf-8a4a-f0cc73872b81 service nova] Lock "603a931e-3bde-4a7f-b3d7-0993ab535e4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:01:41 user nova-compute[74850]: DEBUG nova.compute.manager [req-d80819cc-a388-49ff-a411-dd64a2f83b8d req-d5e61d3e-30bc-47cf-8a4a-f0cc73872b81 service nova] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] No waiting events found dispatching network-vif-unplugged-1fcd413f-b86c-4cc7-b741-b596ef83394e {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:01:41 user nova-compute[74850]: DEBUG nova.compute.manager [req-d80819cc-a388-49ff-a411-dd64a2f83b8d req-d5e61d3e-30bc-47cf-8a4a-f0cc73872b81 service nova] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Received event network-vif-unplugged-1fcd413f-b86c-4cc7-b741-b596ef83394e for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 01:01:42 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Instance destroyed successfully.
Nov 14 01:01:42 user nova-compute[74850]: DEBUG nova.objects.instance [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lazy-loading 'resources' on Instance uuid 603a931e-3bde-4a7f-b3d7-0993ab535e4c {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1339112381',display_name='tempest-TestVolumeBootPattern-server-1339112381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1339112381',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T01:00:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fdb1eb4b5fc841d1952b8db9ae05e446',ramdisk_id='',reservation_id='r-u2ruc9od',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1536334624',owner_user_name='tempest-TestVolumeBootPattern-1536334624-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T01:00:07Z,user_data=None,user_id='6c91ddcee4e54a769eb626c816596bed',uuid=603a931e-3bde-4a7f-b3d7-0993ab535e4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1fcd413f-b86c-4cc7-b741-b596ef83394e", "address": "fa:16:3e:ef:54:e4", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fcd413f-b8", "ovs_interfaceid": "1fcd413f-b86c-4cc7-b741-b596ef83394e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Converting VIF {"id": "1fcd413f-b86c-4cc7-b741-b596ef83394e", "address": "fa:16:3e:ef:54:e4", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fcd413f-b8", "ovs_interfaceid": "1fcd413f-b86c-4cc7-b741-b596ef83394e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:54:e4,bridge_name='br-int',has_traffic_filtering=True,id=1fcd413f-b86c-4cc7-b741-b596ef83394e,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fcd413f-b8') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG os_vif [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:54:e4,bridge_name='br-int',has_traffic_filtering=True,id=1fcd413f-b86c-4cc7-b741-b596ef83394e,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fcd413f-b8') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1fcd413f-b8, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=09b4276f-4710-4662-9404-c5282cb3efa9) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:01:42 user nova-compute[74850]: INFO os_vif [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:54:e4,bridge_name='br-int',has_traffic_filtering=True,id=1fcd413f-b86c-4cc7-b741-b596ef83394e,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fcd413f-b8')
Nov 14 01:01:42 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLCnOYTg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:01:42 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:01:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11bd8ea-e30f-455c-8444-8c3c0536b676]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 01:01:42 user nova-compute[74850]: No targets found.
Nov 14 01:01:42 user nova-compute[74850]: iSNS:
Nov 14 01:01:42 user nova-compute[74850]: No targets found.
Nov 14 01:01:42 user nova-compute[74850]: STATIC:
Nov 14 01:01:42 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1
Nov 14 01:01:42 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:01:42 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:01:42 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d
Nov 14 01:01:42 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:01:42 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:01:42 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d
Nov 14 01:01:42 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:01:42 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:01:42 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739
Nov 14 01:01:42 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:01:42 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:01:42 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed
Nov 14 01:01:42 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:01:42 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:01:42 user nova-compute[74850]: FIRMWARE:
Nov 14 01:01:42 user nova-compute[74850]: No targets found.
Nov 14 01:01:42 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 01:01:42 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 01:01:42 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd943d7-30cd-4dfb-825b-31a99cd53bc0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[392f7f7c-264d-46b5-99cb-9a57e0553539]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:01:42 user nova-compute[74850]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 (non-flash)
Nov 14 01:01:42 user nova-compute[74850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)
Nov 14 01:01:42 user nova-compute[74850]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)
Nov 14 01:01:42 user nova-compute[74850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:01:42 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:01:42 user nova-compute[74850]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 (non-flash)
Nov 14 01:01:42 user nova-compute[74850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)
Nov 14 01:01:42 user nova-compute[74850]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)
Nov 14 01:01:42 user nova-compute[74850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:01:42 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a5fe570a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739'): ({'sdc'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Removing single pathed devices sdc {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8c1784-5e6e-4de4-9e18-a05057057f2f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6906326e-c10b-44ea-aaa2-7d6a2491ab21]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Flushing IO for device /dev/sdc {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9616262-66cf-4615-ad7c-e18d31387492]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc418b5-dcbe-4d4e-bcee-c3c20234c283]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] SCSI volumes sdc have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO55e80697-8048204dde05ad17', '/dev/disk/by-id/scsi-23830343832303464', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_55e80697') {{(pid=84948) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 01:01:42 user nova-compute[74850]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO55e80697-8048204dde05ad17
Nov 14 01:01:42 user nova-compute[74850]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23830343832303464
Nov 14 01:01:42 user nova-compute[74850]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_55e80697
Nov 14 01:01:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b334f845-1750-4cd3-9eaa-ae1ab803c458]: (4, None) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[78309361-15c7-4a54-9168-82f302c73ce0]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b273c4-0d86-41a0-b21c-1fdb3fccc243]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739, portal: 172.16.0.220,3260]
Nov 14 01:01:42 user nova-compute[74850]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739, portal: 172.16.0.220,3260] successful.
Nov 14 01:01:42 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61df958c-9f96-4dbd-8e9e-e338907d8739 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e44ac34-c029-4aa0-92b5-d5c5001cdf3d]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] <== disconnect_volume: return (353ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 01:01:42 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Deleting instance files /opt/stack/data/nova/instances/603a931e-3bde-4a7f-b3d7-0993ab535e4c_del
Nov 14 01:01:42 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Deletion of /opt/stack/data/nova/instances/603a931e-3bde-4a7f-b3d7-0993ab535e4c_del complete
Nov 14 01:01:42 user nova-compute[74850]: INFO nova.compute.manager [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 14 01:01:42 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 01:01:42 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 01:01:43 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:01:43 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Took 0.38 seconds to deallocate network for instance.
Nov 14 01:01:43 user nova-compute[74850]: DEBUG nova.compute.manager [req-74537c08-0f88-4141-bef4-d1cc4b1e4f50 req-1dca49bb-3142-4b17-a674-071c8d099f8c service nova] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Received event network-vif-plugged-1fcd413f-b86c-4cc7-b741-b596ef83394e {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:01:43 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-74537c08-0f88-4141-bef4-d1cc4b1e4f50 req-1dca49bb-3142-4b17-a674-071c8d099f8c service nova] Acquiring lock "603a931e-3bde-4a7f-b3d7-0993ab535e4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:01:43 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-74537c08-0f88-4141-bef4-d1cc4b1e4f50 req-1dca49bb-3142-4b17-a674-071c8d099f8c service nova] Lock "603a931e-3bde-4a7f-b3d7-0993ab535e4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:01:43 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-74537c08-0f88-4141-bef4-d1cc4b1e4f50 req-1dca49bb-3142-4b17-a674-071c8d099f8c service nova] Lock "603a931e-3bde-4a7f-b3d7-0993ab535e4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:01:43 user nova-compute[74850]: DEBUG nova.compute.manager [req-74537c08-0f88-4141-bef4-d1cc4b1e4f50 req-1dca49bb-3142-4b17-a674-071c8d099f8c service nova] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] No waiting events found dispatching network-vif-plugged-1fcd413f-b86c-4cc7-b741-b596ef83394e {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:01:43 user nova-compute[74850]: WARNING nova.compute.manager [req-74537c08-0f88-4141-bef4-d1cc4b1e4f50 req-1dca49bb-3142-4b17-a674-071c8d099f8c service nova] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Received unexpected event network-vif-plugged-1fcd413f-b86c-4cc7-b741-b596ef83394e for instance with vm_state active and task_state deleting.
Nov 14 01:01:43 user nova-compute[74850]: DEBUG nova.compute.manager [req-74537c08-0f88-4141-bef4-d1cc4b1e4f50 req-1dca49bb-3142-4b17-a674-071c8d099f8c service nova] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Received event network-vif-deleted-1fcd413f-b86c-4cc7-b741-b596ef83394e {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:01:43 user nova-compute[74850]: INFO nova.compute.manager [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Took 0.73 seconds to detach 1 volumes for instance.
Nov 14 01:01:43 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 603a931e-3bde-4a7f-b3d7-0993ab535e4c] Deleting volume: 61df958c-9f96-4dbd-8e9e-e338907d8739 {{(pid=74850) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 01:01:43 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:01:43 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:01:44 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:01:44 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:01:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.263s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:01:44 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Deleted allocations for instance 603a931e-3bde-4a7f-b3d7-0993ab535e4c
Nov 14 01:01:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4e4aae6c-e94c-43e9-84e0-0ded18e8e4bd tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "603a931e-3bde-4a7f-b3d7-0993ab535e4c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.824s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:01:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:50 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:01:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:01:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:01:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:01:50 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 01:01:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2749d176-9c59-493e-b3c3-af5980329041/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2749d176-9c59-493e-b3c3-af5980329041/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2749d176-9c59-493e-b3c3-af5980329041/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2749d176-9c59-493e-b3c3-af5980329041/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:01:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:01:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:01:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:01:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:01:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34cc4c3-1c5d-46d7-92ea-571cb8458b96/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34cc4c3-1c5d-46d7-92ea-571cb8458b96/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34cc4c3-1c5d-46d7-92ea-571cb8458b96/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:01:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34cc4c3-1c5d-46d7-92ea-571cb8458b96/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:01:53 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:01:53 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:01:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=8084MB free_disk=25.09805679321289GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 01:01:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:01:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:01:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 748d0da7-bbb9-4e86-aae3-e48b1fa04c14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:01:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance c7952bff-87d6-46c1-a6d4-7729dc4893ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:01:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 702746f7-305f-4eac-a71a-6c08b7cbccd8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:01:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 782a85d0-b427-4ee2-8d6c-778602f00bcd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:01:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 2749d176-9c59-493e-b3c3-af5980329041 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:01:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance f34cc4c3-1c5d-46d7-92ea-571cb8458b96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:01:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 6f0cb80d-dfec-4278-81ff-0e292bad880a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:01:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 01:01:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 01:01:53 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:01:53 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:01:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 01:01:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.361s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:01:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:01:57 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:01:57 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:01:58 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:01:58 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:01:58 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:01:59 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:02:00 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:02:00 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 01:02:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "refresh_cache-702746f7-305f-4eac-a71a-6c08b7cbccd8" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:02:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquired lock "refresh_cache-702746f7-305f-4eac-a71a-6c08b7cbccd8" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:02:01 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Forcefully refreshing network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 01:02:01 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Updating instance_info_cache with network_info: [{"id": "39232b36-eca6-4dac-880c-43aafa9f1719", "address": "fa:16:3e:ac:57:e7", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39232b36-ec", "ovs_interfaceid": "39232b36-eca6-4dac-880c-43aafa9f1719", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:02:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Releasing lock "refresh_cache-702746f7-305f-4eac-a71a-6c08b7cbccd8" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:02:01 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Updated the network info_cache for instance {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 01:02:01 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:02:01 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 01:02:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:02:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "3504ddd3-bdd8-465e-aec5-190acdd563f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:02:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "3504ddd3-bdd8-465e-aec5-190acdd563f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:02:05 user nova-compute[74850]: DEBUG nova.compute.manager [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 01:02:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:02:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:02:05 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 01:02:05 user nova-compute[74850]: INFO nova.compute.claims [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Claim successful on node user
Nov 14 01:02:05 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Refreshing inventories for resource provider fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 01:02:05 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Updating ProviderTree inventory for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 01:02:05 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Updating inventory in ProviderTree for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 01:02:05 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Refreshing aggregate associations for resource provider fe703abb-f68c-420d-a7f0-bf5240e23c54, aggregates: None {{(pid=74850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 01:02:05 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Refreshing trait associations for resource provider fe703abb-f68c-420d-a7f0-bf5240e23c54, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 01:02:05 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:02:05 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:02:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.489s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:02:05 user nova-compute[74850]: DEBUG nova.compute.manager [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 01:02:05 user nova-compute[74850]: DEBUG nova.compute.manager [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 01:02:05 user nova-compute[74850]: DEBUG nova.network.neutron [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 01:02:05 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 01:02:05 user nova-compute[74850]: DEBUG nova.compute.manager [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 01:02:06 user nova-compute[74850]: DEBUG nova.policy [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a5bb5d788a3b4871ae41f57d06f785f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491aa2a4f38140788cb0de9762a8baf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 01:02:06 user nova-compute[74850]: DEBUG nova.compute.manager [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 01:02:06 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 01:02:06 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Creating image(s)
Nov 14 01:02:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "/opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:02:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "/opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:02:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "/opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:02:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:02:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.172s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:02:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:02:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:02:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:02:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.181s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:02:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:02:06 user nova-compute[74850]: DEBUG nova.network.neutron [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Successfully created port: 8ac01677-8e6a-417b-b7a8-2fc5026404f9 {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 01:02:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk 1073741824" returned: 0 in 0.065s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:02:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:02:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:02:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.173s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:02:06 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 01:02:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:02:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:02:06 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Cannot resize image /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 01:02:06 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 01:02:06 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Ensure instance console log exists: /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 01:02:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:02:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:02:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG nova.network.neutron [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Successfully updated port: 8ac01677-8e6a-417b-b7a8-2fc5026404f9 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "refresh_cache-3504ddd3-bdd8-465e-aec5-190acdd563f6" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquired lock "refresh_cache-3504ddd3-bdd8-465e-aec5-190acdd563f6" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG nova.network.neutron [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG nova.compute.manager [req-f489ed13-61ca-4de4-be4e-1cd2a2e546d9 req-35edca2f-ea1b-41fe-b1c0-4dce82b8ba67 service nova] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Received event network-changed-8ac01677-8e6a-417b-b7a8-2fc5026404f9 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG nova.compute.manager [req-f489ed13-61ca-4de4-be4e-1cd2a2e546d9 req-35edca2f-ea1b-41fe-b1c0-4dce82b8ba67 service nova] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Refreshing instance network info cache due to event network-changed-8ac01677-8e6a-417b-b7a8-2fc5026404f9. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f489ed13-61ca-4de4-be4e-1cd2a2e546d9 req-35edca2f-ea1b-41fe-b1c0-4dce82b8ba67 service nova] Acquiring lock "refresh_cache-3504ddd3-bdd8-465e-aec5-190acdd563f6" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG nova.network.neutron [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG nova.network.neutron [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Updating instance_info_cache with network_info: [{"id": "8ac01677-8e6a-417b-b7a8-2fc5026404f9", "address": "fa:16:3e:2a:e3:16", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac01677-8e", "ovs_interfaceid": "8ac01677-8e6a-417b-b7a8-2fc5026404f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Releasing lock "refresh_cache-3504ddd3-bdd8-465e-aec5-190acdd563f6" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG nova.compute.manager [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Instance network_info: |[{"id": "8ac01677-8e6a-417b-b7a8-2fc5026404f9", "address": "fa:16:3e:2a:e3:16", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac01677-8e", "ovs_interfaceid": "8ac01677-8e6a-417b-b7a8-2fc5026404f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f489ed13-61ca-4de4-be4e-1cd2a2e546d9 req-35edca2f-ea1b-41fe-b1c0-4dce82b8ba67 service nova] Acquired lock "refresh_cache-3504ddd3-bdd8-465e-aec5-190acdd563f6" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG nova.network.neutron [req-f489ed13-61ca-4de4-be4e-1cd2a2e546d9 req-35edca2f-ea1b-41fe-b1c0-4dce82b8ba67 service nova] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Refreshing network info cache for port 8ac01677-8e6a-417b-b7a8-2fc5026404f9 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Start _get_guest_xml network_info=[{"id": "8ac01677-8e6a-417b-b7a8-2fc5026404f9", "address": "fa:16:3e:2a:e3:16", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac01677-8e", "ovs_interfaceid": "8ac01677-8e6a-417b-b7a8-2fc5026404f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 01:02:07 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:02:07 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:02:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:02:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1277467798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1277467798',id=36,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='491aa2a4f38140788cb0de9762a8baf4',ramdisk_id='',reservation_id='r-xgxj39jn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-726213232',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:02:06Z,user_data=None,user_id='a5bb5d788a3b4871ae41f57d06f785f2',uuid=3504ddd3-bdd8-465e-aec5-190acdd563f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ac01677-8e6a-417b-b7a8-2fc5026404f9", "address": "fa:16:3e:2a:e3:16", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac01677-8e", "ovs_interfaceid": "8ac01677-8e6a-417b-b7a8-2fc5026404f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Converting VIF {"id": "8ac01677-8e6a-417b-b7a8-2fc5026404f9", "address": "fa:16:3e:2a:e3:16", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac01677-8e", "ovs_interfaceid": "8ac01677-8e6a-417b-b7a8-2fc5026404f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:e3:16,bridge_name='br-int',has_traffic_filtering=True,id=8ac01677-8e6a-417b-b7a8-2fc5026404f9,network=Network(6f8f66ca-e2e8-4565-a05c-df75a16699ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac01677-8e') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG nova.objects.instance [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lazy-loading 'pci_devices' on Instance uuid 3504ddd3-bdd8-465e-aec5-190acdd563f6 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] End _get_guest_xml xml=<domain type="kvm">
Nov 14 01:02:07 user nova-compute[74850]:   <uuid>3504ddd3-bdd8-465e-aec5-190acdd563f6</uuid>
Nov 14 01:02:07 user nova-compute[74850]:   <name>instance-00000024</name>
Nov 14 01:02:07 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 01:02:07 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 01:02:07 user nova-compute[74850]:   <metadata>
Nov 14 01:02:07 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 01:02:07 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 01:02:07 user nova-compute[74850]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1277467798</nova:name>
Nov 14 01:02:07 user nova-compute[74850]:       <nova:creationTime>2023-11-14 01:02:07</nova:creationTime>
Nov 14 01:02:07 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 01:02:07 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 01:02:07 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 01:02:07 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 01:02:07 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 01:02:07 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 01:02:07 user nova-compute[74850]:       </nova:flavor>
Nov 14 01:02:07 user nova-compute[74850]:       <nova:owner>
Nov 14 01:02:07 user nova-compute[74850]:         <nova:user uuid="a5bb5d788a3b4871ae41f57d06f785f2">tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member</nova:user>
Nov 14 01:02:07 user nova-compute[74850]:         <nova:project uuid="491aa2a4f38140788cb0de9762a8baf4">tempest-ServerBootFromVolumeStableRescueTest-726213232</nova:project>
Nov 14 01:02:07 user nova-compute[74850]:       </nova:owner>
Nov 14 01:02:07 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 01:02:07 user nova-compute[74850]:       <nova:ports>
Nov 14 01:02:07 user nova-compute[74850]:         <nova:port uuid="8ac01677-8e6a-417b-b7a8-2fc5026404f9">
Nov 14 01:02:07 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 01:02:07 user nova-compute[74850]:         </nova:port>
Nov 14 01:02:07 user nova-compute[74850]:       </nova:ports>
Nov 14 01:02:07 user nova-compute[74850]:     </nova:instance>
Nov 14 01:02:07 user nova-compute[74850]:   </metadata>
Nov 14 01:02:07 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 01:02:07 user nova-compute[74850]:     <system>
Nov 14 01:02:07 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 01:02:07 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 01:02:07 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 01:02:07 user nova-compute[74850]:       <entry name="serial">3504ddd3-bdd8-465e-aec5-190acdd563f6</entry>
Nov 14 01:02:07 user nova-compute[74850]:       <entry name="uuid">3504ddd3-bdd8-465e-aec5-190acdd563f6</entry>
Nov 14 01:02:07 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 01:02:07 user nova-compute[74850]:     </system>
Nov 14 01:02:07 user nova-compute[74850]:   </sysinfo>
Nov 14 01:02:07 user nova-compute[74850]:   <os>
Nov 14 01:02:07 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 01:02:07 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 01:02:07 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 01:02:07 user nova-compute[74850]:   </os>
Nov 14 01:02:07 user nova-compute[74850]:   <features>
Nov 14 01:02:07 user nova-compute[74850]:     <acpi/>
Nov 14 01:02:07 user nova-compute[74850]:     <apic/>
Nov 14 01:02:07 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 01:02:07 user nova-compute[74850]:   </features>
Nov 14 01:02:07 user nova-compute[74850]:   <clock offset="utc">
Nov 14 01:02:07 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 01:02:07 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 01:02:07 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 01:02:07 user nova-compute[74850]:   </clock>
Nov 14 01:02:07 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 01:02:07 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 01:02:07 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 01:02:07 user nova-compute[74850]:   </cpu>
Nov 14 01:02:07 user nova-compute[74850]:   <devices>
Nov 14 01:02:07 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 01:02:07 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 01:02:07 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk"/>
Nov 14 01:02:07 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 01:02:07 user nova-compute[74850]:     </disk>
Nov 14 01:02:07 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 01:02:07 user nova-compute[74850]:       <mac address="fa:16:3e:2a:e3:16"/>
Nov 14 01:02:07 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:02:07 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 01:02:07 user nova-compute[74850]:       <target dev="tap8ac01677-8e"/>
Nov 14 01:02:07 user nova-compute[74850]:     </interface>
Nov 14 01:02:07 user nova-compute[74850]:     <serial type="pty">
Nov 14 01:02:07 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/console.log" append="off"/>
Nov 14 01:02:07 user nova-compute[74850]:     </serial>
Nov 14 01:02:07 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 01:02:07 user nova-compute[74850]:     <video>
Nov 14 01:02:07 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:02:07 user nova-compute[74850]:     </video>
Nov 14 01:02:07 user nova-compute[74850]:     <rng model="virtio">
Nov 14 01:02:07 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 01:02:07 user nova-compute[74850]:     </rng>
Nov 14 01:02:07 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 01:02:07 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 01:02:07 user nova-compute[74850]:       <stats period="10"/>
Nov 14 01:02:07 user nova-compute[74850]:     </memballoon>
Nov 14 01:02:07 user nova-compute[74850]:   </devices>
Nov 14 01:02:07 user nova-compute[74850]: </domain>
Nov 14 01:02:07 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:02:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1277467798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1277467798',id=36,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='491aa2a4f38140788cb0de9762a8baf4',ramdisk_id='',reservation_id='r-xgxj39jn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-726213232',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:02:06Z,user_data=None,user_id='a5bb5d788a3b4871ae41f57d06f785f2',uuid=3504ddd3-bdd8-465e-aec5-190acdd563f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ac01677-8e6a-417b-b7a8-2fc5026404f9", "address": "fa:16:3e:2a:e3:16", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac01677-8e", "ovs_interfaceid": "8ac01677-8e6a-417b-b7a8-2fc5026404f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Converting VIF {"id": "8ac01677-8e6a-417b-b7a8-2fc5026404f9", "address": "fa:16:3e:2a:e3:16", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac01677-8e", "ovs_interfaceid": "8ac01677-8e6a-417b-b7a8-2fc5026404f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:e3:16,bridge_name='br-int',has_traffic_filtering=True,id=8ac01677-8e6a-417b-b7a8-2fc5026404f9,network=Network(6f8f66ca-e2e8-4565-a05c-df75a16699ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac01677-8e') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG os_vif [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:e3:16,bridge_name='br-int',has_traffic_filtering=True,id=8ac01677-8e6a-417b-b7a8-2fc5026404f9,network=Network(6f8f66ca-e2e8-4565-a05c-df75a16699ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac01677-8e') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2bfb15c0-3040-5448-8114-236a518b7e97', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ac01677-8e, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8ac01677-8e, col_values=(('qos', UUID('0d83cb77-6dd9-488f-a500-132873b1c487')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8ac01677-8e, col_values=(('external_ids', {'iface-id': '8ac01677-8e6a-417b-b7a8-2fc5026404f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:e3:16', 'vm-uuid': '3504ddd3-bdd8-465e-aec5-190acdd563f6'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:07 user nova-compute[74850]: INFO os_vif [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:e3:16,bridge_name='br-int',has_traffic_filtering=True,id=8ac01677-8e6a-417b-b7a8-2fc5026404f9,network=Network(6f8f66ca-e2e8-4565-a05c-df75a16699ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac01677-8e')
Nov 14 01:02:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] No VIF found with MAC fa:16:3e:2a:e3:16, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG nova.network.neutron [req-f489ed13-61ca-4de4-be4e-1cd2a2e546d9 req-35edca2f-ea1b-41fe-b1c0-4dce82b8ba67 service nova] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Updated VIF entry in instance network info cache for port 8ac01677-8e6a-417b-b7a8-2fc5026404f9. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG nova.network.neutron [req-f489ed13-61ca-4de4-be4e-1cd2a2e546d9 req-35edca2f-ea1b-41fe-b1c0-4dce82b8ba67 service nova] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Updating instance_info_cache with network_info: [{"id": "8ac01677-8e6a-417b-b7a8-2fc5026404f9", "address": "fa:16:3e:2a:e3:16", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac01677-8e", "ovs_interfaceid": "8ac01677-8e6a-417b-b7a8-2fc5026404f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:02:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f489ed13-61ca-4de4-be4e-1cd2a2e546d9 req-35edca2f-ea1b-41fe-b1c0-4dce82b8ba67 service nova] Releasing lock "refresh_cache-3504ddd3-bdd8-465e-aec5-190acdd563f6" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:02:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:09 user nova-compute[74850]: DEBUG nova.compute.manager [req-c79334f3-34e2-49d0-a04f-394daab34aff req-6a229d90-2383-4e5f-94ae-da006f6d34ce service nova] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Received event network-vif-plugged-8ac01677-8e6a-417b-b7a8-2fc5026404f9 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:02:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c79334f3-34e2-49d0-a04f-394daab34aff req-6a229d90-2383-4e5f-94ae-da006f6d34ce service nova] Acquiring lock "3504ddd3-bdd8-465e-aec5-190acdd563f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:02:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c79334f3-34e2-49d0-a04f-394daab34aff req-6a229d90-2383-4e5f-94ae-da006f6d34ce service nova] Lock "3504ddd3-bdd8-465e-aec5-190acdd563f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:02:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c79334f3-34e2-49d0-a04f-394daab34aff req-6a229d90-2383-4e5f-94ae-da006f6d34ce service nova] Lock "3504ddd3-bdd8-465e-aec5-190acdd563f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:02:09 user nova-compute[74850]: DEBUG nova.compute.manager [req-c79334f3-34e2-49d0-a04f-394daab34aff req-6a229d90-2383-4e5f-94ae-da006f6d34ce service nova] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] No waiting events found dispatching network-vif-plugged-8ac01677-8e6a-417b-b7a8-2fc5026404f9 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:02:09 user nova-compute[74850]: WARNING nova.compute.manager [req-c79334f3-34e2-49d0-a04f-394daab34aff req-6a229d90-2383-4e5f-94ae-da006f6d34ce service nova] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Received unexpected event network-vif-plugged-8ac01677-8e6a-417b-b7a8-2fc5026404f9 for instance with vm_state building and task_state spawning.
Nov 14 01:02:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:10 user nova-compute[74850]: DEBUG nova.compute.manager [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 01:02:10 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 01:02:10 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Instance spawned successfully.
Nov 14 01:02:10 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 01:02:10 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:02:10 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:02:10 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:02:10 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:02:10 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:02:10 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:02:11 user nova-compute[74850]: INFO nova.compute.manager [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Took 4.97 seconds to spawn the instance on the hypervisor.
Nov 14 01:02:11 user nova-compute[74850]: DEBUG nova.compute.manager [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 01:02:11 user nova-compute[74850]: INFO nova.compute.manager [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Took 5.76 seconds to build instance.
Nov 14 01:02:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9abdc35e-c058-4411-89ca-cbc4b7833092 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "3504ddd3-bdd8-465e-aec5-190acdd563f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.852s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:02:11 user nova-compute[74850]: DEBUG nova.compute.manager [req-124e6af0-15b0-4f0b-bcd0-001459c42e0b req-32f09b58-03de-4fc0-a2f1-0fe13efe5079 service nova] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Received event network-vif-plugged-8ac01677-8e6a-417b-b7a8-2fc5026404f9 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:02:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-124e6af0-15b0-4f0b-bcd0-001459c42e0b req-32f09b58-03de-4fc0-a2f1-0fe13efe5079 service nova] Acquiring lock "3504ddd3-bdd8-465e-aec5-190acdd563f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:02:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-124e6af0-15b0-4f0b-bcd0-001459c42e0b req-32f09b58-03de-4fc0-a2f1-0fe13efe5079 service nova] Lock "3504ddd3-bdd8-465e-aec5-190acdd563f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:02:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-124e6af0-15b0-4f0b-bcd0-001459c42e0b req-32f09b58-03de-4fc0-a2f1-0fe13efe5079 service nova] Lock "3504ddd3-bdd8-465e-aec5-190acdd563f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:02:11 user nova-compute[74850]: DEBUG nova.compute.manager [req-124e6af0-15b0-4f0b-bcd0-001459c42e0b req-32f09b58-03de-4fc0-a2f1-0fe13efe5079 service nova] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] No waiting events found dispatching network-vif-plugged-8ac01677-8e6a-417b-b7a8-2fc5026404f9 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:02:11 user nova-compute[74850]: WARNING nova.compute.manager [req-124e6af0-15b0-4f0b-bcd0-001459c42e0b req-32f09b58-03de-4fc0-a2f1-0fe13efe5079 service nova] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Received unexpected event network-vif-plugged-8ac01677-8e6a-417b-b7a8-2fc5026404f9 for instance with vm_state active and task_state None.
Nov 14 01:02:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:02:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74850) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 01:02:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:02:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:02:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:28 user nova-compute[74850]: DEBUG nova.compute.manager [req-ae45f237-a9f9-4dc4-b5bd-2ebf21c9dfe0 req-99ef43a2-cbde-4f64-9743-5e7f0996d8d2 service nova] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Received event network-changed-516d15ad-46ae-45f4-b6b5-0082495e79ea {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:02:28 user nova-compute[74850]: DEBUG nova.compute.manager [req-ae45f237-a9f9-4dc4-b5bd-2ebf21c9dfe0 req-99ef43a2-cbde-4f64-9743-5e7f0996d8d2 service nova] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Refreshing instance network info cache due to event network-changed-516d15ad-46ae-45f4-b6b5-0082495e79ea. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:02:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ae45f237-a9f9-4dc4-b5bd-2ebf21c9dfe0 req-99ef43a2-cbde-4f64-9743-5e7f0996d8d2 service nova] Acquiring lock "refresh_cache-f34cc4c3-1c5d-46d7-92ea-571cb8458b96" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:02:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ae45f237-a9f9-4dc4-b5bd-2ebf21c9dfe0 req-99ef43a2-cbde-4f64-9743-5e7f0996d8d2 service nova] Acquired lock "refresh_cache-f34cc4c3-1c5d-46d7-92ea-571cb8458b96" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:02:28 user nova-compute[74850]: DEBUG nova.network.neutron [req-ae45f237-a9f9-4dc4-b5bd-2ebf21c9dfe0 req-99ef43a2-cbde-4f64-9743-5e7f0996d8d2 service nova] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Refreshing network info cache for port 516d15ad-46ae-45f4-b6b5-0082495e79ea {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:02:29 user nova-compute[74850]: DEBUG nova.network.neutron [req-ae45f237-a9f9-4dc4-b5bd-2ebf21c9dfe0 req-99ef43a2-cbde-4f64-9743-5e7f0996d8d2 service nova] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Updated VIF entry in instance network info cache for port 516d15ad-46ae-45f4-b6b5-0082495e79ea. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:02:29 user nova-compute[74850]: DEBUG nova.network.neutron [req-ae45f237-a9f9-4dc4-b5bd-2ebf21c9dfe0 req-99ef43a2-cbde-4f64-9743-5e7f0996d8d2 service nova] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Updating instance_info_cache with network_info: [{"id": "516d15ad-46ae-45f4-b6b5-0082495e79ea", "address": "fa:16:3e:b2:d1:a6", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap516d15ad-46", "ovs_interfaceid": "516d15ad-46ae-45f4-b6b5-0082495e79ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:02:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ae45f237-a9f9-4dc4-b5bd-2ebf21c9dfe0 req-99ef43a2-cbde-4f64-9743-5e7f0996d8d2 service nova] Releasing lock "refresh_cache-f34cc4c3-1c5d-46d7-92ea-571cb8458b96" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:02:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9cd13ce4-8430-4b65-93d8-75311a67e605 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "f34cc4c3-1c5d-46d7-92ea-571cb8458b96" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:02:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9cd13ce4-8430-4b65-93d8-75311a67e605 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "f34cc4c3-1c5d-46d7-92ea-571cb8458b96" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:02:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9cd13ce4-8430-4b65-93d8-75311a67e605 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "f34cc4c3-1c5d-46d7-92ea-571cb8458b96-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:02:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9cd13ce4-8430-4b65-93d8-75311a67e605 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "f34cc4c3-1c5d-46d7-92ea-571cb8458b96-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:02:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9cd13ce4-8430-4b65-93d8-75311a67e605 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "f34cc4c3-1c5d-46d7-92ea-571cb8458b96-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:02:29 user nova-compute[74850]: INFO nova.compute.manager [None req-9cd13ce4-8430-4b65-93d8-75311a67e605 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Terminating instance
Nov 14 01:02:29 user nova-compute[74850]: DEBUG nova.compute.manager [None req-9cd13ce4-8430-4b65-93d8-75311a67e605 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 01:02:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:29 user nova-compute[74850]: DEBUG nova.compute.manager [req-64e00acc-88b2-413f-b0b4-c1790f75e500 req-157d58c8-6c35-45d5-a538-fb0f6bfc52e6 service nova] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Received event network-vif-unplugged-516d15ad-46ae-45f4-b6b5-0082495e79ea {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:02:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-64e00acc-88b2-413f-b0b4-c1790f75e500 req-157d58c8-6c35-45d5-a538-fb0f6bfc52e6 service nova] Acquiring lock "f34cc4c3-1c5d-46d7-92ea-571cb8458b96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:02:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-64e00acc-88b2-413f-b0b4-c1790f75e500 req-157d58c8-6c35-45d5-a538-fb0f6bfc52e6 service nova] Lock "f34cc4c3-1c5d-46d7-92ea-571cb8458b96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:02:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-64e00acc-88b2-413f-b0b4-c1790f75e500 req-157d58c8-6c35-45d5-a538-fb0f6bfc52e6 service nova] Lock "f34cc4c3-1c5d-46d7-92ea-571cb8458b96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:02:29 user nova-compute[74850]: DEBUG nova.compute.manager [req-64e00acc-88b2-413f-b0b4-c1790f75e500 req-157d58c8-6c35-45d5-a538-fb0f6bfc52e6 service nova] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] No waiting events found dispatching network-vif-unplugged-516d15ad-46ae-45f4-b6b5-0082495e79ea {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:02:29 user nova-compute[74850]: DEBUG nova.compute.manager [req-64e00acc-88b2-413f-b0b4-c1790f75e500 req-157d58c8-6c35-45d5-a538-fb0f6bfc52e6 service nova] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Received event network-vif-unplugged-516d15ad-46ae-45f4-b6b5-0082495e79ea for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 01:02:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:29 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Instance destroyed successfully.
Nov 14 01:02:29 user nova-compute[74850]: DEBUG nova.objects.instance [None req-9cd13ce4-8430-4b65-93d8-75311a67e605 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lazy-loading 'resources' on Instance uuid f34cc4c3-1c5d-46d7-92ea-571cb8458b96 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:02:29 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-9cd13ce4-8430-4b65-93d8-75311a67e605 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:00:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1830912571',display_name='tempest-AttachVolumeNegativeTest-server-1830912571',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1830912571',id=34,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkoxB5DhtdGTVGTn5hhiFej2lflNPEw2Wiyls01JCrc1DF8MQA7DH6Rs9IQhjbSq2VnsX+CE34QgqLZOTYEDpg1ufsIkn/EV9/OiHe+XBf7kaxM5ZqP/unXTyRGyFCZFQ==',key_name='tempest-keypair-1784207057',keypairs=<?>,launch_index=0,launched_at=2023-11-14T01:00:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35f609057d1e44679838d565d80cade3',ramdisk_id='',reservation_id='r-salecyhh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1995397455',owner_user_name='tempest-AttachVolumeNegativeTest-1995397455-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T01:00:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb027592ab214b57b389227a97576a43',uuid=f34cc4c3-1c5d-46d7-92ea-571cb8458b96,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "516d15ad-46ae-45f4-b6b5-0082495e79ea", "address": "fa:16:3e:b2:d1:a6", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap516d15ad-46", "ovs_interfaceid": "516d15ad-46ae-45f4-b6b5-0082495e79ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 01:02:29 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-9cd13ce4-8430-4b65-93d8-75311a67e605 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Converting VIF {"id": "516d15ad-46ae-45f4-b6b5-0082495e79ea", "address": "fa:16:3e:b2:d1:a6", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap516d15ad-46", "ovs_interfaceid": "516d15ad-46ae-45f4-b6b5-0082495e79ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:02:29 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-9cd13ce4-8430-4b65-93d8-75311a67e605 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:d1:a6,bridge_name='br-int',has_traffic_filtering=True,id=516d15ad-46ae-45f4-b6b5-0082495e79ea,network=Network(11208f55-0e63-4c33-a12c-e061c8061eec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap516d15ad-46') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:02:29 user nova-compute[74850]: DEBUG os_vif [None req-9cd13ce4-8430-4b65-93d8-75311a67e605 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:d1:a6,bridge_name='br-int',has_traffic_filtering=True,id=516d15ad-46ae-45f4-b6b5-0082495e79ea,network=Network(11208f55-0e63-4c33-a12c-e061c8061eec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap516d15ad-46') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 01:02:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap516d15ad-46, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:02:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:02:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=877b1194-eec0-4fca-bc45-6e6595fb958f) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:02:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:29 user nova-compute[74850]: INFO os_vif [None req-9cd13ce4-8430-4b65-93d8-75311a67e605 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:d1:a6,bridge_name='br-int',has_traffic_filtering=True,id=516d15ad-46ae-45f4-b6b5-0082495e79ea,network=Network(11208f55-0e63-4c33-a12c-e061c8061eec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap516d15ad-46')
Nov 14 01:02:30 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-9cd13ce4-8430-4b65-93d8-75311a67e605 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Deleting instance files /opt/stack/data/nova/instances/f34cc4c3-1c5d-46d7-92ea-571cb8458b96_del
Nov 14 01:02:30 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-9cd13ce4-8430-4b65-93d8-75311a67e605 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Deletion of /opt/stack/data/nova/instances/f34cc4c3-1c5d-46d7-92ea-571cb8458b96_del complete
Nov 14 01:02:30 user nova-compute[74850]: INFO nova.compute.manager [None req-9cd13ce4-8430-4b65-93d8-75311a67e605 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 14 01:02:30 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-9cd13ce4-8430-4b65-93d8-75311a67e605 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 01:02:30 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 01:02:30 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 01:02:30 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:30 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:02:30 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Took 0.63 seconds to deallocate network for instance.
Nov 14 01:02:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9cd13ce4-8430-4b65-93d8-75311a67e605 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:02:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9cd13ce4-8430-4b65-93d8-75311a67e605 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:02:30 user nova-compute[74850]: DEBUG nova.compute.manager [req-7cffd26e-b138-4046-a8f8-dd8cab202f1c req-987b01ba-b5a5-4d5d-afca-b04e1a42b3a0 service nova] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Received event network-vif-deleted-516d15ad-46ae-45f4-b6b5-0082495e79ea {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:02:30 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-9cd13ce4-8430-4b65-93d8-75311a67e605 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:02:30 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-9cd13ce4-8430-4b65-93d8-75311a67e605 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:02:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9cd13ce4-8430-4b65-93d8-75311a67e605 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.283s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:02:31 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-9cd13ce4-8430-4b65-93d8-75311a67e605 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Deleted allocations for instance f34cc4c3-1c5d-46d7-92ea-571cb8458b96
Nov 14 01:02:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9cd13ce4-8430-4b65-93d8-75311a67e605 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "f34cc4c3-1c5d-46d7-92ea-571cb8458b96" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.769s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:02:31 user nova-compute[74850]: DEBUG nova.compute.manager [req-9b41f781-2b55-4f0f-8765-737eeacdfb9d req-7d831fb5-16be-48b7-bf3c-d07a9c1096ec service nova] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Received event network-vif-plugged-516d15ad-46ae-45f4-b6b5-0082495e79ea {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:02:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9b41f781-2b55-4f0f-8765-737eeacdfb9d req-7d831fb5-16be-48b7-bf3c-d07a9c1096ec service nova] Acquiring lock "f34cc4c3-1c5d-46d7-92ea-571cb8458b96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:02:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9b41f781-2b55-4f0f-8765-737eeacdfb9d req-7d831fb5-16be-48b7-bf3c-d07a9c1096ec service nova] Lock "f34cc4c3-1c5d-46d7-92ea-571cb8458b96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:02:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9b41f781-2b55-4f0f-8765-737eeacdfb9d req-7d831fb5-16be-48b7-bf3c-d07a9c1096ec service nova] Lock "f34cc4c3-1c5d-46d7-92ea-571cb8458b96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:02:31 user nova-compute[74850]: DEBUG nova.compute.manager [req-9b41f781-2b55-4f0f-8765-737eeacdfb9d req-7d831fb5-16be-48b7-bf3c-d07a9c1096ec service nova] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] No waiting events found dispatching network-vif-plugged-516d15ad-46ae-45f4-b6b5-0082495e79ea {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:02:31 user nova-compute[74850]: WARNING nova.compute.manager [req-9b41f781-2b55-4f0f-8765-737eeacdfb9d req-7d831fb5-16be-48b7-bf3c-d07a9c1096ec service nova] [instance: f34cc4c3-1c5d-46d7-92ea-571cb8458b96] Received unexpected event network-vif-plugged-516d15ad-46ae-45f4-b6b5-0082495e79ea for instance with vm_state deleted and task_state None.
Nov 14 01:02:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "998f2d6a-e3b6-4135-9485-b042a5e094c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:02:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "998f2d6a-e3b6-4135-9485-b042a5e094c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:02:40 user nova-compute[74850]: DEBUG nova.compute.manager [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 01:02:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:02:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:02:40 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 01:02:40 user nova-compute[74850]: INFO nova.compute.claims [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Claim successful on node user
Nov 14 01:02:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:40 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:02:40 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:02:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.370s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:02:40 user nova-compute[74850]: DEBUG nova.compute.manager [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 01:02:40 user nova-compute[74850]: DEBUG nova.compute.manager [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 01:02:40 user nova-compute[74850]: DEBUG nova.network.neutron [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 01:02:40 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 01:02:40 user nova-compute[74850]: DEBUG nova.compute.manager [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 01:02:40 user nova-compute[74850]: DEBUG nova.policy [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c91ddcee4e54a769eb626c816596bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb1eb4b5fc841d1952b8db9ae05e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 01:02:41 user nova-compute[74850]: INFO nova.virt.block_device [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Booting with volume 20a4b5a6-0e20-4a30-9464-8c89e563ef8d at /dev/vda
Nov 14 01:02:41 user nova-compute[74850]: DEBUG os_brick.utils [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:02:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:02:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:02:41 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f3130f-6f9c-4066-a2d7-87fdc756cc98]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:02:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:02:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:02:41 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3417a0a-61a0-4578-a2a8-e3e8de8b98bf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:02:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:02:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:02:41 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b710fb9-01b8-42b2-9960-7a58e3130ebf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:02:41 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[57529ae7-9754-45d7-aab7-de7d383f1332]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:02:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:02:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:02:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 01:02:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:02:41 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:02:41 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 01:02:41 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e844f861-5364-48a0-b351-a23c96026373]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:02:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 01:02:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 01:02:41 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 01:02:41 user nova-compute[74850]: DEBUG os_brick.utils [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:02:41 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Updating existing volume attachment record: 14611128-a1eb-4db0-9100-e381e86f6cd9 {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 01:02:41 user nova-compute[74850]: DEBUG nova.network.neutron [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Successfully created port: 080e37ec-a952-4eb5-bc53-578a3fe28094 {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 01:02:42 user nova-compute[74850]: DEBUG nova.network.neutron [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Successfully updated port: 080e37ec-a952-4eb5-bc53-578a3fe28094 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 01:02:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "refresh_cache-998f2d6a-e3b6-4135-9485-b042a5e094c4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:02:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquired lock "refresh_cache-998f2d6a-e3b6-4135-9485-b042a5e094c4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:02:42 user nova-compute[74850]: DEBUG nova.network.neutron [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 01:02:42 user nova-compute[74850]: DEBUG nova.compute.manager [req-0daeb058-4506-4929-bb27-34904b860016 req-d1a66408-b094-40bd-8754-d7a663b0478a service nova] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Received event network-changed-080e37ec-a952-4eb5-bc53-578a3fe28094 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:02:42 user nova-compute[74850]: DEBUG nova.compute.manager [req-0daeb058-4506-4929-bb27-34904b860016 req-d1a66408-b094-40bd-8754-d7a663b0478a service nova] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Refreshing instance network info cache due to event network-changed-080e37ec-a952-4eb5-bc53-578a3fe28094. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:02:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-0daeb058-4506-4929-bb27-34904b860016 req-d1a66408-b094-40bd-8754-d7a663b0478a service nova] Acquiring lock "refresh_cache-998f2d6a-e3b6-4135-9485-b042a5e094c4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:02:42 user nova-compute[74850]: DEBUG nova.network.neutron [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 01:02:42 user nova-compute[74850]: DEBUG nova.network.neutron [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Updating instance_info_cache with network_info: [{"id": "080e37ec-a952-4eb5-bc53-578a3fe28094", "address": "fa:16:3e:d6:bb:bd", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap080e37ec-a9", "ovs_interfaceid": "080e37ec-a952-4eb5-bc53-578a3fe28094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:02:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Releasing lock "refresh_cache-998f2d6a-e3b6-4135-9485-b042a5e094c4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:02:42 user nova-compute[74850]: DEBUG nova.compute.manager [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Instance network_info: |[{"id": "080e37ec-a952-4eb5-bc53-578a3fe28094", "address": "fa:16:3e:d6:bb:bd", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap080e37ec-a9", "ovs_interfaceid": "080e37ec-a952-4eb5-bc53-578a3fe28094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 01:02:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-0daeb058-4506-4929-bb27-34904b860016 req-d1a66408-b094-40bd-8754-d7a663b0478a service nova] Acquired lock "refresh_cache-998f2d6a-e3b6-4135-9485-b042a5e094c4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:02:42 user nova-compute[74850]: DEBUG nova.network.neutron [req-0daeb058-4506-4929-bb27-34904b860016 req-d1a66408-b094-40bd-8754-d7a663b0478a service nova] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Refreshing network info cache for port 080e37ec-a952-4eb5-bc53-578a3fe28094 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:02:43 user nova-compute[74850]: DEBUG nova.network.neutron [req-0daeb058-4506-4929-bb27-34904b860016 req-d1a66408-b094-40bd-8754-d7a663b0478a service nova] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Updated VIF entry in instance network info cache for port 080e37ec-a952-4eb5-bc53-578a3fe28094. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:02:43 user nova-compute[74850]: DEBUG nova.network.neutron [req-0daeb058-4506-4929-bb27-34904b860016 req-d1a66408-b094-40bd-8754-d7a663b0478a service nova] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Updating instance_info_cache with network_info: [{"id": "080e37ec-a952-4eb5-bc53-578a3fe28094", "address": "fa:16:3e:d6:bb:bd", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap080e37ec-a9", "ovs_interfaceid": "080e37ec-a952-4eb5-bc53-578a3fe28094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:02:43 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-0daeb058-4506-4929-bb27-34904b860016 req-d1a66408-b094-40bd-8754-d7a663b0478a service nova] Releasing lock "refresh_cache-998f2d6a-e3b6-4135-9485-b042a5e094c4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:02:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG nova.compute.manager [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 01:02:45 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Creating image(s)
Nov 14 01:02:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Did not create local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Ensure instance console log exists: /opt/stack/data/nova/instances/998f2d6a-e3b6-4135-9485-b042a5e094c4/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Start _get_guest_xml network_info=[{"id": "080e37ec-a952-4eb5-bc53-578a3fe28094", "address": "fa:16:3e:d6:bb:bd", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap080e37ec-a9", "ovs_interfaceid": "080e37ec-a952-4eb5-bc53-578a3fe28094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '14611128-a1eb-4db0-9100-e381e86f6cd9', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HaFxyisS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '998f2d6a-e3b6-4135-9485-b042a5e094c4', 'attached_at': '', 'detached_at': '', 'volume_id': '20a4b5a6-0e20-4a30-9464-8c89e563ef8d', 'serial': '20a4b5a6-0e20-4a30-9464-8c89e563ef8d'}, 'volume_type': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 01:02:45 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:02:45 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:02:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HaFxyisS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:02:45 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:02:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:02:45 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:02:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:02:45 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 01:02:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d58683-83e2-475d-8070-ec439d801683]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 01:02:45 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8ba2de-80b2-4456-8cc5-1224086780ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d] added
Nov 14 01:02:45 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[50be4188-d7a6-447f-96e7-2d01683c91b2]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ff68d3-6d36-4f6c-acea-398c6402bf26]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HaFxyisS {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HaFxyisS" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be6666c-1e18-4c7b-81dc-9bd7c341cb53]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HaFxyisS'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd048fd-cd18-4f52-ad05-f5b17972a031]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15dbfc8-7e59-4bb2-87fe-49f60b9e0245]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:02:45 user nova-compute[74850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)
Nov 14 01:02:45 user nova-compute[74850]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)
Nov 14 01:02:45 user nova-compute[74850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:02:45 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:02:45 user nova-compute[74850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)
Nov 14 01:02:45 user nova-compute[74850]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)
Nov 14 01:02:45 user nova-compute[74850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:02:45 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8846eb81-e256-4bcf-be22-a428061b4eee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d, portal: 172.16.0.220,3260]
Nov 14 01:02:45 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d, portal: 172.16.0.220,3260] successful.
Nov 14 01:02:45 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e583f7-bc2d-42c1-9a0a-9064a0bc2136]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58c5a4b-58c9-46ff-8333-d1e7b5633515]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:02:45 user nova-compute[74850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)
Nov 14 01:02:45 user nova-compute[74850]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)
Nov 14 01:02:45 user nova-compute[74850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:02:45 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:02:45 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:02:45 user nova-compute[74850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)
Nov 14 01:02:45 user nova-compute[74850]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)
Nov 14 01:02:45 user nova-compute[74850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:02:45 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:02:45 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9c222d-a37e-495b-900e-74adc9f08654]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:02:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HaFxyisS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 01:02:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:02:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23939336566343639', 'path': '/dev/sdc'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:02:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939336566343639', 'path': '/dev/sdc'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 01:02:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:02:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2140022489',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2140022489',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2140022489',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/7ek1jkNyLROtgJdX+fb8SGjy6uhUjyyI80poahEPiU9qAJNv9YbHHcodXq5nGZ9BM3kKWhHJGATQNnDp0vJzEhdF3TxJ2/ZXa7zvy1eyY0UZNBYqi/qotWdw3iB4Mlg==',key_name='tempest-keypair-8877152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdb1eb4b5fc841d1952b8db9ae05e446',ramdisk_id='',reservation_id='r-uoq2n9b6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1536334624',owner_user_name='tempest-TestVolumeBootPattern-1536334624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:02:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c91ddcee4e54a769eb626c816596bed',uuid=998f2d6a-e3b6-4135-9485-b042a5e094c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "080e37ec-a952-4eb5-bc53-578a3fe28094", "address": "fa:16:3e:d6:bb:bd", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap080e37ec-a9", "ovs_interfaceid": "080e37ec-a952-4eb5-bc53-578a3fe28094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 01:02:46 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Converting VIF {"id": "080e37ec-a952-4eb5-bc53-578a3fe28094", "address": "fa:16:3e:d6:bb:bd", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap080e37ec-a9", "ovs_interfaceid": "080e37ec-a952-4eb5-bc53-578a3fe28094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:02:46 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:bb:bd,bridge_name='br-int',has_traffic_filtering=True,id=080e37ec-a952-4eb5-bc53-578a3fe28094,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap080e37ec-a9') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:02:46 user nova-compute[74850]: DEBUG nova.objects.instance [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lazy-loading 'pci_devices' on Instance uuid 998f2d6a-e3b6-4135-9485-b042a5e094c4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:02:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] End _get_guest_xml xml=<domain type="kvm">
Nov 14 01:02:46 user nova-compute[74850]:   <uuid>998f2d6a-e3b6-4135-9485-b042a5e094c4</uuid>
Nov 14 01:02:46 user nova-compute[74850]:   <name>instance-00000025</name>
Nov 14 01:02:46 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 01:02:46 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 01:02:46 user nova-compute[74850]:   <metadata>
Nov 14 01:02:46 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 01:02:46 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 01:02:46 user nova-compute[74850]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-2140022489</nova:name>
Nov 14 01:02:46 user nova-compute[74850]:       <nova:creationTime>2023-11-14 01:02:45</nova:creationTime>
Nov 14 01:02:46 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 01:02:46 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 01:02:46 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 01:02:46 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 01:02:46 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 01:02:46 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 01:02:46 user nova-compute[74850]:       </nova:flavor>
Nov 14 01:02:46 user nova-compute[74850]:       <nova:owner>
Nov 14 01:02:46 user nova-compute[74850]:         <nova:user uuid="6c91ddcee4e54a769eb626c816596bed">tempest-TestVolumeBootPattern-1536334624-project-member</nova:user>
Nov 14 01:02:46 user nova-compute[74850]:         <nova:project uuid="fdb1eb4b5fc841d1952b8db9ae05e446">tempest-TestVolumeBootPattern-1536334624</nova:project>
Nov 14 01:02:46 user nova-compute[74850]:       </nova:owner>
Nov 14 01:02:46 user nova-compute[74850]:       <nova:ports>
Nov 14 01:02:46 user nova-compute[74850]:         <nova:port uuid="080e37ec-a952-4eb5-bc53-578a3fe28094">
Nov 14 01:02:46 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 01:02:46 user nova-compute[74850]:         </nova:port>
Nov 14 01:02:46 user nova-compute[74850]:       </nova:ports>
Nov 14 01:02:46 user nova-compute[74850]:     </nova:instance>
Nov 14 01:02:46 user nova-compute[74850]:   </metadata>
Nov 14 01:02:46 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 01:02:46 user nova-compute[74850]:     <system>
Nov 14 01:02:46 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 01:02:46 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 01:02:46 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 01:02:46 user nova-compute[74850]:       <entry name="serial">998f2d6a-e3b6-4135-9485-b042a5e094c4</entry>
Nov 14 01:02:46 user nova-compute[74850]:       <entry name="uuid">998f2d6a-e3b6-4135-9485-b042a5e094c4</entry>
Nov 14 01:02:46 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 01:02:46 user nova-compute[74850]:     </system>
Nov 14 01:02:46 user nova-compute[74850]:   </sysinfo>
Nov 14 01:02:46 user nova-compute[74850]:   <os>
Nov 14 01:02:46 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 01:02:46 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 01:02:46 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 01:02:46 user nova-compute[74850]:   </os>
Nov 14 01:02:46 user nova-compute[74850]:   <features>
Nov 14 01:02:46 user nova-compute[74850]:     <acpi/>
Nov 14 01:02:46 user nova-compute[74850]:     <apic/>
Nov 14 01:02:46 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 01:02:46 user nova-compute[74850]:   </features>
Nov 14 01:02:46 user nova-compute[74850]:   <clock offset="utc">
Nov 14 01:02:46 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 01:02:46 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 01:02:46 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 01:02:46 user nova-compute[74850]:   </clock>
Nov 14 01:02:46 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 01:02:46 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 01:02:46 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 01:02:46 user nova-compute[74850]:   </cpu>
Nov 14 01:02:46 user nova-compute[74850]:   <devices>
Nov 14 01:02:46 user nova-compute[74850]:     <disk type="block" device="disk">
Nov 14 01:02:46 user nova-compute[74850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:02:46 user nova-compute[74850]:       <source dev="/dev/sdc"/>
Nov 14 01:02:46 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 01:02:46 user nova-compute[74850]:       <serial>20a4b5a6-0e20-4a30-9464-8c89e563ef8d</serial>
Nov 14 01:02:46 user nova-compute[74850]:     </disk>
Nov 14 01:02:46 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 01:02:46 user nova-compute[74850]:       <mac address="fa:16:3e:d6:bb:bd"/>
Nov 14 01:02:46 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:02:46 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 01:02:46 user nova-compute[74850]:       <target dev="tap080e37ec-a9"/>
Nov 14 01:02:46 user nova-compute[74850]:     </interface>
Nov 14 01:02:46 user nova-compute[74850]:     <serial type="pty">
Nov 14 01:02:46 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/998f2d6a-e3b6-4135-9485-b042a5e094c4/console.log" append="off"/>
Nov 14 01:02:46 user nova-compute[74850]:     </serial>
Nov 14 01:02:46 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 01:02:46 user nova-compute[74850]:     <video>
Nov 14 01:02:46 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:02:46 user nova-compute[74850]:     </video>
Nov 14 01:02:46 user nova-compute[74850]:     <rng model="virtio">
Nov 14 01:02:46 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 01:02:46 user nova-compute[74850]:     </rng>
Nov 14 01:02:46 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 01:02:46 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 01:02:46 user nova-compute[74850]:       <stats period="10"/>
Nov 14 01:02:46 user nova-compute[74850]:     </memballoon>
Nov 14 01:02:46 user nova-compute[74850]:   </devices>
Nov 14 01:02:46 user nova-compute[74850]: </domain>
Nov 14 01:02:46 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 01:02:47 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:02:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2140022489',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2140022489',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2140022489',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/7ek1jkNyLROtgJdX+fb8SGjy6uhUjyyI80poahEPiU9qAJNv9YbHHcodXq5nGZ9BM3kKWhHJGATQNnDp0vJzEhdF3TxJ2/ZXa7zvy1eyY0UZNBYqi/qotWdw3iB4Mlg==',key_name='tempest-keypair-8877152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdb1eb4b5fc841d1952b8db9ae05e446',ramdisk_id='',reservation_id='r-uoq2n9b6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1536334624',owner_user_name='tempest-TestVolumeBootPattern-1536334624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:02:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c91ddcee4e54a769eb626c816596bed',uuid=998f2d6a-e3b6-4135-9485-b042a5e094c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "080e37ec-a952-4eb5-bc53-578a3fe28094", "address": "fa:16:3e:d6:bb:bd", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap080e37ec-a9", "ovs_interfaceid": "080e37ec-a952-4eb5-bc53-578a3fe28094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 01:02:47 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Converting VIF {"id": "080e37ec-a952-4eb5-bc53-578a3fe28094", "address": "fa:16:3e:d6:bb:bd", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap080e37ec-a9", "ovs_interfaceid": "080e37ec-a952-4eb5-bc53-578a3fe28094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:02:47 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:bb:bd,bridge_name='br-int',has_traffic_filtering=True,id=080e37ec-a952-4eb5-bc53-578a3fe28094,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap080e37ec-a9') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:02:47 user nova-compute[74850]: DEBUG os_vif [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:bb:bd,bridge_name='br-int',has_traffic_filtering=True,id=080e37ec-a952-4eb5-bc53-578a3fe28094,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap080e37ec-a9') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 01:02:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:02:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 01:02:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e70e04bc-1eb9-5adc-9467-4399197495b8', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:02:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap080e37ec-a9, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:02:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap080e37ec-a9, col_values=(('qos', UUID('8db284ea-a656-4b52-9583-2d18284a6f79')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:02:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap080e37ec-a9, col_values=(('external_ids', {'iface-id': '080e37ec-a952-4eb5-bc53-578a3fe28094', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:bb:bd', 'vm-uuid': '998f2d6a-e3b6-4135-9485-b042a5e094c4'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:02:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:02:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:47 user nova-compute[74850]: INFO os_vif [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:bb:bd,bridge_name='br-int',has_traffic_filtering=True,id=080e37ec-a952-4eb5-bc53-578a3fe28094,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap080e37ec-a9')
Nov 14 01:02:47 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:02:47 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] No VIF found with MAC fa:16:3e:d6:bb:bd, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:02:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:48 user nova-compute[74850]: DEBUG nova.compute.manager [req-d35de440-f84e-4ea9-87a2-f3c7c34a6ed4 req-7a120eec-5e3f-4288-ab84-d7a614486554 service nova] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Received event network-vif-plugged-080e37ec-a952-4eb5-bc53-578a3fe28094 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:02:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d35de440-f84e-4ea9-87a2-f3c7c34a6ed4 req-7a120eec-5e3f-4288-ab84-d7a614486554 service nova] Acquiring lock "998f2d6a-e3b6-4135-9485-b042a5e094c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:02:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d35de440-f84e-4ea9-87a2-f3c7c34a6ed4 req-7a120eec-5e3f-4288-ab84-d7a614486554 service nova] Lock "998f2d6a-e3b6-4135-9485-b042a5e094c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:02:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d35de440-f84e-4ea9-87a2-f3c7c34a6ed4 req-7a120eec-5e3f-4288-ab84-d7a614486554 service nova] Lock "998f2d6a-e3b6-4135-9485-b042a5e094c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:02:48 user nova-compute[74850]: DEBUG nova.compute.manager [req-d35de440-f84e-4ea9-87a2-f3c7c34a6ed4 req-7a120eec-5e3f-4288-ab84-d7a614486554 service nova] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] No waiting events found dispatching network-vif-plugged-080e37ec-a952-4eb5-bc53-578a3fe28094 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:02:48 user nova-compute[74850]: WARNING nova.compute.manager [req-d35de440-f84e-4ea9-87a2-f3c7c34a6ed4 req-7a120eec-5e3f-4288-ab84-d7a614486554 service nova] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Received unexpected event network-vif-plugged-080e37ec-a952-4eb5-bc53-578a3fe28094 for instance with vm_state building and task_state spawning.
Nov 14 01:02:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:50 user nova-compute[74850]: DEBUG nova.compute.manager [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 01:02:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 01:02:50 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Instance spawned successfully.
Nov 14 01:02:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 01:02:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:02:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:02:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:02:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:02:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:02:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:02:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:50 user nova-compute[74850]: INFO nova.compute.manager [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Took 5.05 seconds to spawn the instance on the hypervisor.
Nov 14 01:02:50 user nova-compute[74850]: DEBUG nova.compute.manager [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 01:02:50 user nova-compute[74850]: DEBUG nova.compute.manager [req-fc297ede-1b3f-4a51-a484-8ea54d884e59 req-2263cfb7-dbb8-4aab-8dff-41a9fbffc7cd service nova] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Received event network-vif-plugged-080e37ec-a952-4eb5-bc53-578a3fe28094 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:02:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fc297ede-1b3f-4a51-a484-8ea54d884e59 req-2263cfb7-dbb8-4aab-8dff-41a9fbffc7cd service nova] Acquiring lock "998f2d6a-e3b6-4135-9485-b042a5e094c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:02:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fc297ede-1b3f-4a51-a484-8ea54d884e59 req-2263cfb7-dbb8-4aab-8dff-41a9fbffc7cd service nova] Lock "998f2d6a-e3b6-4135-9485-b042a5e094c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:02:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fc297ede-1b3f-4a51-a484-8ea54d884e59 req-2263cfb7-dbb8-4aab-8dff-41a9fbffc7cd service nova] Lock "998f2d6a-e3b6-4135-9485-b042a5e094c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:02:50 user nova-compute[74850]: DEBUG nova.compute.manager [req-fc297ede-1b3f-4a51-a484-8ea54d884e59 req-2263cfb7-dbb8-4aab-8dff-41a9fbffc7cd service nova] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] No waiting events found dispatching network-vif-plugged-080e37ec-a952-4eb5-bc53-578a3fe28094 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:02:50 user nova-compute[74850]: WARNING nova.compute.manager [req-fc297ede-1b3f-4a51-a484-8ea54d884e59 req-2263cfb7-dbb8-4aab-8dff-41a9fbffc7cd service nova] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Received unexpected event network-vif-plugged-080e37ec-a952-4eb5-bc53-578a3fe28094 for instance with vm_state building and task_state spawning.
Nov 14 01:02:50 user nova-compute[74850]: INFO nova.compute.manager [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Took 10.26 seconds to build instance.
Nov 14 01:02:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bb1299ba-2ce0-4fbc-beca-ac4227c72c30 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "998f2d6a-e3b6-4135-9485-b042a5e094c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.365s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:02:50 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:02:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:02:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:02:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:02:50 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 01:02:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:02:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:02:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:02:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:02:51 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:02:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:02:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:02:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:02:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:02:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:02:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:02:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:02:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:02:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2749d176-9c59-493e-b3c3-af5980329041/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:02:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2749d176-9c59-493e-b3c3-af5980329041/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:02:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2749d176-9c59-493e-b3c3-af5980329041/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:02:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2749d176-9c59-493e-b3c3-af5980329041/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:02:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:02:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:02:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:02:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:02:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:02:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:02:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:02:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:02:53 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:02:53 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:02:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=8053MB free_disk=25.093280792236328GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 01:02:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:02:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:02:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 748d0da7-bbb9-4e86-aae3-e48b1fa04c14 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:02:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance c7952bff-87d6-46c1-a6d4-7729dc4893ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:02:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 702746f7-305f-4eac-a71a-6c08b7cbccd8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:02:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 782a85d0-b427-4ee2-8d6c-778602f00bcd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:02:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 2749d176-9c59-493e-b3c3-af5980329041 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:02:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 6f0cb80d-dfec-4278-81ff-0e292bad880a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:02:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 3504ddd3-bdd8-465e-aec5-190acdd563f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:02:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 998f2d6a-e3b6-4135-9485-b042a5e094c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:02:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 01:02:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 01:02:53 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:02:53 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:02:53 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 01:02:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.413s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:02:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:02:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:02:55 user nova-compute[74850]: INFO nova.compute.manager [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Unshelving
Nov 14 01:02:55 user nova-compute[74850]: INFO nova.virt.block_device [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Booting with volume 91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 at /dev/vdc
Nov 14 01:02:56 user nova-compute[74850]: DEBUG os_brick.utils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:02:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:02:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:02:56 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d789e691-0b95-4582-bf4d-47e2b2537fe8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:02:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:02:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:02:56 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[741e6f16-6732-4cd2-a9e0-683fb092fa47]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:02:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:02:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:02:56 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ed8549-ca1f-46bd-9f1e-6e71075dfba2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:02:56 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f21fe4-60d2-4844-8589-528afcaaaee9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:02:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:02:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:02:56 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 01:02:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:02:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:02:56 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 01:02:56 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f21d63-3d30-4cc2-8bbc-b845ccf5a3a4]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:02:56 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 01:02:56 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 01:02:56 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 01:02:56 user nova-compute[74850]: DEBUG os_brick.utils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:02:56 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Updating existing volume attachment record: 1be5fbb7-3af4-4fab-a30e-7762b7330af9 {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 01:02:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:02:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-27b16ee2-a69e-42a6-b5bd-dbf6fab0af0a tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "782a85d0-b427-4ee2-8d6c-778602f00bcd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:02:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-27b16ee2-a69e-42a6-b5bd-dbf6fab0af0a tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:02:57 user nova-compute[74850]: INFO nova.compute.manager [None req-27b16ee2-a69e-42a6-b5bd-dbf6fab0af0a tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Detaching volume 40c8987b-4ae1-4338-b6da-3d4612c015e1
Nov 14 01:02:57 user nova-compute[74850]: INFO nova.virt.block_device [None req-27b16ee2-a69e-42a6-b5bd-dbf6fab0af0a tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Attempting to driver detach volume 40c8987b-4ae1-4338-b6da-3d4612c015e1 from mountpoint /dev/vdb
Nov 14 01:02:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-27b16ee2-a69e-42a6-b5bd-dbf6fab0af0a tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Attempting to detach device vdb from instance 782a85d0-b427-4ee2-8d6c-778602f00bcd from the persistent domain config. {{(pid=74850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 01:02:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-27b16ee2-a69e-42a6-b5bd-dbf6fab0af0a tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:02:57 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:02:57 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 01:02:57 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:02:57 user nova-compute[74850]:   <serial>40c8987b-4ae1-4338-b6da-3d4612c015e1</serial>
Nov 14 01:02:57 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 01:02:57 user nova-compute[74850]: </disk>
Nov 14 01:02:57 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:02:57 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-27b16ee2-a69e-42a6-b5bd-dbf6fab0af0a tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Successfully detached device vdb from instance 782a85d0-b427-4ee2-8d6c-778602f00bcd from the persistent domain config.
Nov 14 01:02:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-27b16ee2-a69e-42a6-b5bd-dbf6fab0af0a tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 782a85d0-b427-4ee2-8d6c-778602f00bcd from the live domain config. {{(pid=74850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 01:02:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-27b16ee2-a69e-42a6-b5bd-dbf6fab0af0a tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:02:57 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:02:57 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 01:02:57 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:02:57 user nova-compute[74850]:   <serial>40c8987b-4ae1-4338-b6da-3d4612c015e1</serial>
Nov 14 01:02:57 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 01:02:57 user nova-compute[74850]: </disk>
Nov 14 01:02:57 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:02:58 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-27b16ee2-a69e-42a6-b5bd-dbf6fab0af0a tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 782a85d0-b427-4ee2-8d6c-778602f00bcd {{(pid=74850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 01:02:58 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:02:58 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:02:58 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:03:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:03:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:03:00 user nova-compute[74850]: DEBUG nova.objects.instance [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lazy-loading 'pci_requests' on Instance uuid 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:03:00 user nova-compute[74850]: DEBUG nova.objects.instance [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lazy-loading 'numa_topology' on Instance uuid 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:03:00 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 01:03:00 user nova-compute[74850]: INFO nova.compute.claims [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Claim successful on node user
Nov 14 01:03:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:00 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:03:00 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:03:00 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:03:00 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:03:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.463s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:03:01 user nova-compute[74850]: INFO nova.network.neutron [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Updating port ee3e224b-fade-4ac4-bb64-1bf1a4df045c with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 01:03:01 user nova-compute[74850]: DEBUG nova.compute.manager [req-bca84207-2299-476f-8094-eee0f877f0f7 req-977297fe-fb29-4aab-9abb-979bedac3eb8 service nova] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Received event network-changed-11d8d21f-e53e-4277-a1d1-36e99c3bcd62 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:03:01 user nova-compute[74850]: DEBUG nova.compute.manager [req-bca84207-2299-476f-8094-eee0f877f0f7 req-977297fe-fb29-4aab-9abb-979bedac3eb8 service nova] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Refreshing instance network info cache due to event network-changed-11d8d21f-e53e-4277-a1d1-36e99c3bcd62. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:03:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-bca84207-2299-476f-8094-eee0f877f0f7 req-977297fe-fb29-4aab-9abb-979bedac3eb8 service nova] Acquiring lock "refresh_cache-748d0da7-bbb9-4e86-aae3-e48b1fa04c14" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:03:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-bca84207-2299-476f-8094-eee0f877f0f7 req-977297fe-fb29-4aab-9abb-979bedac3eb8 service nova] Acquired lock "refresh_cache-748d0da7-bbb9-4e86-aae3-e48b1fa04c14" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:03:01 user nova-compute[74850]: DEBUG nova.network.neutron [req-bca84207-2299-476f-8094-eee0f877f0f7 req-977297fe-fb29-4aab-9abb-979bedac3eb8 service nova] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Refreshing network info cache for port 11d8d21f-e53e-4277-a1d1-36e99c3bcd62 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:03:01 user nova-compute[74850]: DEBUG nova.network.neutron [req-bca84207-2299-476f-8094-eee0f877f0f7 req-977297fe-fb29-4aab-9abb-979bedac3eb8 service nova] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Updated VIF entry in instance network info cache for port 11d8d21f-e53e-4277-a1d1-36e99c3bcd62. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:03:01 user nova-compute[74850]: DEBUG nova.network.neutron [req-bca84207-2299-476f-8094-eee0f877f0f7 req-977297fe-fb29-4aab-9abb-979bedac3eb8 service nova] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Updating instance_info_cache with network_info: [{"id": "11d8d21f-e53e-4277-a1d1-36e99c3bcd62", "address": "fa:16:3e:f2:d6:a0", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d8d21f-e5", "ovs_interfaceid": "11d8d21f-e53e-4277-a1d1-36e99c3bcd62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:03:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-bca84207-2299-476f-8094-eee0f877f0f7 req-977297fe-fb29-4aab-9abb-979bedac3eb8 service nova] Releasing lock "refresh_cache-748d0da7-bbb9-4e86-aae3-e48b1fa04c14" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:03:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "refresh_cache-7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:03:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquired lock "refresh_cache-7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:03:01 user nova-compute[74850]: DEBUG nova.network.neutron [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 01:03:01 user nova-compute[74850]: DEBUG nova.compute.manager [req-049dc3f9-0c8c-4cc0-b259-0186d080c4b9 req-76d10bd3-5585-47c4-86dd-876325f3fb28 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Received event network-changed-ee3e224b-fade-4ac4-bb64-1bf1a4df045c {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:03:01 user nova-compute[74850]: DEBUG nova.compute.manager [req-049dc3f9-0c8c-4cc0-b259-0186d080c4b9 req-76d10bd3-5585-47c4-86dd-876325f3fb28 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Refreshing instance network info cache due to event network-changed-ee3e224b-fade-4ac4-bb64-1bf1a4df045c. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:03:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-049dc3f9-0c8c-4cc0-b259-0186d080c4b9 req-76d10bd3-5585-47c4-86dd-876325f3fb28 service nova] Acquiring lock "refresh_cache-7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:03:01 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:03:01 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:03:01 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 01:03:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:02 user nova-compute[74850]: DEBUG nova.network.neutron [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Updating instance_info_cache with network_info: [{"id": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "address": "fa:16:3e:06:ff:75", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3e224b-fa", "ovs_interfaceid": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:03:02 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Releasing lock "refresh_cache-7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:03:02 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 01:03:02 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Creating image(s)
Nov 14 01:03:02 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "/opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:03:02 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "/opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:03:02 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "/opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:03:02 user nova-compute[74850]: DEBUG nova.objects.instance [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:03:02 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-049dc3f9-0c8c-4cc0-b259-0186d080c4b9 req-76d10bd3-5585-47c4-86dd-876325f3fb28 service nova] Acquired lock "refresh_cache-7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:03:02 user nova-compute[74850]: DEBUG nova.network.neutron [req-049dc3f9-0c8c-4cc0-b259-0186d080c4b9 req-76d10bd3-5585-47c4-86dd-876325f3fb28 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Refreshing network info cache for port ee3e224b-fade-4ac4-bb64-1bf1a4df045c {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:03:02 user nova-compute[74850]: DEBUG nova.objects.base [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Object Instance<7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 01:03:02 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "687b327c6d4447601982509dde3475b3135a2fd6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:03:02 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "687b327c6d4447601982509dde3475b3135a2fd6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:03:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/687b327c6d4447601982509dde3475b3135a2fd6.part --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:03 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:03:03 user nova-compute[74850]: DEBUG nova.compute.manager [req-e16ea499-8ed5-4ae3-9750-bac352466eb2 req-08274dec-ac0b-4c38-87f0-88cc12b2e9c0 service nova] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Received event network-changed-430fc00c-2c5c-4139-8344-47c701006287 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:03:03 user nova-compute[74850]: DEBUG nova.compute.manager [req-e16ea499-8ed5-4ae3-9750-bac352466eb2 req-08274dec-ac0b-4c38-87f0-88cc12b2e9c0 service nova] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Refreshing instance network info cache due to event network-changed-430fc00c-2c5c-4139-8344-47c701006287. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:03:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e16ea499-8ed5-4ae3-9750-bac352466eb2 req-08274dec-ac0b-4c38-87f0-88cc12b2e9c0 service nova] Acquiring lock "refresh_cache-6f0cb80d-dfec-4278-81ff-0e292bad880a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:03:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e16ea499-8ed5-4ae3-9750-bac352466eb2 req-08274dec-ac0b-4c38-87f0-88cc12b2e9c0 service nova] Acquired lock "refresh_cache-6f0cb80d-dfec-4278-81ff-0e292bad880a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:03:03 user nova-compute[74850]: DEBUG nova.network.neutron [req-e16ea499-8ed5-4ae3-9750-bac352466eb2 req-08274dec-ac0b-4c38-87f0-88cc12b2e9c0 service nova] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Refreshing network info cache for port 430fc00c-2c5c-4139-8344-47c701006287 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:03:03 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:03:03 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 01:03:03 user nova-compute[74850]: DEBUG nova.compute.manager [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Stashing vm_state: active {{(pid=74850) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 14 01:03:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/687b327c6d4447601982509dde3475b3135a2fd6.part --force-share --output=json" returned: 0 in 0.185s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:03 user nova-compute[74850]: DEBUG nova.virt.images [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] 5047e287-fdef-4d7d-9a92-fcea553cea55 was qcow2, converting to raw {{(pid=74850) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 01:03:03 user nova-compute[74850]: DEBUG nova.privsep.utils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74850) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 01:03:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/687b327c6d4447601982509dde3475b3135a2fd6.part /opt/stack/data/nova/instances/_base/687b327c6d4447601982509dde3475b3135a2fd6.converted {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "refresh_cache-782a85d0-b427-4ee2-8d6c-778602f00bcd" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:03:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquired lock "refresh_cache-782a85d0-b427-4ee2-8d6c-778602f00bcd" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:03:03 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Forcefully refreshing network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 01:03:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:03:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:03:03 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 01:03:03 user nova-compute[74850]: INFO nova.compute.claims [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Claim successful on node user
Nov 14 01:03:03 user nova-compute[74850]: INFO nova.compute.resource_tracker [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Updating resource usage from migration f37dd344-02f5-4e16-8ff0-d1fefe9f215e
Nov 14 01:03:03 user nova-compute[74850]: DEBUG nova.network.neutron [req-049dc3f9-0c8c-4cc0-b259-0186d080c4b9 req-76d10bd3-5585-47c4-86dd-876325f3fb28 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Updated VIF entry in instance network info cache for port ee3e224b-fade-4ac4-bb64-1bf1a4df045c. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:03:03 user nova-compute[74850]: DEBUG nova.network.neutron [req-049dc3f9-0c8c-4cc0-b259-0186d080c4b9 req-76d10bd3-5585-47c4-86dd-876325f3fb28 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Updating instance_info_cache with network_info: [{"id": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "address": "fa:16:3e:06:ff:75", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3e224b-fa", "ovs_interfaceid": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:03:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-049dc3f9-0c8c-4cc0-b259-0186d080c4b9 req-76d10bd3-5585-47c4-86dd-876325f3fb28 service nova] Releasing lock "refresh_cache-7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:03:04 user nova-compute[74850]: DEBUG nova.network.neutron [req-e16ea499-8ed5-4ae3-9750-bac352466eb2 req-08274dec-ac0b-4c38-87f0-88cc12b2e9c0 service nova] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Updated VIF entry in instance network info cache for port 430fc00c-2c5c-4139-8344-47c701006287. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:03:04 user nova-compute[74850]: DEBUG nova.network.neutron [req-e16ea499-8ed5-4ae3-9750-bac352466eb2 req-08274dec-ac0b-4c38-87f0-88cc12b2e9c0 service nova] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Updating instance_info_cache with network_info: [{"id": "430fc00c-2c5c-4139-8344-47c701006287", "address": "fa:16:3e:ff:f2:a3", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap430fc00c-2c", "ovs_interfaceid": "430fc00c-2c5c-4139-8344-47c701006287", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:03:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/687b327c6d4447601982509dde3475b3135a2fd6.part /opt/stack/data/nova/instances/_base/687b327c6d4447601982509dde3475b3135a2fd6.converted" returned: 0 in 0.529s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/687b327c6d4447601982509dde3475b3135a2fd6.converted --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:04 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e16ea499-8ed5-4ae3-9750-bac352466eb2 req-08274dec-ac0b-4c38-87f0-88cc12b2e9c0 service nova] Releasing lock "refresh_cache-6f0cb80d-dfec-4278-81ff-0e292bad880a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:03:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/687b327c6d4447601982509dde3475b3135a2fd6.converted --force-share --output=json" returned: 0 in 0.202s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:04 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "687b327c6d4447601982509dde3475b3135a2fd6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.183s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:03:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/687b327c6d4447601982509dde3475b3135a2fd6 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:04 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Updating instance_info_cache with network_info: [{"id": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "address": "fa:16:3e:70:96:bf", "network": {"id": "75650b3d-1169-46fa-a1cf-7ae51dd28e18", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227679489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3e629e632d444faf3898681aaafa79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744a9e-48", "ovs_interfaceid": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:03:04 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:03:04 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Releasing lock "refresh_cache-782a85d0-b427-4ee2-8d6c-778602f00bcd" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:03:04 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Updated the network info_cache for instance {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 01:03:04 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:03:04 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.751s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:03:04 user nova-compute[74850]: INFO nova.compute.manager [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Migrating
Nov 14 01:03:04 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "refresh_cache-6f0cb80d-dfec-4278-81ff-0e292bad880a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:03:04 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquired lock "refresh_cache-6f0cb80d-dfec-4278-81ff-0e292bad880a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:03:04 user nova-compute[74850]: DEBUG nova.network.neutron [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 01:03:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/687b327c6d4447601982509dde3475b3135a2fd6 --force-share --output=json" returned: 0 in 0.178s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:04 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "687b327c6d4447601982509dde3475b3135a2fd6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:03:04 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "687b327c6d4447601982509dde3475b3135a2fd6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:03:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/687b327c6d4447601982509dde3475b3135a2fd6 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/687b327c6d4447601982509dde3475b3135a2fd6 --force-share --output=json" returned: 0 in 0.190s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/687b327c6d4447601982509dde3475b3135a2fd6,backing_fmt=raw /opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/687b327c6d4447601982509dde3475b3135a2fd6,backing_fmt=raw /opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/disk 1073741824" returned: 0 in 0.049s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:04 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "687b327c6d4447601982509dde3475b3135a2fd6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:03:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/687b327c6d4447601982509dde3475b3135a2fd6 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/687b327c6d4447601982509dde3475b3135a2fd6 --force-share --output=json" returned: 0 in 0.175s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:05 user nova-compute[74850]: DEBUG nova.objects.instance [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lazy-loading 'migration_context' on Instance uuid 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:03:05 user nova-compute[74850]: DEBUG nova.objects.base [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Object Instance<7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 01:03:05 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Rebasing disk image.
Nov 14 01:03:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:05 user nova-compute[74850]: DEBUG nova.network.neutron [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Updating instance_info_cache with network_info: [{"id": "430fc00c-2c5c-4139-8344-47c701006287", "address": "fa:16:3e:ff:f2:a3", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap430fc00c-2c", "ovs_interfaceid": "430fc00c-2c5c-4139-8344-47c701006287", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:03:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Releasing lock "refresh_cache-6f0cb80d-dfec-4278-81ff-0e292bad880a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:03:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.168s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 -F raw /opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/disk {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:05 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Starting migrate_disk_and_power_off {{(pid=74850) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 14 01:03:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:05 user nova-compute[74850]: DEBUG nova.compute.manager [req-c4af2924-3d6e-4700-9b24-90466e209110 req-abbe1d4b-f8ec-4481-93a5-617cdf6f5cd1 service nova] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Received event network-vif-unplugged-430fc00c-2c5c-4139-8344-47c701006287 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:03:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c4af2924-3d6e-4700-9b24-90466e209110 req-abbe1d4b-f8ec-4481-93a5-617cdf6f5cd1 service nova] Acquiring lock "6f0cb80d-dfec-4278-81ff-0e292bad880a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:03:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c4af2924-3d6e-4700-9b24-90466e209110 req-abbe1d4b-f8ec-4481-93a5-617cdf6f5cd1 service nova] Lock "6f0cb80d-dfec-4278-81ff-0e292bad880a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:03:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c4af2924-3d6e-4700-9b24-90466e209110 req-abbe1d4b-f8ec-4481-93a5-617cdf6f5cd1 service nova] Lock "6f0cb80d-dfec-4278-81ff-0e292bad880a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:03:05 user nova-compute[74850]: DEBUG nova.compute.manager [req-c4af2924-3d6e-4700-9b24-90466e209110 req-abbe1d4b-f8ec-4481-93a5-617cdf6f5cd1 service nova] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] No waiting events found dispatching network-vif-unplugged-430fc00c-2c5c-4139-8344-47c701006287 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:03:05 user nova-compute[74850]: WARNING nova.compute.manager [req-c4af2924-3d6e-4700-9b24-90466e209110 req-abbe1d4b-f8ec-4481-93a5-617cdf6f5cd1 service nova] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Received unexpected event network-vif-unplugged-430fc00c-2c5c-4139-8344-47c701006287 for instance with vm_state active and task_state resize_migrating.
Nov 14 01:03:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:06 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Instance destroyed successfully.
Nov 14 01:03:06 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:01:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-314685057',display_name='tempest-ServerActionsTestOtherA-server-314685057',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-314685057',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEDBs7Es/72p/FM9xIVe3NSPFzUvxLUb0JwmaT04oo+hgQgHwN4cwLNmRX2VhLFhce2UGzsRv1c1pV/ZeRW8oCrRJ/Tmr/k2YN/XTGeAv4iUUyvZpvQioCuIlgWRqA+LA==',key_name='tempest-keypair-638803187',keypairs=<?>,launch_index=0,launched_at=2023-11-14T01:01:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='67d09cd8d15a4b058988fa348d7fdc2e',ramdisk_id='',reservation_id='r-n0nc986k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1680693726',owner_user_name='tempest-ServerActionsTestOtherA-1680693726-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:03:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dab7bcadfc32457e8bfa6fa81cba2702',uuid=6f0cb80d-dfec-4278-81ff-0e292bad880a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "430fc00c-2c5c-4139-8344-47c701006287", "address": "fa:16:3e:ff:f2:a3", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-423241520-network", "vif_mac": "fa:16:3e:ff:f2:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap430fc00c-2c", "ovs_interfaceid": "430fc00c-2c5c-4139-8344-47c701006287", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Converting VIF {"id": "430fc00c-2c5c-4139-8344-47c701006287", "address": "fa:16:3e:ff:f2:a3", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-423241520-network", "vif_mac": "fa:16:3e:ff:f2:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap430fc00c-2c", "ovs_interfaceid": "430fc00c-2c5c-4139-8344-47c701006287", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:f2:a3,bridge_name='br-int',has_traffic_filtering=True,id=430fc00c-2c5c-4139-8344-47c701006287,network=Network(6e563565-dc0c-4f19-9030-742bf28811d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap430fc00c-2c') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG os_vif [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:f2:a3,bridge_name='br-int',has_traffic_filtering=True,id=430fc00c-2c5c-4139-8344-47c701006287,network=Network(6e563565-dc0c-4f19-9030-742bf28811d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap430fc00c-2c') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap430fc00c-2c, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2dd7f27b-09c3-4db0-9bfe-8d3fd50112a0) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:03:06 user nova-compute[74850]: INFO os_vif [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:f2:a3,bridge_name='br-int',has_traffic_filtering=True,id=430fc00c-2c5c-4139-8344-47c701006287,network=Network(6e563565-dc0c-4f19-9030-742bf28811d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap430fc00c-2c')
Nov 14 01:03:06 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IPjahxlF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:03:06 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:03:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0334eb-6fac-4478-b97c-c52ac055bef7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 01:03:06 user nova-compute[74850]: No targets found.
Nov 14 01:03:06 user nova-compute[74850]: iSNS:
Nov 14 01:03:06 user nova-compute[74850]: No targets found.
Nov 14 01:03:06 user nova-compute[74850]: STATIC:
Nov 14 01:03:06 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1
Nov 14 01:03:06 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:03:06 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:03:06 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d
Nov 14 01:03:06 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:03:06 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:03:06 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d
Nov 14 01:03:06 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:03:06 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:03:06 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d
Nov 14 01:03:06 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:03:06 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:03:06 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed
Nov 14 01:03:06 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:03:06 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:03:06 user nova-compute[74850]: FIRMWARE:
Nov 14 01:03:06 user nova-compute[74850]: No targets found.
Nov 14 01:03:06 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 01:03:06 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 01:03:06 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb4e842-30aa-4c07-b9f9-2a0bdc8f7691]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af41e01-e442-49ca-89ec-e2f2111a67ff]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:03:06 user nova-compute[74850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)
Nov 14 01:03:06 user nova-compute[74850]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)
Nov 14 01:03:06 user nova-compute[74850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:03:06 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:03:06 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:03:06 user nova-compute[74850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)
Nov 14 01:03:06 user nova-compute[74850]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)
Nov 14 01:03:06 user nova-compute[74850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:03:06 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:03:06 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a68993be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d'): ({'sde'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Removing single pathed devices sde {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[52db5273-383f-4f8e-90a3-918e3c097961]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fe1b8a-9c8a-40d4-9d1a-60b2bb253b54]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Flushing IO for device /dev/sde {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bdd5f1-be3d-45ea-9c1d-b36f406d4bcd]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adef9f1-6762-4d9e-aca0-801a0c5c4c24]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] SCSI volumes sde have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe2d9db-5bc6-43cb-9560-6663dcc09d14]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ddd5dc-01fe-451f-8af7-7e4010d12868]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d, portal: 172.16.0.220,3260]
Nov 14 01:03:06 user nova-compute[74850]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d, portal: 172.16.0.220,3260] successful.
Nov 14 01:03:06 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c28339-1cc3-4a39-8a08-0c4151f4b6e6]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] <== disconnect_volume: return (334ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 01:03:06 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:03:07 user nova-compute[74850]: DEBUG nova.compute.manager [req-ddeba5e0-0b40-475e-bd79-da8f7d4491c2 req-aa8b0f61-f513-4fdd-84cf-3d77d314df73 service nova] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Received event network-vif-plugged-430fc00c-2c5c-4139-8344-47c701006287 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:03:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ddeba5e0-0b40-475e-bd79-da8f7d4491c2 req-aa8b0f61-f513-4fdd-84cf-3d77d314df73 service nova] Acquiring lock "6f0cb80d-dfec-4278-81ff-0e292bad880a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:03:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ddeba5e0-0b40-475e-bd79-da8f7d4491c2 req-aa8b0f61-f513-4fdd-84cf-3d77d314df73 service nova] Lock "6f0cb80d-dfec-4278-81ff-0e292bad880a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:03:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ddeba5e0-0b40-475e-bd79-da8f7d4491c2 req-aa8b0f61-f513-4fdd-84cf-3d77d314df73 service nova] Lock "6f0cb80d-dfec-4278-81ff-0e292bad880a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:03:07 user nova-compute[74850]: DEBUG nova.compute.manager [req-ddeba5e0-0b40-475e-bd79-da8f7d4491c2 req-aa8b0f61-f513-4fdd-84cf-3d77d314df73 service nova] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] No waiting events found dispatching network-vif-plugged-430fc00c-2c5c-4139-8344-47c701006287 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:03:07 user nova-compute[74850]: WARNING nova.compute.manager [req-ddeba5e0-0b40-475e-bd79-da8f7d4491c2 req-aa8b0f61-f513-4fdd-84cf-3d77d314df73 service nova] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Received unexpected event network-vif-plugged-430fc00c-2c5c-4139-8344-47c701006287 for instance with vm_state active and task_state resize_migrating.
Nov 14 01:03:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 -F raw /opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/disk" returned: 0 in 2.796s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 01:03:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Ensure instance console log exists: /opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 01:03:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:03:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:03:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:03:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Start _get_guest_xml network_info=[{"id": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "address": "fa:16:3e:06:ff:75", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3e224b-fa", "ovs_interfaceid": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='1eb6bde702a6507d8f81a4eabf25237e',container_format='bare',created_at=2023-11-14T01:01:03Z,direct_url=<?>,disk_format='qcow2',id=5047e287-fdef-4d7d-9a92-fcea553cea55,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-589429054-shelved',owner='e396f5de82e54abfa812bf8a7e89b0c4',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T01:01:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '1be5fbb7-3af4-4fab-a30e-7762b7330af9', 'guest_format': None, 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CjhpabUW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e', 'attached_at': '', 'detached_at': '', 'volume_id': '91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7', 'serial': '91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7'}, 'volume_type': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 01:03:08 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:03:08 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:03:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='1eb6bde702a6507d8f81a4eabf25237e',container_format='bare',created_at=2023-11-14T01:01:03Z,direct_url=<?>,disk_format='qcow2',id=5047e287-fdef-4d7d-9a92-fcea553cea55,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-589429054-shelved',owner='e396f5de82e54abfa812bf8a7e89b0c4',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T01:01:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG nova.objects.instance [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG nova.objects.base [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Object Instance<7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CjhpabUW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:03:08 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:03:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:03:08 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:03:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:03:08 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 01:03:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3287f3f3-ea65-49d4-a18d-82bde0e4e85a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 01:03:08 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f102d2f9-3564-4320-858d-f317e64ee09b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7] added
Nov 14 01:03:08 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96f3977-2ca6-4326-bcab-88fe55d50dac]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc74e1ed-85f5-4735-840a-239cb8b2db19]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CjhpabUW {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CjhpabUW" returned: 0 in 0.027s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b825f7d6-614b-4ccc-b3ec-8853c6c52619]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CjhpabUW'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c2cec6-ae98-481e-9e68-545141184bb4]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG nova.network.neutron [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Port 430fc00c-2c5c-4139-8344-47c701006287 binding to destination host user is already ACTIVE {{(pid=74850) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a5eb4c-63b2-4b7e-9ca3-249166ab54c1]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:03:08 user nova-compute[74850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)
Nov 14 01:03:08 user nova-compute[74850]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)
Nov 14 01:03:08 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:03:08 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:03:08 user nova-compute[74850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)
Nov 14 01:03:08 user nova-compute[74850]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)
Nov 14 01:03:08 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:03:08 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c304345-ce0e-46b1-b1d5-0fd040a33db2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7, portal: 172.16.0.220,3260]
Nov 14 01:03:08 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7, portal: 172.16.0.220,3260] successful.
Nov 14 01:03:08 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[601d7eec-2f2f-4535-9183-41650cd16673]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "6f0cb80d-dfec-4278-81ff-0e292bad880a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "6f0cb80d-dfec-4278-81ff-0e292bad880a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "6f0cb80d-dfec-4278-81ff-0e292bad880a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f976dc-5156-47b2-a0e4-af24cce170b8]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:03:08 user nova-compute[74850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)
Nov 14 01:03:08 user nova-compute[74850]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)
Nov 14 01:03:08 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:03:08 user nova-compute[74850]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 (non-flash)
Nov 14 01:03:08 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:03:08 user nova-compute[74850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)
Nov 14 01:03:08 user nova-compute[74850]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)
Nov 14 01:03:08 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:03:08 user nova-compute[74850]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 (non-flash)
Nov 14 01:03:08 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] HCTL ('36', '-', '-', 0) found on session 41 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c59727-6486-42fd-880d-c53963cbc54e]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:03:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CjhpabUW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "refresh_cache-6f0cb80d-dfec-4278-81ff-0e292bad880a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquired lock "refresh_cache-6f0cb80d-dfec-4278-81ff-0e292bad880a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG nova.network.neutron [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '26365356233633232', 'path': '/dev/sde'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365356233633232', 'path': '/dev/sde'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T00:59:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-589429054',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-589429054',id=32,image_ref='5047e287-fdef-4d7d-9a92-fcea553cea55',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-553908575',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:59:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e396f5de82e54abfa812bf8a7e89b0c4',ramdisk_id='',reservation_id='r-s21f41qa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-270753956',owner_user_name='tempest-AttachVolumeShelveTestJSON-270753956-project-member',shelved_at='2023-11-14T01:01:07.653305',shelved_host='user',shelved_image_id='5047e287-fdef-4d7d-9a92-fcea553cea55'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:02:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe8332d8221a49db86a402c5851b4882',uuid=7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "address": "fa:16:3e:06:ff:75", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3e224b-fa", "ovs_interfaceid": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Converting VIF {"id": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "address": "fa:16:3e:06:ff:75", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3e224b-fa", "ovs_interfaceid": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:ff:75,bridge_name='br-int',has_traffic_filtering=True,id=ee3e224b-fade-4ac4-bb64-1bf1a4df045c,network=Network(dfd22096-9f0c-4e0f-aac4-06c224b5b9f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee3e224b-fa') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG nova.objects.instance [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG nova.objects.base [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Object Instance<7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] End _get_guest_xml xml=<domain type="kvm">
Nov 14 01:03:09 user nova-compute[74850]:   <uuid>7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e</uuid>
Nov 14 01:03:09 user nova-compute[74850]:   <name>instance-00000020</name>
Nov 14 01:03:09 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 01:03:09 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 01:03:09 user nova-compute[74850]:   <metadata>
Nov 14 01:03:09 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 01:03:09 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 01:03:09 user nova-compute[74850]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-589429054</nova:name>
Nov 14 01:03:09 user nova-compute[74850]:       <nova:creationTime>2023-11-14 01:03:08</nova:creationTime>
Nov 14 01:03:09 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 01:03:09 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 01:03:09 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 01:03:09 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 01:03:09 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 01:03:09 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 01:03:09 user nova-compute[74850]:       </nova:flavor>
Nov 14 01:03:09 user nova-compute[74850]:       <nova:owner>
Nov 14 01:03:09 user nova-compute[74850]:         <nova:user uuid="fe8332d8221a49db86a402c5851b4882">tempest-AttachVolumeShelveTestJSON-270753956-project-member</nova:user>
Nov 14 01:03:09 user nova-compute[74850]:         <nova:project uuid="e396f5de82e54abfa812bf8a7e89b0c4">tempest-AttachVolumeShelveTestJSON-270753956</nova:project>
Nov 14 01:03:09 user nova-compute[74850]:       </nova:owner>
Nov 14 01:03:09 user nova-compute[74850]:       <nova:root type="image" uuid="5047e287-fdef-4d7d-9a92-fcea553cea55"/>
Nov 14 01:03:09 user nova-compute[74850]:       <nova:ports>
Nov 14 01:03:09 user nova-compute[74850]:         <nova:port uuid="ee3e224b-fade-4ac4-bb64-1bf1a4df045c">
Nov 14 01:03:09 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 01:03:09 user nova-compute[74850]:         </nova:port>
Nov 14 01:03:09 user nova-compute[74850]:       </nova:ports>
Nov 14 01:03:09 user nova-compute[74850]:     </nova:instance>
Nov 14 01:03:09 user nova-compute[74850]:   </metadata>
Nov 14 01:03:09 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 01:03:09 user nova-compute[74850]:     <system>
Nov 14 01:03:09 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 01:03:09 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 01:03:09 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 01:03:09 user nova-compute[74850]:       <entry name="serial">7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e</entry>
Nov 14 01:03:09 user nova-compute[74850]:       <entry name="uuid">7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e</entry>
Nov 14 01:03:09 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 01:03:09 user nova-compute[74850]:     </system>
Nov 14 01:03:09 user nova-compute[74850]:   </sysinfo>
Nov 14 01:03:09 user nova-compute[74850]:   <os>
Nov 14 01:03:09 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 01:03:09 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 01:03:09 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 01:03:09 user nova-compute[74850]:   </os>
Nov 14 01:03:09 user nova-compute[74850]:   <features>
Nov 14 01:03:09 user nova-compute[74850]:     <acpi/>
Nov 14 01:03:09 user nova-compute[74850]:     <apic/>
Nov 14 01:03:09 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 01:03:09 user nova-compute[74850]:   </features>
Nov 14 01:03:09 user nova-compute[74850]:   <clock offset="utc">
Nov 14 01:03:09 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 01:03:09 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 01:03:09 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 01:03:09 user nova-compute[74850]:   </clock>
Nov 14 01:03:09 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 01:03:09 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 01:03:09 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 01:03:09 user nova-compute[74850]:   </cpu>
Nov 14 01:03:09 user nova-compute[74850]:   <devices>
Nov 14 01:03:09 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 01:03:09 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 01:03:09 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/disk"/>
Nov 14 01:03:09 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 01:03:09 user nova-compute[74850]:     </disk>
Nov 14 01:03:09 user nova-compute[74850]:     <disk type="block" device="disk">
Nov 14 01:03:09 user nova-compute[74850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:03:09 user nova-compute[74850]:       <source dev="/dev/sde"/>
Nov 14 01:03:09 user nova-compute[74850]:       <target dev="vdc" bus="virtio"/>
Nov 14 01:03:09 user nova-compute[74850]:       <serial>91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7</serial>
Nov 14 01:03:09 user nova-compute[74850]:     </disk>
Nov 14 01:03:09 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 01:03:09 user nova-compute[74850]:       <mac address="fa:16:3e:06:ff:75"/>
Nov 14 01:03:09 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:03:09 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 01:03:09 user nova-compute[74850]:       <target dev="tapee3e224b-fa"/>
Nov 14 01:03:09 user nova-compute[74850]:     </interface>
Nov 14 01:03:09 user nova-compute[74850]:     <serial type="pty">
Nov 14 01:03:09 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/console.log" append="off"/>
Nov 14 01:03:09 user nova-compute[74850]:     </serial>
Nov 14 01:03:09 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 01:03:09 user nova-compute[74850]:     <video>
Nov 14 01:03:09 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:03:09 user nova-compute[74850]:     </video>
Nov 14 01:03:09 user nova-compute[74850]:     <rng model="virtio">
Nov 14 01:03:09 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 01:03:09 user nova-compute[74850]:     </rng>
Nov 14 01:03:09 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 01:03:09 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 01:03:09 user nova-compute[74850]:       <stats period="10"/>
Nov 14 01:03:09 user nova-compute[74850]:     </memballoon>
Nov 14 01:03:09 user nova-compute[74850]:   </devices>
Nov 14 01:03:09 user nova-compute[74850]: </domain>
Nov 14 01:03:09 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T00:59:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-589429054',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-589429054',id=32,image_ref='5047e287-fdef-4d7d-9a92-fcea553cea55',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-553908575',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:59:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e396f5de82e54abfa812bf8a7e89b0c4',ramdisk_id='',reservation_id='r-s21f41qa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-270753956',owner_user_name='tempest-AttachVolumeShelveTestJSON-270753956-project-member',shelved_at='2023-11-14T01:01:07.653305',shelved_host='user',shelved_image_id='5047e287-fdef-4d7d-9a92-fcea553cea55'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:02:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe8332d8221a49db86a402c5851b4882',uuid=7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "address": "fa:16:3e:06:ff:75", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3e224b-fa", "ovs_interfaceid": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Converting VIF {"id": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "address": "fa:16:3e:06:ff:75", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3e224b-fa", "ovs_interfaceid": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:ff:75,bridge_name='br-int',has_traffic_filtering=True,id=ee3e224b-fade-4ac4-bb64-1bf1a4df045c,network=Network(dfd22096-9f0c-4e0f-aac4-06c224b5b9f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee3e224b-fa') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG os_vif [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:ff:75,bridge_name='br-int',has_traffic_filtering=True,id=ee3e224b-fade-4ac4-bb64-1bf1a4df045c,network=Network(dfd22096-9f0c-4e0f-aac4-06c224b5b9f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee3e224b-fa') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6966a1e4-0100-51ed-8670-af1e7ee2e439', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG nova.network.neutron [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Updating instance_info_cache with network_info: [{"id": "430fc00c-2c5c-4139-8344-47c701006287", "address": "fa:16:3e:ff:f2:a3", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap430fc00c-2c", "ovs_interfaceid": "430fc00c-2c5c-4139-8344-47c701006287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee3e224b-fa, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapee3e224b-fa, col_values=(('qos', UUID('4061fb02-add6-44a6-aaa4-30e575227930')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapee3e224b-fa, col_values=(('external_ids', {'iface-id': 'ee3e224b-fade-4ac4-bb64-1bf1a4df045c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:ff:75', 'vm-uuid': '7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Releasing lock "refresh_cache-6f0cb80d-dfec-4278-81ff-0e292bad880a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:09 user nova-compute[74850]: INFO os_vif [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:ff:75,bridge_name='br-int',has_traffic_filtering=True,id=ee3e224b-fade-4ac4-bb64-1bf1a4df045c,network=Network(dfd22096-9f0c-4e0f-aac4-06c224b5b9f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee3e224b-fa')
Nov 14 01:03:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] No VIF found with MAC fa:16:3e:06:ff:75, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG os_brick.utils [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[534908b7-a0c5-4e46-945b-6e55e82d24ce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d29e898-5c88-4c89-b319-87b9f69fb842]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d232ec-13c8-48cc-adf7-4e46bb5f916a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[528b01d0-841f-4427-871b-d1640895071c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:09 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:03:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 01:03:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:03:10 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 01:03:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[141bf751-bb5f-47e4-b2c1-b71d77d595de]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 01:03:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 01:03:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 01:03:10 user nova-compute[74850]: DEBUG os_brick.utils [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] <== get_connector_properties: return (487ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:03:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:11 user nova-compute[74850]: DEBUG nova.compute.manager [req-a05216ce-00d1-42df-820a-11436d63ba25 req-8b5cca7c-b91f-45c2-a489-e78ffa671809 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Received event network-vif-plugged-ee3e224b-fade-4ac4-bb64-1bf1a4df045c {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:03:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a05216ce-00d1-42df-820a-11436d63ba25 req-8b5cca7c-b91f-45c2-a489-e78ffa671809 service nova] Acquiring lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:03:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a05216ce-00d1-42df-820a-11436d63ba25 req-8b5cca7c-b91f-45c2-a489-e78ffa671809 service nova] Lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:03:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a05216ce-00d1-42df-820a-11436d63ba25 req-8b5cca7c-b91f-45c2-a489-e78ffa671809 service nova] Lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:03:11 user nova-compute[74850]: DEBUG nova.compute.manager [req-a05216ce-00d1-42df-820a-11436d63ba25 req-8b5cca7c-b91f-45c2-a489-e78ffa671809 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] No waiting events found dispatching network-vif-plugged-ee3e224b-fade-4ac4-bb64-1bf1a4df045c {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:03:11 user nova-compute[74850]: WARNING nova.compute.manager [req-a05216ce-00d1-42df-820a-11436d63ba25 req-8b5cca7c-b91f-45c2-a489-e78ffa671809 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Received unexpected event network-vif-plugged-ee3e224b-fade-4ac4-bb64-1bf1a4df045c for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 01:03:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:13 user nova-compute[74850]: DEBUG nova.compute.manager [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 01:03:13 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 01:03:13 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Instance spawned successfully.
Nov 14 01:03:13 user nova-compute[74850]: DEBUG nova.compute.manager [req-19a03611-e426-4cbd-b9bf-243c0bfbe35d req-d801c7a0-d58a-4cb8-b700-b8023aa7ac61 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Received event network-vif-plugged-ee3e224b-fade-4ac4-bb64-1bf1a4df045c {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:03:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-19a03611-e426-4cbd-b9bf-243c0bfbe35d req-d801c7a0-d58a-4cb8-b700-b8023aa7ac61 service nova] Acquiring lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:03:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-19a03611-e426-4cbd-b9bf-243c0bfbe35d req-d801c7a0-d58a-4cb8-b700-b8023aa7ac61 service nova] Lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:03:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-19a03611-e426-4cbd-b9bf-243c0bfbe35d req-d801c7a0-d58a-4cb8-b700-b8023aa7ac61 service nova] Lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:03:13 user nova-compute[74850]: DEBUG nova.compute.manager [req-19a03611-e426-4cbd-b9bf-243c0bfbe35d req-d801c7a0-d58a-4cb8-b700-b8023aa7ac61 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] No waiting events found dispatching network-vif-plugged-ee3e224b-fade-4ac4-bb64-1bf1a4df045c {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:03:13 user nova-compute[74850]: WARNING nova.compute.manager [req-19a03611-e426-4cbd-b9bf-243c0bfbe35d req-d801c7a0-d58a-4cb8-b700-b8023aa7ac61 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Received unexpected event network-vif-plugged-ee3e224b-fade-4ac4-bb64-1bf1a4df045c for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 01:03:13 user nova-compute[74850]: DEBUG nova.compute.manager [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 01:03:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-dfe9662b-6c93-45ab-b4af-6aa029a80add tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 17.650s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Starting finish_migration {{(pid=74850) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Instance directory exists: not creating {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 01:03:14 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Creating image(s)
Nov 14 01:03:14 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Did not create local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Ensure instance console log exists: /opt/stack/data/nova/instances/6f0cb80d-dfec-4278-81ff-0e292bad880a/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Start _get_guest_xml network_info=[{"id": "430fc00c-2c5c-4139-8344-47c701006287", "address": "fa:16:3e:ff:f2:a3", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-423241520-network", "vif_mac": "fa:16:3e:ff:f2:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap430fc00c-2c", "ovs_interfaceid": "430fc00c-2c5c-4139-8344-47c701006287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2b4dc45e-f145-45e8-a25b-f1a8b00ada68', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IPjahxlF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '6f0cb80d-dfec-4278-81ff-0e292bad880a', 'attached_at': '2023-11-14T01:03:14.000000', 'detached_at': '', 'volume_id': '0061b40f-c802-454f-b38b-b74cc014fc2d', 'serial': '0061b40f-c802-454f-b38b-b74cc014fc2d'}, 'volume_type': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 01:03:14 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:03:14 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:03:14 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IPjahxlF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:03:14 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:03:14 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:03:14 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:03:14 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:03:14 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 01:03:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ac3728-dbf3-4af4-9b19-e00cea1c4612]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 01:03:14 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7b444b-38e1-4037-97e4-ac1c71a7c5e1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d] added
Nov 14 01:03:14 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fe4076-5376-4e1b-a3ec-39180ab42ccb]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fc712a-2abc-4d81-9114-d29b9c0d5ee1]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IPjahxlF {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IPjahxlF" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[958c3e62-eb17-49f6-9e1c-d0766fb3a6d5]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IPjahxlF'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a06be8-164f-4112-94a4-92b3372eca29]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8857d157-8877-4ec4-90a6-a4b36634c6d5]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:03:14 user nova-compute[74850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)
Nov 14 01:03:14 user nova-compute[74850]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)
Nov 14 01:03:14 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:03:14 user nova-compute[74850]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 (non-flash)
Nov 14 01:03:14 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:03:14 user nova-compute[74850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)
Nov 14 01:03:14 user nova-compute[74850]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)
Nov 14 01:03:14 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:03:14 user nova-compute[74850]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 (non-flash)
Nov 14 01:03:14 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6771f2-247b-4f90-ad8d-644e78e38f74]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d, portal: 172.16.0.220,3260]
Nov 14 01:03:14 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d, portal: 172.16.0.220,3260] successful.
Nov 14 01:03:14 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:14 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d9b697-0be3-4549-917c-e4048c83557f]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:03:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:15 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76cbc82-d7fb-4811-a9f1-09927fee0d77]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:03:15 user nova-compute[74850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)
Nov 14 01:03:15 user nova-compute[74850]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)
Nov 14 01:03:15 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:03:15 user nova-compute[74850]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 (non-flash)
Nov 14 01:03:15 user nova-compute[74850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:03:15 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:03:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:03:15 user nova-compute[74850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)
Nov 14 01:03:15 user nova-compute[74850]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)
Nov 14 01:03:15 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:03:15 user nova-compute[74850]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 (non-flash)
Nov 14 01:03:15 user nova-compute[74850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:03:15 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:03:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:03:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 01:03:15 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] HCTL ('38', '-', '-', 0) found on session 42 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 01:03:15 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 01:03:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.024s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:15 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[343659f8-7164-444f-8e81-0e948020b79c]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:15 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Searching for a device in session 42 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:03:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IPjahxlF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 01:03:15 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:03:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '26635313330396361', 'path': '/dev/sdg'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:03:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635313330396361', 'path': '/dev/sdg'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 01:03:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:01:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-314685057',display_name='tempest-ServerActionsTestOtherA-server-314685057',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-314685057',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEDBs7Es/72p/FM9xIVe3NSPFzUvxLUb0JwmaT04oo+hgQgHwN4cwLNmRX2VhLFhce2UGzsRv1c1pV/ZeRW8oCrRJ/Tmr/k2YN/XTGeAv4iUUyvZpvQioCuIlgWRqA+LA==',key_name='tempest-keypair-638803187',keypairs=<?>,launch_index=0,launched_at=2023-11-14T01:01:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='67d09cd8d15a4b058988fa348d7fdc2e',ramdisk_id='',reservation_id='r-n0nc986k',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1680693726',owner_user_name='tempest-ServerActionsTestOtherA-1680693726-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:03:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dab7bcadfc32457e8bfa6fa81cba2702',uuid=6f0cb80d-dfec-4278-81ff-0e292bad880a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "430fc00c-2c5c-4139-8344-47c701006287", "address": "fa:16:3e:ff:f2:a3", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-423241520-network", "vif_mac": "fa:16:3e:ff:f2:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap430fc00c-2c", "ovs_interfaceid": "430fc00c-2c5c-4139-8344-47c701006287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 01:03:16 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Converting VIF {"id": "430fc00c-2c5c-4139-8344-47c701006287", "address": "fa:16:3e:ff:f2:a3", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-423241520-network", "vif_mac": "fa:16:3e:ff:f2:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap430fc00c-2c", "ovs_interfaceid": "430fc00c-2c5c-4139-8344-47c701006287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:03:16 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:f2:a3,bridge_name='br-int',has_traffic_filtering=True,id=430fc00c-2c5c-4139-8344-47c701006287,network=Network(6e563565-dc0c-4f19-9030-742bf28811d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap430fc00c-2c') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:03:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 01:03:16 user nova-compute[74850]:   <uuid>6f0cb80d-dfec-4278-81ff-0e292bad880a</uuid>
Nov 14 01:03:16 user nova-compute[74850]:   <name>instance-00000023</name>
Nov 14 01:03:16 user nova-compute[74850]:   <memory>2097152</memory>
Nov 14 01:03:16 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 01:03:16 user nova-compute[74850]:   <metadata>
Nov 14 01:03:16 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 01:03:16 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 01:03:16 user nova-compute[74850]:       <nova:name>tempest-ServerActionsTestOtherA-server-314685057</nova:name>
Nov 14 01:03:16 user nova-compute[74850]:       <nova:creationTime>2023-11-14 01:03:14</nova:creationTime>
Nov 14 01:03:16 user nova-compute[74850]:       <nova:flavor name="m1.small">
Nov 14 01:03:16 user nova-compute[74850]:         <nova:memory>2048</nova:memory>
Nov 14 01:03:16 user nova-compute[74850]:         <nova:disk>20</nova:disk>
Nov 14 01:03:16 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 01:03:16 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 01:03:16 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 01:03:16 user nova-compute[74850]:       </nova:flavor>
Nov 14 01:03:16 user nova-compute[74850]:       <nova:owner>
Nov 14 01:03:16 user nova-compute[74850]:         <nova:user uuid="dab7bcadfc32457e8bfa6fa81cba2702">tempest-ServerActionsTestOtherA-1680693726-project-member</nova:user>
Nov 14 01:03:16 user nova-compute[74850]:         <nova:project uuid="67d09cd8d15a4b058988fa348d7fdc2e">tempest-ServerActionsTestOtherA-1680693726</nova:project>
Nov 14 01:03:16 user nova-compute[74850]:       </nova:owner>
Nov 14 01:03:16 user nova-compute[74850]:       <nova:ports>
Nov 14 01:03:16 user nova-compute[74850]:         <nova:port uuid="430fc00c-2c5c-4139-8344-47c701006287">
Nov 14 01:03:16 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 01:03:16 user nova-compute[74850]:         </nova:port>
Nov 14 01:03:16 user nova-compute[74850]:       </nova:ports>
Nov 14 01:03:16 user nova-compute[74850]:     </nova:instance>
Nov 14 01:03:16 user nova-compute[74850]:   </metadata>
Nov 14 01:03:16 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 01:03:16 user nova-compute[74850]:     <system>
Nov 14 01:03:16 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 01:03:16 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 01:03:16 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 01:03:16 user nova-compute[74850]:       <entry name="serial">6f0cb80d-dfec-4278-81ff-0e292bad880a</entry>
Nov 14 01:03:16 user nova-compute[74850]:       <entry name="uuid">6f0cb80d-dfec-4278-81ff-0e292bad880a</entry>
Nov 14 01:03:16 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 01:03:16 user nova-compute[74850]:     </system>
Nov 14 01:03:16 user nova-compute[74850]:   </sysinfo>
Nov 14 01:03:16 user nova-compute[74850]:   <os>
Nov 14 01:03:16 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 01:03:16 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 01:03:16 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 01:03:16 user nova-compute[74850]:   </os>
Nov 14 01:03:16 user nova-compute[74850]:   <features>
Nov 14 01:03:16 user nova-compute[74850]:     <acpi/>
Nov 14 01:03:16 user nova-compute[74850]:     <apic/>
Nov 14 01:03:16 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 01:03:16 user nova-compute[74850]:   </features>
Nov 14 01:03:16 user nova-compute[74850]:   <clock offset="utc">
Nov 14 01:03:16 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 01:03:16 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 01:03:16 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 01:03:16 user nova-compute[74850]:   </clock>
Nov 14 01:03:16 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 01:03:16 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 01:03:16 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 01:03:16 user nova-compute[74850]:   </cpu>
Nov 14 01:03:16 user nova-compute[74850]:   <devices>
Nov 14 01:03:16 user nova-compute[74850]:     <disk type="block" device="disk">
Nov 14 01:03:16 user nova-compute[74850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:03:16 user nova-compute[74850]:       <source dev="/dev/sdg"/>
Nov 14 01:03:16 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 01:03:16 user nova-compute[74850]:       <serial>0061b40f-c802-454f-b38b-b74cc014fc2d</serial>
Nov 14 01:03:16 user nova-compute[74850]:     </disk>
Nov 14 01:03:16 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 01:03:16 user nova-compute[74850]:       <mac address="fa:16:3e:ff:f2:a3"/>
Nov 14 01:03:16 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:03:16 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 01:03:16 user nova-compute[74850]:       <target dev="tap430fc00c-2c"/>
Nov 14 01:03:16 user nova-compute[74850]:     </interface>
Nov 14 01:03:16 user nova-compute[74850]:     <serial type="pty">
Nov 14 01:03:16 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/6f0cb80d-dfec-4278-81ff-0e292bad880a/console.log" append="off"/>
Nov 14 01:03:16 user nova-compute[74850]:     </serial>
Nov 14 01:03:16 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 01:03:16 user nova-compute[74850]:     <video>
Nov 14 01:03:16 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:03:16 user nova-compute[74850]:     </video>
Nov 14 01:03:16 user nova-compute[74850]:     <rng model="virtio">
Nov 14 01:03:16 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 01:03:16 user nova-compute[74850]:     </rng>
Nov 14 01:03:16 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 01:03:16 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 01:03:16 user nova-compute[74850]:       <stats period="10"/>
Nov 14 01:03:16 user nova-compute[74850]:     </memballoon>
Nov 14 01:03:16 user nova-compute[74850]:   </devices>
Nov 14 01:03:16 user nova-compute[74850]: </domain>
Nov 14 01:03:16 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 01:03:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:01:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-314685057',display_name='tempest-ServerActionsTestOtherA-server-314685057',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-314685057',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEDBs7Es/72p/FM9xIVe3NSPFzUvxLUb0JwmaT04oo+hgQgHwN4cwLNmRX2VhLFhce2UGzsRv1c1pV/ZeRW8oCrRJ/Tmr/k2YN/XTGeAv4iUUyvZpvQioCuIlgWRqA+LA==',key_name='tempest-keypair-638803187',keypairs=<?>,launch_index=0,launched_at=2023-11-14T01:01:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='67d09cd8d15a4b058988fa348d7fdc2e',ramdisk_id='',reservation_id='r-n0nc986k',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1680693726',owner_user_name='tempest-ServerActionsTestOtherA-1680693726-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:03:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dab7bcadfc32457e8bfa6fa81cba2702',uuid=6f0cb80d-dfec-4278-81ff-0e292bad880a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "430fc00c-2c5c-4139-8344-47c701006287", "address": "fa:16:3e:ff:f2:a3", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-423241520-network", "vif_mac": "fa:16:3e:ff:f2:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap430fc00c-2c", "ovs_interfaceid": "430fc00c-2c5c-4139-8344-47c701006287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 01:03:16 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Converting VIF {"id": "430fc00c-2c5c-4139-8344-47c701006287", "address": "fa:16:3e:ff:f2:a3", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-423241520-network", "vif_mac": "fa:16:3e:ff:f2:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap430fc00c-2c", "ovs_interfaceid": "430fc00c-2c5c-4139-8344-47c701006287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:03:16 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:f2:a3,bridge_name='br-int',has_traffic_filtering=True,id=430fc00c-2c5c-4139-8344-47c701006287,network=Network(6e563565-dc0c-4f19-9030-742bf28811d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap430fc00c-2c') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:03:16 user nova-compute[74850]: DEBUG os_vif [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:f2:a3,bridge_name='br-int',has_traffic_filtering=True,id=430fc00c-2c5c-4139-8344-47c701006287,network=Network(6e563565-dc0c-4f19-9030-742bf28811d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap430fc00c-2c') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 01:03:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:03:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 01:03:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '84373182-1d4f-5d9e-8a48-adff3c2bef95', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:03:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:03:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap430fc00c-2c, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:03:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap430fc00c-2c, col_values=(('qos', UUID('9d65467f-8939-40cf-8969-6959df22814f')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:03:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap430fc00c-2c, col_values=(('external_ids', {'iface-id': '430fc00c-2c5c-4139-8344-47c701006287', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:f2:a3', 'vm-uuid': '6f0cb80d-dfec-4278-81ff-0e292bad880a'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:03:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:03:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:16 user nova-compute[74850]: INFO os_vif [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:f2:a3,bridge_name='br-int',has_traffic_filtering=True,id=430fc00c-2c5c-4139-8344-47c701006287,network=Network(6e563565-dc0c-4f19-9030-742bf28811d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap430fc00c-2c')
Nov 14 01:03:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:03:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] No VIF found with MAC fa:16:3e:ff:f2:a3, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:03:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:17 user nova-compute[74850]: DEBUG nova.compute.manager [req-d35be8ca-2f91-479d-9dd7-074bb7b133eb req-8b9fa3d4-727d-4279-8186-735fdb5624d9 service nova] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Received event network-vif-plugged-430fc00c-2c5c-4139-8344-47c701006287 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:03:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d35be8ca-2f91-479d-9dd7-074bb7b133eb req-8b9fa3d4-727d-4279-8186-735fdb5624d9 service nova] Acquiring lock "6f0cb80d-dfec-4278-81ff-0e292bad880a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:03:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d35be8ca-2f91-479d-9dd7-074bb7b133eb req-8b9fa3d4-727d-4279-8186-735fdb5624d9 service nova] Lock "6f0cb80d-dfec-4278-81ff-0e292bad880a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:03:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d35be8ca-2f91-479d-9dd7-074bb7b133eb req-8b9fa3d4-727d-4279-8186-735fdb5624d9 service nova] Lock "6f0cb80d-dfec-4278-81ff-0e292bad880a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:03:17 user nova-compute[74850]: DEBUG nova.compute.manager [req-d35be8ca-2f91-479d-9dd7-074bb7b133eb req-8b9fa3d4-727d-4279-8186-735fdb5624d9 service nova] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] No waiting events found dispatching network-vif-plugged-430fc00c-2c5c-4139-8344-47c701006287 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:03:17 user nova-compute[74850]: WARNING nova.compute.manager [req-d35be8ca-2f91-479d-9dd7-074bb7b133eb req-8b9fa3d4-727d-4279-8186-735fdb5624d9 service nova] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Received unexpected event network-vif-plugged-430fc00c-2c5c-4139-8344-47c701006287 for instance with vm_state active and task_state resize_finish.
Nov 14 01:03:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:18 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-27b16ee2-a69e-42a6-b5bd-dbf6fab0af0a tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 782a85d0-b427-4ee2-8d6c-778602f00bcd is timed out.
Nov 14 01:03:18 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-27b16ee2-a69e-42a6-b5bd-dbf6fab0af0a tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Successfully detached device vdb from instance 782a85d0-b427-4ee2-8d6c-778602f00bcd from the live domain config.
Nov 14 01:03:18 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27b16ee2-a69e-42a6-b5bd-dbf6fab0af0a tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b16ee2-a69e-42a6-b5bd-dbf6fab0af0a tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ePJdMtNr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:03:18 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-27b16ee2-a69e-42a6-b5bd-dbf6fab0af0a tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:03:18 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-27b16ee2-a69e-42a6-b5bd-dbf6fab0af0a tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-27b16ee2-a69e-42a6-b5bd-dbf6fab0af0a tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a0784c-60ff-4097-a645-57ab5242cea0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b16ee2-a69e-42a6-b5bd-dbf6fab0af0a tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 01:03:18 user nova-compute[74850]: No targets found.
Nov 14 01:03:18 user nova-compute[74850]: iSNS:
Nov 14 01:03:18 user nova-compute[74850]: No targets found.
Nov 14 01:03:18 user nova-compute[74850]: STATIC:
Nov 14 01:03:18 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1
Nov 14 01:03:18 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:03:18 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:03:18 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d
Nov 14 01:03:18 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:03:18 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:03:18 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7
Nov 14 01:03:18 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:03:18 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:03:18 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d
Nov 14 01:03:18 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:03:18 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:03:18 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d
Nov 14 01:03:18 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:03:18 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:03:18 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed
Nov 14 01:03:18 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:03:18 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:03:18 user nova-compute[74850]: FIRMWARE:
Nov 14 01:03:18 user nova-compute[74850]: No targets found.
Nov 14 01:03:18 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b16ee2-a69e-42a6-b5bd-dbf6fab0af0a tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 01:03:18 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 01:03:18 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b16ee2-a69e-42a6-b5bd-dbf6fab0af0a tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a6c428-5ad3-4993-9dfe-f8fbf0a33702]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89b2349-e90f-480b-9aea-170781850d0b]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b16ee2-a69e-42a6-b5bd-dbf6fab0af0a tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:03:18 user nova-compute[74850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)
Nov 14 01:03:18 user nova-compute[74850]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)
Nov 14 01:03:18 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:03:18 user nova-compute[74850]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 (non-flash)
Nov 14 01:03:18 user nova-compute[74850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:03:18 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b16ee2-a69e-42a6-b5bd-dbf6fab0af0a tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:03:18 user nova-compute[74850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)
Nov 14 01:03:18 user nova-compute[74850]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 (non-flash)
Nov 14 01:03:18 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:03:18 user nova-compute[74850]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 (non-flash)
Nov 14 01:03:18 user nova-compute[74850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:03:18 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b16ee2-a69e-42a6-b5bd-dbf6fab0af0a tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a3c2eea70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1'): ({'sdb'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-27b16ee2-a69e-42a6-b5bd-dbf6fab0af0a tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Removing single pathed devices sdb {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[115b02ca-e993-4e67-9f0e-b94d213b4683]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68564a5-e647-4420-9704-c2cd56b90ffc]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-27b16ee2-a69e-42a6-b5bd-dbf6fab0af0a tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Flushing IO for device /dev/sdb {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2446fa0e-3c37-4d01-b5cf-7a39a23675fc]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-27b16ee2-a69e-42a6-b5bd-dbf6fab0af0a tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b7f40a-9da9-48be-8c4f-626531cfe493]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-27b16ee2-a69e-42a6-b5bd-dbf6fab0af0a tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-27b16ee2-a69e-42a6-b5bd-dbf6fab0af0a tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b16ee2-a69e-42a6-b5bd-dbf6fab0af0a tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d530878-5d4c-4162-b6dd-276b94ec336d]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b16ee2-a69e-42a6-b5bd-dbf6fab0af0a tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[048e648d-2d2d-4202-bc52-3fb78c87b433]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b16ee2-a69e-42a6-b5bd-dbf6fab0af0a tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1, portal: 172.16.0.220,3260]
Nov 14 01:03:18 user nova-compute[74850]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1, portal: 172.16.0.220,3260] successful.
Nov 14 01:03:18 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40c8987b-4ae1-4338-b6da-3d4612c015e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63f192d-c70d-458c-a62b-2f6dad61384c]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b16ee2-a69e-42a6-b5bd-dbf6fab0af0a tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-27b16ee2-a69e-42a6-b5bd-dbf6fab0af0a tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b16ee2-a69e-42a6-b5bd-dbf6fab0af0a tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] <== disconnect_volume: return (351ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:03:18 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27b16ee2-a69e-42a6-b5bd-dbf6fab0af0a tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 01:03:19 user nova-compute[74850]: DEBUG nova.objects.instance [None req-27b16ee2-a69e-42a6-b5bd-dbf6fab0af0a tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lazy-loading 'flavor' on Instance uuid 782a85d0-b427-4ee2-8d6c-778602f00bcd {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:03:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-27b16ee2-a69e-42a6-b5bd-dbf6fab0af0a tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.835s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:03:19 user nova-compute[74850]: DEBUG nova.compute.manager [req-5ba09697-848d-42eb-b2cc-730fccc55d64 req-d57e05da-abc2-41ae-8ac8-af8c244fb7aa service nova] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Received event network-vif-plugged-430fc00c-2c5c-4139-8344-47c701006287 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:03:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5ba09697-848d-42eb-b2cc-730fccc55d64 req-d57e05da-abc2-41ae-8ac8-af8c244fb7aa service nova] Acquiring lock "6f0cb80d-dfec-4278-81ff-0e292bad880a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:03:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5ba09697-848d-42eb-b2cc-730fccc55d64 req-d57e05da-abc2-41ae-8ac8-af8c244fb7aa service nova] Lock "6f0cb80d-dfec-4278-81ff-0e292bad880a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:03:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5ba09697-848d-42eb-b2cc-730fccc55d64 req-d57e05da-abc2-41ae-8ac8-af8c244fb7aa service nova] Lock "6f0cb80d-dfec-4278-81ff-0e292bad880a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:03:19 user nova-compute[74850]: DEBUG nova.compute.manager [req-5ba09697-848d-42eb-b2cc-730fccc55d64 req-d57e05da-abc2-41ae-8ac8-af8c244fb7aa service nova] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] No waiting events found dispatching network-vif-plugged-430fc00c-2c5c-4139-8344-47c701006287 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:03:19 user nova-compute[74850]: WARNING nova.compute.manager [req-5ba09697-848d-42eb-b2cc-730fccc55d64 req-d57e05da-abc2-41ae-8ac8-af8c244fb7aa service nova] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Received unexpected event network-vif-plugged-430fc00c-2c5c-4139-8344-47c701006287 for instance with vm_state active and task_state resize_finish.
Nov 14 01:03:19 user nova-compute[74850]: DEBUG nova.compute.manager [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 01:03:19 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Instance running successfully.
Nov 14 01:03:19 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Failed to set time: agent not configured {{(pid=74850) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 14 01:03:19 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5a249854-87bf-4e45-a861-3f1f744c82bf tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] finish_migration finished successfully. {{(pid=74850) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 14 01:03:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e7c85e57-026a-4544-92a2-d1318288a97b tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "782a85d0-b427-4ee2-8d6c-778602f00bcd" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:03:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e7c85e57-026a-4544-92a2-d1318288a97b tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:03:20 user nova-compute[74850]: DEBUG nova.compute.manager [None req-e7c85e57-026a-4544-92a2-d1318288a97b tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 01:03:20 user nova-compute[74850]: DEBUG nova.compute.manager [None req-e7c85e57-026a-4544-92a2-d1318288a97b tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74850) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 14 01:03:20 user nova-compute[74850]: DEBUG nova.objects.instance [None req-e7c85e57-026a-4544-92a2-d1318288a97b tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lazy-loading 'flavor' on Instance uuid 782a85d0-b427-4ee2-8d6c-778602f00bcd {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:03:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:21 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Instance destroyed successfully.
Nov 14 01:03:21 user nova-compute[74850]: DEBUG nova.compute.manager [None req-e7c85e57-026a-4544-92a2-d1318288a97b tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 01:03:21 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e0b0704f-d2a4-4094-81cb-8fdd27cf9285 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "2749d176-9c59-493e-b3c3-af5980329041" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:03:21 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e0b0704f-d2a4-4094-81cb-8fdd27cf9285 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "2749d176-9c59-493e-b3c3-af5980329041" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:03:21 user nova-compute[74850]: INFO nova.compute.manager [None req-e0b0704f-d2a4-4094-81cb-8fdd27cf9285 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Detaching volume 9157061b-8883-48dd-9a75-473a4d8b32ed
Nov 14 01:03:21 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e7c85e57-026a-4544-92a2-d1318288a97b tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.099s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:03:21 user nova-compute[74850]: INFO nova.virt.block_device [None req-e0b0704f-d2a4-4094-81cb-8fdd27cf9285 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Attempting to driver detach volume 9157061b-8883-48dd-9a75-473a4d8b32ed from mountpoint /dev/vdb
Nov 14 01:03:21 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e0b0704f-d2a4-4094-81cb-8fdd27cf9285 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Attempting to detach device vdb from instance 2749d176-9c59-493e-b3c3-af5980329041 from the persistent domain config. {{(pid=74850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 01:03:21 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-e0b0704f-d2a4-4094-81cb-8fdd27cf9285 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:03:21 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:03:21 user nova-compute[74850]:   <source dev="/dev/sdd"/>
Nov 14 01:03:21 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:03:21 user nova-compute[74850]:   <serial>9157061b-8883-48dd-9a75-473a4d8b32ed</serial>
Nov 14 01:03:21 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 01:03:21 user nova-compute[74850]: </disk>
Nov 14 01:03:21 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:03:21 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-e0b0704f-d2a4-4094-81cb-8fdd27cf9285 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Successfully detached device vdb from instance 2749d176-9c59-493e-b3c3-af5980329041 from the persistent domain config.
Nov 14 01:03:21 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e0b0704f-d2a4-4094-81cb-8fdd27cf9285 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2749d176-9c59-493e-b3c3-af5980329041 from the live domain config. {{(pid=74850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 01:03:21 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-e0b0704f-d2a4-4094-81cb-8fdd27cf9285 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:03:21 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:03:21 user nova-compute[74850]:   <source dev="/dev/sdd"/>
Nov 14 01:03:21 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:03:21 user nova-compute[74850]:   <serial>9157061b-8883-48dd-9a75-473a4d8b32ed</serial>
Nov 14 01:03:21 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 01:03:21 user nova-compute[74850]: </disk>
Nov 14 01:03:21 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:03:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e0b0704f-d2a4-4094-81cb-8fdd27cf9285 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2749d176-9c59-493e-b3c3-af5980329041 {{(pid=74850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 01:03:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:26 user nova-compute[74850]: DEBUG nova.compute.manager [req-678dbeff-c15f-4a57-bb32-b1dea206807e req-0993732c-0634-47e1-b6cc-cedfecaceb36 service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Received event network-vif-unplugged-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:03:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-678dbeff-c15f-4a57-bb32-b1dea206807e req-0993732c-0634-47e1-b6cc-cedfecaceb36 service nova] Acquiring lock "782a85d0-b427-4ee2-8d6c-778602f00bcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:03:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-678dbeff-c15f-4a57-bb32-b1dea206807e req-0993732c-0634-47e1-b6cc-cedfecaceb36 service nova] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:03:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-678dbeff-c15f-4a57-bb32-b1dea206807e req-0993732c-0634-47e1-b6cc-cedfecaceb36 service nova] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:03:26 user nova-compute[74850]: DEBUG nova.compute.manager [req-678dbeff-c15f-4a57-bb32-b1dea206807e req-0993732c-0634-47e1-b6cc-cedfecaceb36 service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] No waiting events found dispatching network-vif-unplugged-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:03:26 user nova-compute[74850]: WARNING nova.compute.manager [req-678dbeff-c15f-4a57-bb32-b1dea206807e req-0993732c-0634-47e1-b6cc-cedfecaceb36 service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Received unexpected event network-vif-unplugged-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 for instance with vm_state stopped and task_state None.
Nov 14 01:03:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Acquiring lock "dbdb3ee1-4129-4378-8771-a2e8ccff53a4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:03:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "dbdb3ee1-4129-4378-8771-a2e8ccff53a4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:03:27 user nova-compute[74850]: DEBUG nova.compute.manager [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 01:03:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:03:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:03:27 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 01:03:27 user nova-compute[74850]: INFO nova.compute.claims [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Claim successful on node user
Nov 14 01:03:27 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:03:27 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:03:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.414s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:03:27 user nova-compute[74850]: DEBUG nova.compute.manager [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 01:03:27 user nova-compute[74850]: DEBUG nova.compute.manager [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 01:03:27 user nova-compute[74850]: DEBUG nova.network.neutron [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 01:03:27 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 01:03:27 user nova-compute[74850]: DEBUG nova.compute.manager [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 01:03:28 user nova-compute[74850]: DEBUG nova.policy [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7ab31389a2f415eb08ca3ddaae08ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84022f7a63234abba05ae4e88035fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 01:03:28 user nova-compute[74850]: DEBUG nova.compute.manager [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 01:03:28 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 01:03:28 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Creating image(s)
Nov 14 01:03:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Acquiring lock "/opt/stack/data/nova/instances/dbdb3ee1-4129-4378-8771-a2e8ccff53a4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:03:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "/opt/stack/data/nova/instances/dbdb3ee1-4129-4378-8771-a2e8ccff53a4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:03:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "/opt/stack/data/nova/instances/dbdb3ee1-4129-4378-8771-a2e8ccff53a4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:03:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.186s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:03:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:03:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.176s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/dbdb3ee1-4129-4378-8771-a2e8ccff53a4/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/dbdb3ee1-4129-4378-8771-a2e8ccff53a4/disk 1073741824" returned: 0 in 0.055s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:03:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:28 user nova-compute[74850]: DEBUG nova.network.neutron [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Successfully created port: 32218b9b-be7a-426b-b741-f0bdf28a3a2e {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 01:03:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.183s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:28 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dbdb3ee1-4129-4378-8771-a2e8ccff53a4/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 01:03:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbdb3ee1-4129-4378-8771-a2e8ccff53a4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbdb3ee1-4129-4378-8771-a2e8ccff53a4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:28 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Cannot resize image /opt/stack/data/nova/instances/dbdb3ee1-4129-4378-8771-a2e8ccff53a4/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 01:03:28 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 01:03:28 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Ensure instance console log exists: /opt/stack/data/nova/instances/dbdb3ee1-4129-4378-8771-a2e8ccff53a4/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 01:03:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:03:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:03:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:03:28 user nova-compute[74850]: DEBUG nova.compute.manager [req-0f553ce4-ef79-4ceb-a880-e592da4f2edc req-b062596f-aee4-48f6-92bd-a452a146ea6a service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Received event network-vif-plugged-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:03:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-0f553ce4-ef79-4ceb-a880-e592da4f2edc req-b062596f-aee4-48f6-92bd-a452a146ea6a service nova] Acquiring lock "782a85d0-b427-4ee2-8d6c-778602f00bcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:03:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-0f553ce4-ef79-4ceb-a880-e592da4f2edc req-b062596f-aee4-48f6-92bd-a452a146ea6a service nova] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:03:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-0f553ce4-ef79-4ceb-a880-e592da4f2edc req-b062596f-aee4-48f6-92bd-a452a146ea6a service nova] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:03:28 user nova-compute[74850]: DEBUG nova.compute.manager [req-0f553ce4-ef79-4ceb-a880-e592da4f2edc req-b062596f-aee4-48f6-92bd-a452a146ea6a service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] No waiting events found dispatching network-vif-plugged-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:03:28 user nova-compute[74850]: WARNING nova.compute.manager [req-0f553ce4-ef79-4ceb-a880-e592da4f2edc req-b062596f-aee4-48f6-92bd-a452a146ea6a service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Received unexpected event network-vif-plugged-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 for instance with vm_state stopped and task_state None.
Nov 14 01:03:29 user nova-compute[74850]: DEBUG nova.network.neutron [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Successfully updated port: 32218b9b-be7a-426b-b741-f0bdf28a3a2e {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Acquiring lock "refresh_cache-dbdb3ee1-4129-4378-8771-a2e8ccff53a4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Acquired lock "refresh_cache-dbdb3ee1-4129-4378-8771-a2e8ccff53a4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG nova.network.neutron [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG nova.network.neutron [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG nova.network.neutron [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Updating instance_info_cache with network_info: [{"id": "32218b9b-be7a-426b-b741-f0bdf28a3a2e", "address": "fa:16:3e:f1:53:0f", "network": {"id": "e822a969-afbd-4415-a246-324f9b0c98ce", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1543025211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84022f7a63234abba05ae4e88035fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32218b9b-be", "ovs_interfaceid": "32218b9b-be7a-426b-b741-f0bdf28a3a2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Releasing lock "refresh_cache-dbdb3ee1-4129-4378-8771-a2e8ccff53a4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG nova.compute.manager [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Instance network_info: |[{"id": "32218b9b-be7a-426b-b741-f0bdf28a3a2e", "address": "fa:16:3e:f1:53:0f", "network": {"id": "e822a969-afbd-4415-a246-324f9b0c98ce", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1543025211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84022f7a63234abba05ae4e88035fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32218b9b-be", "ovs_interfaceid": "32218b9b-be7a-426b-b741-f0bdf28a3a2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Start _get_guest_xml network_info=[{"id": "32218b9b-be7a-426b-b741-f0bdf28a3a2e", "address": "fa:16:3e:f1:53:0f", "network": {"id": "e822a969-afbd-4415-a246-324f9b0c98ce", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1543025211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84022f7a63234abba05ae4e88035fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32218b9b-be", "ovs_interfaceid": "32218b9b-be7a-426b-b741-f0bdf28a3a2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 01:03:29 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:03:29 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:03:29 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:03:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1019630848',display_name='tempest-VolumesSnapshotTestJSON-instance-1019630848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1019630848',id=38,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHhFrRr6CysDUvL/yVsmnt0+1XIjMZW/b1jWJTSD5PsWcd8zjEasE0kVJeIYxqDiUUv9n0X4vmCMVWyMNiJGx/lyDlCyWWKNReNMzOrs31jsEBkN7hDLzjKsv9gveupfw==',key_name='tempest-keypair-1355653026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84022f7a63234abba05ae4e88035fd34',ramdisk_id='',reservation_id='r-7nmxqeyo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1878797663',owner_user_name='tempest-VolumesSnapshotTestJSON-1878797663-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:03:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7ab31389a2f415eb08ca3ddaae08ddd',uuid=dbdb3ee1-4129-4378-8771-a2e8ccff53a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32218b9b-be7a-426b-b741-f0bdf28a3a2e", "address": "fa:16:3e:f1:53:0f", "network": {"id": "e822a969-afbd-4415-a246-324f9b0c98ce", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1543025211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84022f7a63234abba05ae4e88035fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32218b9b-be", "ovs_interfaceid": "32218b9b-be7a-426b-b741-f0bdf28a3a2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Converting VIF {"id": "32218b9b-be7a-426b-b741-f0bdf28a3a2e", "address": "fa:16:3e:f1:53:0f", "network": {"id": "e822a969-afbd-4415-a246-324f9b0c98ce", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1543025211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84022f7a63234abba05ae4e88035fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32218b9b-be", "ovs_interfaceid": "32218b9b-be7a-426b-b741-f0bdf28a3a2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:53:0f,bridge_name='br-int',has_traffic_filtering=True,id=32218b9b-be7a-426b-b741-f0bdf28a3a2e,network=Network(e822a969-afbd-4415-a246-324f9b0c98ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32218b9b-be') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG nova.objects.instance [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lazy-loading 'pci_devices' on Instance uuid dbdb3ee1-4129-4378-8771-a2e8ccff53a4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] End _get_guest_xml xml=<domain type="kvm">
Nov 14 01:03:29 user nova-compute[74850]:   <uuid>dbdb3ee1-4129-4378-8771-a2e8ccff53a4</uuid>
Nov 14 01:03:29 user nova-compute[74850]:   <name>instance-00000026</name>
Nov 14 01:03:29 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 01:03:29 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 01:03:29 user nova-compute[74850]:   <metadata>
Nov 14 01:03:29 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 01:03:29 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 01:03:29 user nova-compute[74850]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1019630848</nova:name>
Nov 14 01:03:29 user nova-compute[74850]:       <nova:creationTime>2023-11-14 01:03:29</nova:creationTime>
Nov 14 01:03:29 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 01:03:29 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 01:03:29 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 01:03:29 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 01:03:29 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 01:03:29 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 01:03:29 user nova-compute[74850]:       </nova:flavor>
Nov 14 01:03:29 user nova-compute[74850]:       <nova:owner>
Nov 14 01:03:29 user nova-compute[74850]:         <nova:user uuid="d7ab31389a2f415eb08ca3ddaae08ddd">tempest-VolumesSnapshotTestJSON-1878797663-project-member</nova:user>
Nov 14 01:03:29 user nova-compute[74850]:         <nova:project uuid="84022f7a63234abba05ae4e88035fd34">tempest-VolumesSnapshotTestJSON-1878797663</nova:project>
Nov 14 01:03:29 user nova-compute[74850]:       </nova:owner>
Nov 14 01:03:29 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 01:03:29 user nova-compute[74850]:       <nova:ports>
Nov 14 01:03:29 user nova-compute[74850]:         <nova:port uuid="32218b9b-be7a-426b-b741-f0bdf28a3a2e">
Nov 14 01:03:29 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 01:03:29 user nova-compute[74850]:         </nova:port>
Nov 14 01:03:29 user nova-compute[74850]:       </nova:ports>
Nov 14 01:03:29 user nova-compute[74850]:     </nova:instance>
Nov 14 01:03:29 user nova-compute[74850]:   </metadata>
Nov 14 01:03:29 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 01:03:29 user nova-compute[74850]:     <system>
Nov 14 01:03:29 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 01:03:29 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 01:03:29 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 01:03:29 user nova-compute[74850]:       <entry name="serial">dbdb3ee1-4129-4378-8771-a2e8ccff53a4</entry>
Nov 14 01:03:29 user nova-compute[74850]:       <entry name="uuid">dbdb3ee1-4129-4378-8771-a2e8ccff53a4</entry>
Nov 14 01:03:29 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 01:03:29 user nova-compute[74850]:     </system>
Nov 14 01:03:29 user nova-compute[74850]:   </sysinfo>
Nov 14 01:03:29 user nova-compute[74850]:   <os>
Nov 14 01:03:29 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 01:03:29 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 01:03:29 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 01:03:29 user nova-compute[74850]:   </os>
Nov 14 01:03:29 user nova-compute[74850]:   <features>
Nov 14 01:03:29 user nova-compute[74850]:     <acpi/>
Nov 14 01:03:29 user nova-compute[74850]:     <apic/>
Nov 14 01:03:29 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 01:03:29 user nova-compute[74850]:   </features>
Nov 14 01:03:29 user nova-compute[74850]:   <clock offset="utc">
Nov 14 01:03:29 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 01:03:29 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 01:03:29 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 01:03:29 user nova-compute[74850]:   </clock>
Nov 14 01:03:29 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 01:03:29 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 01:03:29 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 01:03:29 user nova-compute[74850]:   </cpu>
Nov 14 01:03:29 user nova-compute[74850]:   <devices>
Nov 14 01:03:29 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 01:03:29 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 01:03:29 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/dbdb3ee1-4129-4378-8771-a2e8ccff53a4/disk"/>
Nov 14 01:03:29 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 01:03:29 user nova-compute[74850]:     </disk>
Nov 14 01:03:29 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 01:03:29 user nova-compute[74850]:       <mac address="fa:16:3e:f1:53:0f"/>
Nov 14 01:03:29 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:03:29 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 01:03:29 user nova-compute[74850]:       <target dev="tap32218b9b-be"/>
Nov 14 01:03:29 user nova-compute[74850]:     </interface>
Nov 14 01:03:29 user nova-compute[74850]:     <serial type="pty">
Nov 14 01:03:29 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/dbdb3ee1-4129-4378-8771-a2e8ccff53a4/console.log" append="off"/>
Nov 14 01:03:29 user nova-compute[74850]:     </serial>
Nov 14 01:03:29 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 01:03:29 user nova-compute[74850]:     <video>
Nov 14 01:03:29 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:03:29 user nova-compute[74850]:     </video>
Nov 14 01:03:29 user nova-compute[74850]:     <rng model="virtio">
Nov 14 01:03:29 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 01:03:29 user nova-compute[74850]:     </rng>
Nov 14 01:03:29 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 01:03:29 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 01:03:29 user nova-compute[74850]:       <stats period="10"/>
Nov 14 01:03:29 user nova-compute[74850]:     </memballoon>
Nov 14 01:03:29 user nova-compute[74850]:   </devices>
Nov 14 01:03:29 user nova-compute[74850]: </domain>
Nov 14 01:03:29 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:03:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1019630848',display_name='tempest-VolumesSnapshotTestJSON-instance-1019630848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1019630848',id=38,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHhFrRr6CysDUvL/yVsmnt0+1XIjMZW/b1jWJTSD5PsWcd8zjEasE0kVJeIYxqDiUUv9n0X4vmCMVWyMNiJGx/lyDlCyWWKNReNMzOrs31jsEBkN7hDLzjKsv9gveupfw==',key_name='tempest-keypair-1355653026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84022f7a63234abba05ae4e88035fd34',ramdisk_id='',reservation_id='r-7nmxqeyo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1878797663',owner_user_name='tempest-VolumesSnapshotTestJSON-1878797663-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:03:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7ab31389a2f415eb08ca3ddaae08ddd',uuid=dbdb3ee1-4129-4378-8771-a2e8ccff53a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32218b9b-be7a-426b-b741-f0bdf28a3a2e", "address": "fa:16:3e:f1:53:0f", "network": {"id": "e822a969-afbd-4415-a246-324f9b0c98ce", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1543025211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84022f7a63234abba05ae4e88035fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32218b9b-be", "ovs_interfaceid": "32218b9b-be7a-426b-b741-f0bdf28a3a2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Converting VIF {"id": "32218b9b-be7a-426b-b741-f0bdf28a3a2e", "address": "fa:16:3e:f1:53:0f", "network": {"id": "e822a969-afbd-4415-a246-324f9b0c98ce", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1543025211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84022f7a63234abba05ae4e88035fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32218b9b-be", "ovs_interfaceid": "32218b9b-be7a-426b-b741-f0bdf28a3a2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:53:0f,bridge_name='br-int',has_traffic_filtering=True,id=32218b9b-be7a-426b-b741-f0bdf28a3a2e,network=Network(e822a969-afbd-4415-a246-324f9b0c98ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32218b9b-be') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG os_vif [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:53:0f,bridge_name='br-int',has_traffic_filtering=True,id=32218b9b-be7a-426b-b741-f0bdf28a3a2e,network=Network(e822a969-afbd-4415-a246-324f9b0c98ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32218b9b-be') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '39e15e03-f4fe-5e45-839b-927e58fc38bf', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32218b9b-be, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap32218b9b-be, col_values=(('qos', UUID('b035c781-60d5-4f02-a55d-e1cf09971359')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap32218b9b-be, col_values=(('external_ids', {'iface-id': '32218b9b-be7a-426b-b741-f0bdf28a3a2e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:53:0f', 'vm-uuid': 'dbdb3ee1-4129-4378-8771-a2e8ccff53a4'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:29 user nova-compute[74850]: INFO os_vif [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:53:0f,bridge_name='br-int',has_traffic_filtering=True,id=32218b9b-be7a-426b-b741-f0bdf28a3a2e,network=Network(e822a969-afbd-4415-a246-324f9b0c98ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32218b9b-be')
Nov 14 01:03:29 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:03:29 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] No VIF found with MAC fa:16:3e:f1:53:0f, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:03:30 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:30 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:30 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:30 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:30 user nova-compute[74850]: DEBUG nova.compute.manager [req-5283dc82-8da1-4c80-8ae0-ea9ebab4a6e8 req-871228e2-a1be-4f96-bf9e-76bac9249fd2 service nova] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Received event network-changed-32218b9b-be7a-426b-b741-f0bdf28a3a2e {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:03:30 user nova-compute[74850]: DEBUG nova.compute.manager [req-5283dc82-8da1-4c80-8ae0-ea9ebab4a6e8 req-871228e2-a1be-4f96-bf9e-76bac9249fd2 service nova] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Refreshing instance network info cache due to event network-changed-32218b9b-be7a-426b-b741-f0bdf28a3a2e. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:03:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5283dc82-8da1-4c80-8ae0-ea9ebab4a6e8 req-871228e2-a1be-4f96-bf9e-76bac9249fd2 service nova] Acquiring lock "refresh_cache-dbdb3ee1-4129-4378-8771-a2e8ccff53a4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:03:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5283dc82-8da1-4c80-8ae0-ea9ebab4a6e8 req-871228e2-a1be-4f96-bf9e-76bac9249fd2 service nova] Acquired lock "refresh_cache-dbdb3ee1-4129-4378-8771-a2e8ccff53a4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:03:30 user nova-compute[74850]: DEBUG nova.network.neutron [req-5283dc82-8da1-4c80-8ae0-ea9ebab4a6e8 req-871228e2-a1be-4f96-bf9e-76bac9249fd2 service nova] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Refreshing network info cache for port 32218b9b-be7a-426b-b741-f0bdf28a3a2e {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:03:31 user nova-compute[74850]: DEBUG nova.compute.manager [req-ca0005e1-e2a6-4196-9fac-2db7ead78200 req-add0371d-6ee6-49b4-b5af-bfe1fa394d55 service nova] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Received event network-vif-plugged-32218b9b-be7a-426b-b741-f0bdf28a3a2e {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:03:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ca0005e1-e2a6-4196-9fac-2db7ead78200 req-add0371d-6ee6-49b4-b5af-bfe1fa394d55 service nova] Acquiring lock "dbdb3ee1-4129-4378-8771-a2e8ccff53a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:03:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ca0005e1-e2a6-4196-9fac-2db7ead78200 req-add0371d-6ee6-49b4-b5af-bfe1fa394d55 service nova] Lock "dbdb3ee1-4129-4378-8771-a2e8ccff53a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:03:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ca0005e1-e2a6-4196-9fac-2db7ead78200 req-add0371d-6ee6-49b4-b5af-bfe1fa394d55 service nova] Lock "dbdb3ee1-4129-4378-8771-a2e8ccff53a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:03:31 user nova-compute[74850]: DEBUG nova.compute.manager [req-ca0005e1-e2a6-4196-9fac-2db7ead78200 req-add0371d-6ee6-49b4-b5af-bfe1fa394d55 service nova] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] No waiting events found dispatching network-vif-plugged-32218b9b-be7a-426b-b741-f0bdf28a3a2e {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:03:31 user nova-compute[74850]: WARNING nova.compute.manager [req-ca0005e1-e2a6-4196-9fac-2db7ead78200 req-add0371d-6ee6-49b4-b5af-bfe1fa394d55 service nova] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Received unexpected event network-vif-plugged-32218b9b-be7a-426b-b741-f0bdf28a3a2e for instance with vm_state building and task_state spawning.
Nov 14 01:03:31 user nova-compute[74850]: DEBUG nova.network.neutron [req-5283dc82-8da1-4c80-8ae0-ea9ebab4a6e8 req-871228e2-a1be-4f96-bf9e-76bac9249fd2 service nova] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Updated VIF entry in instance network info cache for port 32218b9b-be7a-426b-b741-f0bdf28a3a2e. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:03:31 user nova-compute[74850]: DEBUG nova.network.neutron [req-5283dc82-8da1-4c80-8ae0-ea9ebab4a6e8 req-871228e2-a1be-4f96-bf9e-76bac9249fd2 service nova] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Updating instance_info_cache with network_info: [{"id": "32218b9b-be7a-426b-b741-f0bdf28a3a2e", "address": "fa:16:3e:f1:53:0f", "network": {"id": "e822a969-afbd-4415-a246-324f9b0c98ce", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1543025211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84022f7a63234abba05ae4e88035fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32218b9b-be", "ovs_interfaceid": "32218b9b-be7a-426b-b741-f0bdf28a3a2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:03:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5283dc82-8da1-4c80-8ae0-ea9ebab4a6e8 req-871228e2-a1be-4f96-bf9e-76bac9249fd2 service nova] Releasing lock "refresh_cache-dbdb3ee1-4129-4378-8771-a2e8ccff53a4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:03:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:33 user nova-compute[74850]: DEBUG nova.compute.manager [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 01:03:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 01:03:33 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Instance spawned successfully.
Nov 14 01:03:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 01:03:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:03:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:03:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:03:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:03:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:03:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:03:33 user nova-compute[74850]: DEBUG nova.compute.manager [req-18fdf203-b4e0-4e08-a409-5e6bb5247ce2 req-f211f11f-bcf4-46f0-ad43-796ab803308d service nova] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Received event network-vif-plugged-32218b9b-be7a-426b-b741-f0bdf28a3a2e {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:03:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-18fdf203-b4e0-4e08-a409-5e6bb5247ce2 req-f211f11f-bcf4-46f0-ad43-796ab803308d service nova] Acquiring lock "dbdb3ee1-4129-4378-8771-a2e8ccff53a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:03:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-18fdf203-b4e0-4e08-a409-5e6bb5247ce2 req-f211f11f-bcf4-46f0-ad43-796ab803308d service nova] Lock "dbdb3ee1-4129-4378-8771-a2e8ccff53a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:03:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-18fdf203-b4e0-4e08-a409-5e6bb5247ce2 req-f211f11f-bcf4-46f0-ad43-796ab803308d service nova] Lock "dbdb3ee1-4129-4378-8771-a2e8ccff53a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:03:33 user nova-compute[74850]: DEBUG nova.compute.manager [req-18fdf203-b4e0-4e08-a409-5e6bb5247ce2 req-f211f11f-bcf4-46f0-ad43-796ab803308d service nova] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] No waiting events found dispatching network-vif-plugged-32218b9b-be7a-426b-b741-f0bdf28a3a2e {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:03:33 user nova-compute[74850]: WARNING nova.compute.manager [req-18fdf203-b4e0-4e08-a409-5e6bb5247ce2 req-f211f11f-bcf4-46f0-ad43-796ab803308d service nova] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Received unexpected event network-vif-plugged-32218b9b-be7a-426b-b741-f0bdf28a3a2e for instance with vm_state building and task_state spawning.
Nov 14 01:03:33 user nova-compute[74850]: INFO nova.compute.manager [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Took 5.11 seconds to spawn the instance on the hypervisor.
Nov 14 01:03:33 user nova-compute[74850]: DEBUG nova.compute.manager [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 01:03:33 user nova-compute[74850]: INFO nova.compute.manager [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Took 5.88 seconds to build instance.
Nov 14 01:03:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-777f351a-09b1-4762-98b3-cbe14e2e4a3c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "dbdb3ee1-4129-4378-8771-a2e8ccff53a4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.977s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:03:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:42 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-e0b0704f-d2a4-4094-81cb-8fdd27cf9285 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2749d176-9c59-493e-b3c3-af5980329041 is timed out.
Nov 14 01:03:42 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-e0b0704f-d2a4-4094-81cb-8fdd27cf9285 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Successfully detached device vdb from instance 2749d176-9c59-493e-b3c3-af5980329041 from the live domain config.
Nov 14 01:03:42 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0b0704f-d2a4-4094-81cb-8fdd27cf9285 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0704f-d2a4-4094-81cb-8fdd27cf9285 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GYVDUWaQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:03:42 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-e0b0704f-d2a4-4094-81cb-8fdd27cf9285 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:03:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-e0b0704f-d2a4-4094-81cb-8fdd27cf9285 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-e0b0704f-d2a4-4094-81cb-8fdd27cf9285 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe868db-bfc4-4d1b-9cd5-2a3a8e7fa4b5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0704f-d2a4-4094-81cb-8fdd27cf9285 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 01:03:42 user nova-compute[74850]: No targets found.
Nov 14 01:03:42 user nova-compute[74850]: iSNS:
Nov 14 01:03:42 user nova-compute[74850]: No targets found.
Nov 14 01:03:42 user nova-compute[74850]: STATIC:
Nov 14 01:03:42 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d
Nov 14 01:03:42 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:03:42 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:03:42 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7
Nov 14 01:03:42 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:03:42 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:03:42 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d
Nov 14 01:03:42 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:03:42 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:03:42 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d
Nov 14 01:03:42 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:03:42 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:03:42 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed
Nov 14 01:03:42 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:03:42 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:03:42 user nova-compute[74850]: FIRMWARE:
Nov 14 01:03:42 user nova-compute[74850]: No targets found.
Nov 14 01:03:42 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0704f-d2a4-4094-81cb-8fdd27cf9285 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 01:03:42 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 01:03:42 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0704f-d2a4-4094-81cb-8fdd27cf9285 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a58b1ec-9ac5-4ef4-99e8-98a72b3f7df7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bf00ad-667b-4536-978c-c2196481f77f]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0704f-d2a4-4094-81cb-8fdd27cf9285 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:03:42 user nova-compute[74850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)
Nov 14 01:03:42 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:03:42 user nova-compute[74850]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 (non-flash)
Nov 14 01:03:42 user nova-compute[74850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:03:42 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0704f-d2a4-4094-81cb-8fdd27cf9285 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:03:42 user nova-compute[74850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed (non-flash)
Nov 14 01:03:42 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:03:42 user nova-compute[74850]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 (non-flash)
Nov 14 01:03:42 user nova-compute[74850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:03:42 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0704f-d2a4-4094-81cb-8fdd27cf9285 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a3c2edf30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed'): ({'sdd'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-e0b0704f-d2a4-4094-81cb-8fdd27cf9285 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Removing single pathed devices sdd {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff81021-312d-42d7-b2d4-6f73e6bfea02]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[92de7c3d-0120-4c6d-b32b-e37e1356c7c6]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-e0b0704f-d2a4-4094-81cb-8fdd27cf9285 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Flushing IO for device /dev/sdd {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[028f984f-60a9-42ac-85d4-082761a5c3eb]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-e0b0704f-d2a4-4094-81cb-8fdd27cf9285 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa836c1c-4783-4902-a5f3-0f4df7bf5fa9]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-e0b0704f-d2a4-4094-81cb-8fdd27cf9285 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-e0b0704f-d2a4-4094-81cb-8fdd27cf9285 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] SCSI volumes sdd have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0704f-d2a4-4094-81cb-8fdd27cf9285 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0e9c76-f7ab-490c-afdb-e1fcccf0eefd]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0704f-d2a4-4094-81cb-8fdd27cf9285 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[29654a11-7b0a-4bfe-9e3a-5cdc01943fe0]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0704f-d2a4-4094-81cb-8fdd27cf9285 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed, portal: 172.16.0.220,3260]
Nov 14 01:03:42 user nova-compute[74850]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed, portal: 172.16.0.220,3260] successful.
Nov 14 01:03:42 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9157061b-8883-48dd-9a75-473a4d8b32ed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde87470-2608-450b-aaff-bedfd89fe7c6]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0704f-d2a4-4094-81cb-8fdd27cf9285 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-e0b0704f-d2a4-4094-81cb-8fdd27cf9285 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0704f-d2a4-4094-81cb-8fdd27cf9285 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] <== disconnect_volume: return (319ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:03:42 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0b0704f-d2a4-4094-81cb-8fdd27cf9285 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 01:03:43 user nova-compute[74850]: DEBUG nova.objects.instance [None req-e0b0704f-d2a4-4094-81cb-8fdd27cf9285 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lazy-loading 'flavor' on Instance uuid 2749d176-9c59-493e-b3c3-af5980329041 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:03:43 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e0b0704f-d2a4-4094-81cb-8fdd27cf9285 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "2749d176-9c59-493e-b3c3-af5980329041" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.040s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:03:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:51 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:03:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:03:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:03:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:03:51 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 01:03:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:03:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2749d176-9c59-493e-b3c3-af5980329041/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2749d176-9c59-493e-b3c3-af5980329041/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2749d176-9c59-493e-b3c3-af5980329041/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2749d176-9c59-493e-b3c3-af5980329041/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:03:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:03:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbdb3ee1-4129-4378-8771-a2e8ccff53a4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbdb3ee1-4129-4378-8771-a2e8ccff53a4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbdb3ee1-4129-4378-8771-a2e8ccff53a4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbdb3ee1-4129-4378-8771-a2e8ccff53a4/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:54 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:54 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:03:55 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:03:55 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:03:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=7768MB free_disk=25.02786636352539GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 01:03:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:03:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:03:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Applying migration context for instance 6f0cb80d-dfec-4278-81ff-0e292bad880a as it has an incoming, in-progress migration f37dd344-02f5-4e16-8ff0-d1fefe9f215e. Migration status is finished {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 01:03:55 user nova-compute[74850]: INFO nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Updating resource usage from migration f37dd344-02f5-4e16-8ff0-d1fefe9f215e
Nov 14 01:03:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 748d0da7-bbb9-4e86-aae3-e48b1fa04c14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:03:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance c7952bff-87d6-46c1-a6d4-7729dc4893ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:03:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 702746f7-305f-4eac-a71a-6c08b7cbccd8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:03:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 782a85d0-b427-4ee2-8d6c-778602f00bcd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:03:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 2749d176-9c59-493e-b3c3-af5980329041 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:03:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 3504ddd3-bdd8-465e-aec5-190acdd563f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:03:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 998f2d6a-e3b6-4135-9485-b042a5e094c4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:03:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:03:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Migration f37dd344-02f5-4e16-8ff0-d1fefe9f215e is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 01:03:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 6f0cb80d-dfec-4278-81ff-0e292bad880a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:03:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance dbdb3ee1-4129-4378-8771-a2e8ccff53a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:03:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 01:03:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 01:03:55 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:03:55 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:03:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 01:03:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.474s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:03:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:03:56 user nova-compute[74850]: DEBUG nova.compute.manager [None req-e24bf92e-e362-4b9f-b327-a28fae9e9042 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 01:03:56 user nova-compute[74850]: INFO nova.compute.manager [None req-e24bf92e-e362-4b9f-b327-a28fae9e9042 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] instance snapshotting
Nov 14 01:03:56 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-e24bf92e-e362-4b9f-b327-a28fae9e9042 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Beginning live snapshot process
Nov 14 01:03:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e24bf92e-e362-4b9f-b327-a28fae9e9042 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json -f qcow2 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e24bf92e-e362-4b9f-b327-a28fae9e9042 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json -f qcow2" returned: 0 in 0.168s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e24bf92e-e362-4b9f-b327-a28fae9e9042 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json -f qcow2 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e24bf92e-e362-4b9f-b327-a28fae9e9042 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e24bf92e-e362-4b9f-b327-a28fae9e9042 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e24bf92e-e362-4b9f-b327-a28fae9e9042 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.171s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e24bf92e-e362-4b9f-b327-a28fae9e9042 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphbiylasu/408da1458e4c49ba926e1311dd8ac35d.delta 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e24bf92e-e362-4b9f-b327-a28fae9e9042 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphbiylasu/408da1458e4c49ba926e1311dd8ac35d.delta 1073741824" returned: 0 in 0.047s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:03:57 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-e24bf92e-e362-4b9f-b327-a28fae9e9042 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 01:03:58 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-e24bf92e-e362-4b9f-b327-a28fae9e9042 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] COPY block job progress, current cursor: 65536 final cursor: 75497472 {{(pid=74850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 01:03:58 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-e24bf92e-e362-4b9f-b327-a28fae9e9042 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] COPY block job progress, current cursor: 25231360 final cursor: 75497472 {{(pid=74850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 01:03:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-e24bf92e-e362-4b9f-b327-a28fae9e9042 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 01:03:59 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-e24bf92e-e362-4b9f-b327-a28fae9e9042 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 01:03:59 user nova-compute[74850]: DEBUG nova.privsep.utils [None req-e24bf92e-e362-4b9f-b327-a28fae9e9042 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74850) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 01:03:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e24bf92e-e362-4b9f-b327-a28fae9e9042 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphbiylasu/408da1458e4c49ba926e1311dd8ac35d.delta /opt/stack/data/nova/instances/snapshots/tmphbiylasu/408da1458e4c49ba926e1311dd8ac35d {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:03:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e24bf92e-e362-4b9f-b327-a28fae9e9042 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphbiylasu/408da1458e4c49ba926e1311dd8ac35d.delta /opt/stack/data/nova/instances/snapshots/tmphbiylasu/408da1458e4c49ba926e1311dd8ac35d" returned: 0 in 0.820s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:04:00 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-e24bf92e-e362-4b9f-b327-a28fae9e9042 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Snapshot extracted, beginning image upload
Nov 14 01:04:00 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:04:00 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:04:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:00 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:04:01 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:04:01 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:04:01 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:04:01 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 01:04:02 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-e24bf92e-e362-4b9f-b327-a28fae9e9042 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Snapshot image upload complete
Nov 14 01:04:02 user nova-compute[74850]: INFO nova.compute.manager [None req-e24bf92e-e362-4b9f-b327-a28fae9e9042 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Took 5.76 seconds to snapshot the instance on the hypervisor.
Nov 14 01:04:02 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:04:02 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 01:04:02 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Didn't find any instances for network info cache update. {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 01:04:02 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:04:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:04:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74850) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 01:04:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:04:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:04:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fbd612c4-7f9b-4ac3-89fd-9dddc9aab735 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "2749d176-9c59-493e-b3c3-af5980329041" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:04:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fbd612c4-7f9b-4ac3-89fd-9dddc9aab735 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "2749d176-9c59-493e-b3c3-af5980329041" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:04:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fbd612c4-7f9b-4ac3-89fd-9dddc9aab735 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "2749d176-9c59-493e-b3c3-af5980329041-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:04:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fbd612c4-7f9b-4ac3-89fd-9dddc9aab735 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "2749d176-9c59-493e-b3c3-af5980329041-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:04:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fbd612c4-7f9b-4ac3-89fd-9dddc9aab735 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "2749d176-9c59-493e-b3c3-af5980329041-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:04:11 user nova-compute[74850]: INFO nova.compute.manager [None req-fbd612c4-7f9b-4ac3-89fd-9dddc9aab735 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Terminating instance
Nov 14 01:04:11 user nova-compute[74850]: DEBUG nova.compute.manager [None req-fbd612c4-7f9b-4ac3-89fd-9dddc9aab735 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 01:04:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:12 user nova-compute[74850]: DEBUG nova.compute.manager [req-adf0beba-8a08-4872-a6b2-dd7956c70e39 req-0c0bb9fd-8397-47c5-b38a-20f29d7af5c1 service nova] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Received event network-vif-unplugged-021a5c27-b8d3-492f-b536-69e13aae8216 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:04:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-adf0beba-8a08-4872-a6b2-dd7956c70e39 req-0c0bb9fd-8397-47c5-b38a-20f29d7af5c1 service nova] Acquiring lock "2749d176-9c59-493e-b3c3-af5980329041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:04:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-adf0beba-8a08-4872-a6b2-dd7956c70e39 req-0c0bb9fd-8397-47c5-b38a-20f29d7af5c1 service nova] Lock "2749d176-9c59-493e-b3c3-af5980329041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:04:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-adf0beba-8a08-4872-a6b2-dd7956c70e39 req-0c0bb9fd-8397-47c5-b38a-20f29d7af5c1 service nova] Lock "2749d176-9c59-493e-b3c3-af5980329041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:04:12 user nova-compute[74850]: DEBUG nova.compute.manager [req-adf0beba-8a08-4872-a6b2-dd7956c70e39 req-0c0bb9fd-8397-47c5-b38a-20f29d7af5c1 service nova] [instance: 2749d176-9c59-493e-b3c3-af5980329041] No waiting events found dispatching network-vif-unplugged-021a5c27-b8d3-492f-b536-69e13aae8216 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:04:12 user nova-compute[74850]: DEBUG nova.compute.manager [req-adf0beba-8a08-4872-a6b2-dd7956c70e39 req-0c0bb9fd-8397-47c5-b38a-20f29d7af5c1 service nova] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Received event network-vif-unplugged-021a5c27-b8d3-492f-b536-69e13aae8216 for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 01:04:12 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Instance destroyed successfully.
Nov 14 01:04:12 user nova-compute[74850]: DEBUG nova.objects.instance [None req-fbd612c4-7f9b-4ac3-89fd-9dddc9aab735 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lazy-loading 'resources' on Instance uuid 2749d176-9c59-493e-b3c3-af5980329041 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:04:12 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-fbd612c4-7f9b-4ac3-89fd-9dddc9aab735 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:58:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1605490917',display_name='tempest-AttachVolumeNegativeTest-server-1605490917',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1605490917',id=31,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLpBY92Em/Y+DF81kuDBnosgwSxcAXqsnW32pYf5a3o2cZY/5eLk1T7zgqDAS/T4yRRyDs2nbdPCYLTEOXLF18X7DWo/x+V8pcN0r5N1UqQ891bevyfqI6wIrYYrJQExA==',key_name='tempest-keypair-1782448778',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:58:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35f609057d1e44679838d565d80cade3',ramdisk_id='',reservation_id='r-ti4qyqg7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1995397455',owner_user_name='tempest-AttachVolumeNegativeTest-1995397455-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:58:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb027592ab214b57b389227a97576a43',uuid=2749d176-9c59-493e-b3c3-af5980329041,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "021a5c27-b8d3-492f-b536-69e13aae8216", "address": "fa:16:3e:77:48:ae", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021a5c27-b8", "ovs_interfaceid": "021a5c27-b8d3-492f-b536-69e13aae8216", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 01:04:12 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-fbd612c4-7f9b-4ac3-89fd-9dddc9aab735 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Converting VIF {"id": "021a5c27-b8d3-492f-b536-69e13aae8216", "address": "fa:16:3e:77:48:ae", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021a5c27-b8", "ovs_interfaceid": "021a5c27-b8d3-492f-b536-69e13aae8216", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:04:12 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-fbd612c4-7f9b-4ac3-89fd-9dddc9aab735 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:48:ae,bridge_name='br-int',has_traffic_filtering=True,id=021a5c27-b8d3-492f-b536-69e13aae8216,network=Network(11208f55-0e63-4c33-a12c-e061c8061eec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021a5c27-b8') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:04:12 user nova-compute[74850]: DEBUG os_vif [None req-fbd612c4-7f9b-4ac3-89fd-9dddc9aab735 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:48:ae,bridge_name='br-int',has_traffic_filtering=True,id=021a5c27-b8d3-492f-b536-69e13aae8216,network=Network(11208f55-0e63-4c33-a12c-e061c8061eec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021a5c27-b8') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 01:04:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap021a5c27-b8, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:04:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:04:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d3548db4-712b-4da4-97f8-b54abdf46ca5) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:04:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:04:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:12 user nova-compute[74850]: INFO os_vif [None req-fbd612c4-7f9b-4ac3-89fd-9dddc9aab735 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:48:ae,bridge_name='br-int',has_traffic_filtering=True,id=021a5c27-b8d3-492f-b536-69e13aae8216,network=Network(11208f55-0e63-4c33-a12c-e061c8061eec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021a5c27-b8')
Nov 14 01:04:12 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-fbd612c4-7f9b-4ac3-89fd-9dddc9aab735 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Deleting instance files /opt/stack/data/nova/instances/2749d176-9c59-493e-b3c3-af5980329041_del
Nov 14 01:04:12 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-fbd612c4-7f9b-4ac3-89fd-9dddc9aab735 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Deletion of /opt/stack/data/nova/instances/2749d176-9c59-493e-b3c3-af5980329041_del complete
Nov 14 01:04:12 user nova-compute[74850]: INFO nova.compute.manager [None req-fbd612c4-7f9b-4ac3-89fd-9dddc9aab735 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 01:04:12 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-fbd612c4-7f9b-4ac3-89fd-9dddc9aab735 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 01:04:12 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 01:04:12 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 2749d176-9c59-493e-b3c3-af5980329041] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 01:04:13 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:04:13 user nova-compute[74850]: DEBUG nova.compute.manager [req-4acb4e13-1411-4040-a975-723822119972 req-bea8d5ff-4b7a-4481-bf30-6a6807960709 service nova] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Received event network-vif-deleted-021a5c27-b8d3-492f-b536-69e13aae8216 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:04:13 user nova-compute[74850]: INFO nova.compute.manager [req-4acb4e13-1411-4040-a975-723822119972 req-bea8d5ff-4b7a-4481-bf30-6a6807960709 service nova] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Neutron deleted interface 021a5c27-b8d3-492f-b536-69e13aae8216; detaching it from the instance and deleting it from the info cache
Nov 14 01:04:13 user nova-compute[74850]: DEBUG nova.network.neutron [req-4acb4e13-1411-4040-a975-723822119972 req-bea8d5ff-4b7a-4481-bf30-6a6807960709 service nova] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:04:13 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Took 0.98 seconds to deallocate network for instance.
Nov 14 01:04:13 user nova-compute[74850]: DEBUG nova.compute.manager [req-4acb4e13-1411-4040-a975-723822119972 req-bea8d5ff-4b7a-4481-bf30-6a6807960709 service nova] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Detach interface failed, port_id=021a5c27-b8d3-492f-b536-69e13aae8216, reason: Instance 2749d176-9c59-493e-b3c3-af5980329041 could not be found. {{(pid=74850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 01:04:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fbd612c4-7f9b-4ac3-89fd-9dddc9aab735 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:04:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fbd612c4-7f9b-4ac3-89fd-9dddc9aab735 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:04:14 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-fbd612c4-7f9b-4ac3-89fd-9dddc9aab735 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:04:14 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-fbd612c4-7f9b-4ac3-89fd-9dddc9aab735 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:04:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fbd612c4-7f9b-4ac3-89fd-9dddc9aab735 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.307s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:04:14 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-fbd612c4-7f9b-4ac3-89fd-9dddc9aab735 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Deleted allocations for instance 2749d176-9c59-493e-b3c3-af5980329041
Nov 14 01:04:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-fbd612c4-7f9b-4ac3-89fd-9dddc9aab735 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "2749d176-9c59-493e-b3c3-af5980329041" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.329s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:04:14 user nova-compute[74850]: DEBUG nova.compute.manager [req-056d54f3-9994-4a1f-a76a-b98a0c3647a1 req-a39429a9-3d44-476a-8cc6-028a3d19daaf service nova] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Received event network-vif-plugged-021a5c27-b8d3-492f-b536-69e13aae8216 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:04:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-056d54f3-9994-4a1f-a76a-b98a0c3647a1 req-a39429a9-3d44-476a-8cc6-028a3d19daaf service nova] Acquiring lock "2749d176-9c59-493e-b3c3-af5980329041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:04:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-056d54f3-9994-4a1f-a76a-b98a0c3647a1 req-a39429a9-3d44-476a-8cc6-028a3d19daaf service nova] Lock "2749d176-9c59-493e-b3c3-af5980329041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:04:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-056d54f3-9994-4a1f-a76a-b98a0c3647a1 req-a39429a9-3d44-476a-8cc6-028a3d19daaf service nova] Lock "2749d176-9c59-493e-b3c3-af5980329041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:04:14 user nova-compute[74850]: DEBUG nova.compute.manager [req-056d54f3-9994-4a1f-a76a-b98a0c3647a1 req-a39429a9-3d44-476a-8cc6-028a3d19daaf service nova] [instance: 2749d176-9c59-493e-b3c3-af5980329041] No waiting events found dispatching network-vif-plugged-021a5c27-b8d3-492f-b536-69e13aae8216 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:04:14 user nova-compute[74850]: WARNING nova.compute.manager [req-056d54f3-9994-4a1f-a76a-b98a0c3647a1 req-a39429a9-3d44-476a-8cc6-028a3d19daaf service nova] [instance: 2749d176-9c59-493e-b3c3-af5980329041] Received unexpected event network-vif-plugged-021a5c27-b8d3-492f-b536-69e13aae8216 for instance with vm_state deleted and task_state None.
Nov 14 01:04:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:04:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74850) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 01:04:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:04:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:04:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:31 user nova-compute[74850]: DEBUG nova.compute.manager [req-ef38dacb-0cc8-4275-9335-b3b937b97275 req-8e0c77ef-98be-4a7e-bf23-4a95e4ae9da2 service nova] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Received event network-changed-080e37ec-a952-4eb5-bc53-578a3fe28094 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:04:31 user nova-compute[74850]: DEBUG nova.compute.manager [req-ef38dacb-0cc8-4275-9335-b3b937b97275 req-8e0c77ef-98be-4a7e-bf23-4a95e4ae9da2 service nova] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Refreshing instance network info cache due to event network-changed-080e37ec-a952-4eb5-bc53-578a3fe28094. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:04:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ef38dacb-0cc8-4275-9335-b3b937b97275 req-8e0c77ef-98be-4a7e-bf23-4a95e4ae9da2 service nova] Acquiring lock "refresh_cache-998f2d6a-e3b6-4135-9485-b042a5e094c4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:04:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ef38dacb-0cc8-4275-9335-b3b937b97275 req-8e0c77ef-98be-4a7e-bf23-4a95e4ae9da2 service nova] Acquired lock "refresh_cache-998f2d6a-e3b6-4135-9485-b042a5e094c4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:04:31 user nova-compute[74850]: DEBUG nova.network.neutron [req-ef38dacb-0cc8-4275-9335-b3b937b97275 req-8e0c77ef-98be-4a7e-bf23-4a95e4ae9da2 service nova] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Refreshing network info cache for port 080e37ec-a952-4eb5-bc53-578a3fe28094 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:04:31 user nova-compute[74850]: DEBUG nova.network.neutron [req-ef38dacb-0cc8-4275-9335-b3b937b97275 req-8e0c77ef-98be-4a7e-bf23-4a95e4ae9da2 service nova] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Updated VIF entry in instance network info cache for port 080e37ec-a952-4eb5-bc53-578a3fe28094. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:04:31 user nova-compute[74850]: DEBUG nova.network.neutron [req-ef38dacb-0cc8-4275-9335-b3b937b97275 req-8e0c77ef-98be-4a7e-bf23-4a95e4ae9da2 service nova] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Updating instance_info_cache with network_info: [{"id": "080e37ec-a952-4eb5-bc53-578a3fe28094", "address": "fa:16:3e:d6:bb:bd", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap080e37ec-a9", "ovs_interfaceid": "080e37ec-a952-4eb5-bc53-578a3fe28094", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:04:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ef38dacb-0cc8-4275-9335-b3b937b97275 req-8e0c77ef-98be-4a7e-bf23-4a95e4ae9da2 service nova] Releasing lock "refresh_cache-998f2d6a-e3b6-4135-9485-b042a5e094c4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:04:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:04:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74850) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 01:04:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:04:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:04:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "b6c2a1f5-1cf1-489b-8100-325833c9a42f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:04:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "b6c2a1f5-1cf1-489b-8100-325833c9a42f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:04:37 user nova-compute[74850]: DEBUG nova.compute.manager [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 01:04:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:04:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:04:37 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 01:04:37 user nova-compute[74850]: INFO nova.compute.claims [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Claim successful on node user
Nov 14 01:04:37 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:04:37 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:04:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:04:37 user nova-compute[74850]: DEBUG nova.compute.manager [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 01:04:37 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 01:04:37 user nova-compute[74850]: DEBUG nova.compute.manager [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 01:04:37 user nova-compute[74850]: DEBUG nova.network.neutron [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 01:04:37 user nova-compute[74850]: DEBUG nova.compute.manager [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 01:04:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:37 user nova-compute[74850]: INFO nova.virt.block_device [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Booting with volume snapshot e979e84d-6555-4ec7-9cf9-f5b5d252c4e4 at /dev/vda
Nov 14 01:04:37 user nova-compute[74850]: DEBUG nova.policy [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c91ddcee4e54a769eb626c816596bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb1eb4b5fc841d1952b8db9ae05e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 01:04:38 user nova-compute[74850]: DEBUG nova.network.neutron [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Successfully created port: 212d8fe5-766d-46b8-9ea1-8e2127519282 {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 01:04:38 user nova-compute[74850]: DEBUG nova.network.neutron [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Successfully updated port: 212d8fe5-766d-46b8-9ea1-8e2127519282 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 01:04:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "refresh_cache-b6c2a1f5-1cf1-489b-8100-325833c9a42f" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:04:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquired lock "refresh_cache-b6c2a1f5-1cf1-489b-8100-325833c9a42f" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:04:39 user nova-compute[74850]: DEBUG nova.network.neutron [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 01:04:39 user nova-compute[74850]: DEBUG nova.compute.manager [req-42e8a1a7-01a5-4f0c-adcd-0ecdd522e035 req-6a3b4f9a-7ca1-4d80-80b7-ba35a8038bff service nova] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Received event network-changed-212d8fe5-766d-46b8-9ea1-8e2127519282 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:04:39 user nova-compute[74850]: DEBUG nova.compute.manager [req-42e8a1a7-01a5-4f0c-adcd-0ecdd522e035 req-6a3b4f9a-7ca1-4d80-80b7-ba35a8038bff service nova] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Refreshing instance network info cache due to event network-changed-212d8fe5-766d-46b8-9ea1-8e2127519282. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:04:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-42e8a1a7-01a5-4f0c-adcd-0ecdd522e035 req-6a3b4f9a-7ca1-4d80-80b7-ba35a8038bff service nova] Acquiring lock "refresh_cache-b6c2a1f5-1cf1-489b-8100-325833c9a42f" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:04:39 user nova-compute[74850]: DEBUG nova.network.neutron [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 01:04:39 user nova-compute[74850]: DEBUG nova.network.neutron [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Updating instance_info_cache with network_info: [{"id": "212d8fe5-766d-46b8-9ea1-8e2127519282", "address": "fa:16:3e:53:56:58", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap212d8fe5-76", "ovs_interfaceid": "212d8fe5-766d-46b8-9ea1-8e2127519282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:04:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Releasing lock "refresh_cache-b6c2a1f5-1cf1-489b-8100-325833c9a42f" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:04:39 user nova-compute[74850]: DEBUG nova.compute.manager [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Instance network_info: |[{"id": "212d8fe5-766d-46b8-9ea1-8e2127519282", "address": "fa:16:3e:53:56:58", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap212d8fe5-76", "ovs_interfaceid": "212d8fe5-766d-46b8-9ea1-8e2127519282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 01:04:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-42e8a1a7-01a5-4f0c-adcd-0ecdd522e035 req-6a3b4f9a-7ca1-4d80-80b7-ba35a8038bff service nova] Acquired lock "refresh_cache-b6c2a1f5-1cf1-489b-8100-325833c9a42f" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:04:39 user nova-compute[74850]: DEBUG nova.network.neutron [req-42e8a1a7-01a5-4f0c-adcd-0ecdd522e035 req-6a3b4f9a-7ca1-4d80-80b7-ba35a8038bff service nova] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Refreshing network info cache for port 212d8fe5-766d-46b8-9ea1-8e2127519282 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:04:39 user nova-compute[74850]: DEBUG nova.network.neutron [req-42e8a1a7-01a5-4f0c-adcd-0ecdd522e035 req-6a3b4f9a-7ca1-4d80-80b7-ba35a8038bff service nova] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Updated VIF entry in instance network info cache for port 212d8fe5-766d-46b8-9ea1-8e2127519282. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:04:39 user nova-compute[74850]: DEBUG nova.network.neutron [req-42e8a1a7-01a5-4f0c-adcd-0ecdd522e035 req-6a3b4f9a-7ca1-4d80-80b7-ba35a8038bff service nova] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Updating instance_info_cache with network_info: [{"id": "212d8fe5-766d-46b8-9ea1-8e2127519282", "address": "fa:16:3e:53:56:58", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap212d8fe5-76", "ovs_interfaceid": "212d8fe5-766d-46b8-9ea1-8e2127519282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:04:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-42e8a1a7-01a5-4f0c-adcd-0ecdd522e035 req-6a3b4f9a-7ca1-4d80-80b7-ba35a8038bff service nova] Releasing lock "refresh_cache-b6c2a1f5-1cf1-489b-8100-325833c9a42f" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:04:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:43 user nova-compute[74850]: DEBUG os_brick.utils [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:04:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:04:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:04:43 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddfc93d-728f-44c7-b4b2-d5aad3445d48]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:04:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:04:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:04:43 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff875a8-edc1-4742-8ba3-f6b0a84608f7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:04:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:04:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:04:43 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c18e501-cd5a-415d-9a31-089bcd0da3bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:04:43 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[748f21fc-a7af-4d4e-b107-43c733eb9dea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:04:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:04:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:04:43 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 01:04:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:04:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:04:43 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 01:04:43 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58ba94a-c5d9-43aa-95b1-533aa36755bb]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:04:43 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 01:04:43 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 01:04:43 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 01:04:43 user nova-compute[74850]: DEBUG os_brick.utils [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:04:43 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Updating existing volume attachment record: d6e0d1be-b2e5-4098-a62c-ffed61f97cdd {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 01:04:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f1a2170b-1952-4899-ab06-5918eea8bdec tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:04:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f1a2170b-1952-4899-ab06-5918eea8bdec tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:04:46 user nova-compute[74850]: INFO nova.compute.manager [None req-f1a2170b-1952-4899-ab06-5918eea8bdec tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Detaching volume 91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7
Nov 14 01:04:46 user nova-compute[74850]: INFO nova.virt.block_device [None req-f1a2170b-1952-4899-ab06-5918eea8bdec tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Attempting to driver detach volume 91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 from mountpoint /dev/vdc
Nov 14 01:04:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-f1a2170b-1952-4899-ab06-5918eea8bdec tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Attempting to detach device vdc from instance 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e from the persistent domain config. {{(pid=74850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 01:04:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-f1a2170b-1952-4899-ab06-5918eea8bdec tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:04:46 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:04:46 user nova-compute[74850]:   <source dev="/dev/sde"/>
Nov 14 01:04:46 user nova-compute[74850]:   <target dev="vdc" bus="virtio"/>
Nov 14 01:04:46 user nova-compute[74850]:   <serial>91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7</serial>
Nov 14 01:04:46 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 01:04:46 user nova-compute[74850]: </disk>
Nov 14 01:04:46 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:04:46 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-f1a2170b-1952-4899-ab06-5918eea8bdec tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Successfully detached device vdc from instance 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e from the persistent domain config.
Nov 14 01:04:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-f1a2170b-1952-4899-ab06-5918eea8bdec tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e from the live domain config. {{(pid=74850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 01:04:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-f1a2170b-1952-4899-ab06-5918eea8bdec tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:04:46 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:04:46 user nova-compute[74850]:   <source dev="/dev/sde"/>
Nov 14 01:04:46 user nova-compute[74850]:   <target dev="vdc" bus="virtio"/>
Nov 14 01:04:46 user nova-compute[74850]:   <serial>91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7</serial>
Nov 14 01:04:46 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 01:04:46 user nova-compute[74850]: </disk>
Nov 14 01:04:46 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:04:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-f1a2170b-1952-4899-ab06-5918eea8bdec tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e {{(pid=74850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 01:04:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:47 user nova-compute[74850]: DEBUG nova.compute.manager [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 01:04:47 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 01:04:47 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Creating image(s)
Nov 14 01:04:47 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Did not create local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 01:04:47 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Ensure instance console log exists: /opt/stack/data/nova/instances/b6c2a1f5-1cf1-489b-8100-325833c9a42f/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Start _get_guest_xml network_info=[{"id": "212d8fe5-766d-46b8-9ea1-8e2127519282", "address": "fa:16:3e:53:56:58", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap212d8fe5-76", "ovs_interfaceid": "212d8fe5-766d-46b8-9ea1-8e2127519282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-14T01:04:33Z,direct_url=<?>,disk_format='qcow2',id=4991ba75-d413-4c65-91b6-64223678da1c,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1255157750',owner='fdb1eb4b5fc841d1952b8db9ae05e446',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-14T01:04:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd6e0d1be-b2e5-4098-a62c-ffed61f97cdd', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WyOGSUHz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b6c2a1f5-1cf1-489b-8100-325833c9a42f', 'attached_at': '', 'detached_at': '', 'volume_id': '4119b2fa-608f-4679-b0cb-0a9fb73c9b4f', 'serial': '4119b2fa-608f-4679-b0cb-0a9fb73c9b4f'}, 'volume_type': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 01:04:48 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:04:48 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:04:48 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-14T01:04:33Z,direct_url=<?>,disk_format='qcow2',id=4991ba75-d413-4c65-91b6-64223678da1c,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1255157750',owner='fdb1eb4b5fc841d1952b8db9ae05e446',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-14T01:04:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WyOGSUHz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:04:48 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:04:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:04:48 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:04:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:04:48 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 01:04:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ecbd0c-b57a-49be-a02a-74713e0d0e08]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 01:04:48 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7d61f2-4877-4f48-a5b3-713c52cf7811]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f] added
Nov 14 01:04:48 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[675ce656-6430-4914-8c4e-2ca60bfeae7d]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f15d7b6-8331-4d70-86a6-cf0e05a7f32f]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WyOGSUHz {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WyOGSUHz" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ad646a-2501-4024-9aa0-7740e3566d2b]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WyOGSUHz'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8e3f0b-4af1-4b6e-965d-993829712d48]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[331f334d-6fa7-4374-bf6f-403cb7649e1f]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:04:48 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:04:48 user nova-compute[74850]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 (non-flash)
Nov 14 01:04:48 user nova-compute[74850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:04:48 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:04:48 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:04:48 user nova-compute[74850]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 (non-flash)
Nov 14 01:04:48 user nova-compute[74850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:04:48 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0199a9d9-562e-41c2-b4cb-42082e39cf2b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f, portal: 172.16.0.220,3260]
Nov 14 01:04:48 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f, portal: 172.16.0.220,3260] successful.
Nov 14 01:04:48 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[914c635a-32d9-4e8d-8f64-b07571a946ee]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b03aeec-da73-47ad-8805-36ba8ecb6d21]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:04:48 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:04:48 user nova-compute[74850]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 (non-flash)
Nov 14 01:04:48 user nova-compute[74850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:04:48 user nova-compute[74850]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f (non-flash)
Nov 14 01:04:48 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:04:48 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:04:48 user nova-compute[74850]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 (non-flash)
Nov 14 01:04:48 user nova-compute[74850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:04:48 user nova-compute[74850]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f (non-flash)
Nov 14 01:04:48 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[accbecd3-93f8-4f96-90d6-bcb60c5157b0]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:04:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WyOGSUHz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 01:04:49 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:04:49 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23766653863633239', 'path': '/dev/sdb'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:04:49 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766653863633239', 'path': '/dev/sdb'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 01:04:49 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:04:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-349198214',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-349198214',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-349198214',id=39,image_ref='4991ba75-d413-4c65-91b6-64223678da1c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrQLa6nPznAFIXCLtN7Qn08ramo6AGebbzjXDkjAZvsUhmESOZUJqVSmYCony8eeSOdX4aGxqxLMlIpg7p76OXRoYvyHZG+FpZHGrLjFFIwpfpsov9cSRPrWeiQNvUd7A==',key_name='tempest-keypair-1566661028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdb1eb4b5fc841d1952b8db9ae05e446',ramdisk_id='',reservation_id='r-dlugt778',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1536334624',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1536334624-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1536334624',owner_user_name='tempest-TestVolumeBootPattern-1536334624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c91ddcee4e54a769eb626c816596bed',uuid=b6c2a1f5-1cf1-489b-8100-325833c9a42f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "212d8fe5-766d-46b8-9ea1-8e2127519282", "address": "fa:16:3e:53:56:58", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap212d8fe5-76", "ovs_interfaceid": "212d8fe5-766d-46b8-9ea1-8e2127519282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 01:04:49 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Converting VIF {"id": "212d8fe5-766d-46b8-9ea1-8e2127519282", "address": "fa:16:3e:53:56:58", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap212d8fe5-76", "ovs_interfaceid": "212d8fe5-766d-46b8-9ea1-8e2127519282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:04:49 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:56:58,bridge_name='br-int',has_traffic_filtering=True,id=212d8fe5-766d-46b8-9ea1-8e2127519282,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap212d8fe5-76') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:04:49 user nova-compute[74850]: DEBUG nova.objects.instance [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lazy-loading 'pci_devices' on Instance uuid b6c2a1f5-1cf1-489b-8100-325833c9a42f {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:04:49 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] End _get_guest_xml xml=<domain type="kvm">
Nov 14 01:04:49 user nova-compute[74850]:   <uuid>b6c2a1f5-1cf1-489b-8100-325833c9a42f</uuid>
Nov 14 01:04:49 user nova-compute[74850]:   <name>instance-00000027</name>
Nov 14 01:04:49 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 01:04:49 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 01:04:49 user nova-compute[74850]:   <metadata>
Nov 14 01:04:49 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 01:04:49 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 01:04:49 user nova-compute[74850]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-349198214</nova:name>
Nov 14 01:04:49 user nova-compute[74850]:       <nova:creationTime>2023-11-14 01:04:48</nova:creationTime>
Nov 14 01:04:49 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 01:04:49 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 01:04:49 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 01:04:49 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 01:04:49 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 01:04:49 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 01:04:49 user nova-compute[74850]:       </nova:flavor>
Nov 14 01:04:49 user nova-compute[74850]:       <nova:owner>
Nov 14 01:04:49 user nova-compute[74850]:         <nova:user uuid="6c91ddcee4e54a769eb626c816596bed">tempest-TestVolumeBootPattern-1536334624-project-member</nova:user>
Nov 14 01:04:49 user nova-compute[74850]:         <nova:project uuid="fdb1eb4b5fc841d1952b8db9ae05e446">tempest-TestVolumeBootPattern-1536334624</nova:project>
Nov 14 01:04:49 user nova-compute[74850]:       </nova:owner>
Nov 14 01:04:49 user nova-compute[74850]:       <nova:root type="image" uuid="4991ba75-d413-4c65-91b6-64223678da1c"/>
Nov 14 01:04:49 user nova-compute[74850]:       <nova:ports>
Nov 14 01:04:49 user nova-compute[74850]:         <nova:port uuid="212d8fe5-766d-46b8-9ea1-8e2127519282">
Nov 14 01:04:49 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 01:04:49 user nova-compute[74850]:         </nova:port>
Nov 14 01:04:49 user nova-compute[74850]:       </nova:ports>
Nov 14 01:04:49 user nova-compute[74850]:     </nova:instance>
Nov 14 01:04:49 user nova-compute[74850]:   </metadata>
Nov 14 01:04:49 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 01:04:49 user nova-compute[74850]:     <system>
Nov 14 01:04:49 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 01:04:49 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 01:04:49 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 01:04:49 user nova-compute[74850]:       <entry name="serial">b6c2a1f5-1cf1-489b-8100-325833c9a42f</entry>
Nov 14 01:04:49 user nova-compute[74850]:       <entry name="uuid">b6c2a1f5-1cf1-489b-8100-325833c9a42f</entry>
Nov 14 01:04:49 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 01:04:49 user nova-compute[74850]:     </system>
Nov 14 01:04:49 user nova-compute[74850]:   </sysinfo>
Nov 14 01:04:49 user nova-compute[74850]:   <os>
Nov 14 01:04:49 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 01:04:49 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 01:04:49 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 01:04:49 user nova-compute[74850]:   </os>
Nov 14 01:04:49 user nova-compute[74850]:   <features>
Nov 14 01:04:49 user nova-compute[74850]:     <acpi/>
Nov 14 01:04:49 user nova-compute[74850]:     <apic/>
Nov 14 01:04:49 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 01:04:49 user nova-compute[74850]:   </features>
Nov 14 01:04:49 user nova-compute[74850]:   <clock offset="utc">
Nov 14 01:04:49 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 01:04:49 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 01:04:49 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 01:04:49 user nova-compute[74850]:   </clock>
Nov 14 01:04:49 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 01:04:49 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 01:04:49 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 01:04:49 user nova-compute[74850]:   </cpu>
Nov 14 01:04:49 user nova-compute[74850]:   <devices>
Nov 14 01:04:49 user nova-compute[74850]:     <disk type="block" device="disk">
Nov 14 01:04:49 user nova-compute[74850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:04:49 user nova-compute[74850]:       <source dev="/dev/sdb"/>
Nov 14 01:04:49 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 01:04:49 user nova-compute[74850]:       <serial>4119b2fa-608f-4679-b0cb-0a9fb73c9b4f</serial>
Nov 14 01:04:49 user nova-compute[74850]:     </disk>
Nov 14 01:04:49 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 01:04:49 user nova-compute[74850]:       <mac address="fa:16:3e:53:56:58"/>
Nov 14 01:04:49 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:04:49 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 01:04:49 user nova-compute[74850]:       <target dev="tap212d8fe5-76"/>
Nov 14 01:04:49 user nova-compute[74850]:     </interface>
Nov 14 01:04:49 user nova-compute[74850]:     <serial type="pty">
Nov 14 01:04:49 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/b6c2a1f5-1cf1-489b-8100-325833c9a42f/console.log" append="off"/>
Nov 14 01:04:49 user nova-compute[74850]:     </serial>
Nov 14 01:04:49 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 01:04:49 user nova-compute[74850]:     <video>
Nov 14 01:04:49 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:04:49 user nova-compute[74850]:     </video>
Nov 14 01:04:49 user nova-compute[74850]:     <rng model="virtio">
Nov 14 01:04:49 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 01:04:49 user nova-compute[74850]:     </rng>
Nov 14 01:04:49 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 01:04:49 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 01:04:49 user nova-compute[74850]:       <stats period="10"/>
Nov 14 01:04:49 user nova-compute[74850]:     </memballoon>
Nov 14 01:04:49 user nova-compute[74850]:   </devices>
Nov 14 01:04:49 user nova-compute[74850]: </domain>
Nov 14 01:04:49 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 01:04:49 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:04:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-349198214',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-349198214',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-349198214',id=39,image_ref='4991ba75-d413-4c65-91b6-64223678da1c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrQLa6nPznAFIXCLtN7Qn08ramo6AGebbzjXDkjAZvsUhmESOZUJqVSmYCony8eeSOdX4aGxqxLMlIpg7p76OXRoYvyHZG+FpZHGrLjFFIwpfpsov9cSRPrWeiQNvUd7A==',key_name='tempest-keypair-1566661028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdb1eb4b5fc841d1952b8db9ae05e446',ramdisk_id='',reservation_id='r-dlugt778',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1536334624',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1536334624-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1536334624',owner_user_name='tempest-TestVolumeBootPattern-1536334624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c91ddcee4e54a769eb626c816596bed',uuid=b6c2a1f5-1cf1-489b-8100-325833c9a42f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "212d8fe5-766d-46b8-9ea1-8e2127519282", "address": "fa:16:3e:53:56:58", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap212d8fe5-76", "ovs_interfaceid": "212d8fe5-766d-46b8-9ea1-8e2127519282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 01:04:49 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Converting VIF {"id": "212d8fe5-766d-46b8-9ea1-8e2127519282", "address": "fa:16:3e:53:56:58", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap212d8fe5-76", "ovs_interfaceid": "212d8fe5-766d-46b8-9ea1-8e2127519282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:04:49 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:56:58,bridge_name='br-int',has_traffic_filtering=True,id=212d8fe5-766d-46b8-9ea1-8e2127519282,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap212d8fe5-76') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:04:49 user nova-compute[74850]: DEBUG os_vif [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:56:58,bridge_name='br-int',has_traffic_filtering=True,id=212d8fe5-766d-46b8-9ea1-8e2127519282,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap212d8fe5-76') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 01:04:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:04:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 01:04:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2d72a01d-b86c-57e5-9a22-e8c348e6a14e', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:04:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:04:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap212d8fe5-76, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:04:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap212d8fe5-76, col_values=(('qos', UUID('1fa2ca22-2058-4e4e-a6d4-50abdff7bc69')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:04:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap212d8fe5-76, col_values=(('external_ids', {'iface-id': '212d8fe5-766d-46b8-9ea1-8e2127519282', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:56:58', 'vm-uuid': 'b6c2a1f5-1cf1-489b-8100-325833c9a42f'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:04:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:04:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:49 user nova-compute[74850]: INFO os_vif [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:56:58,bridge_name='br-int',has_traffic_filtering=True,id=212d8fe5-766d-46b8-9ea1-8e2127519282,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap212d8fe5-76')
Nov 14 01:04:49 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:04:49 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] No VIF found with MAC fa:16:3e:53:56:58, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:04:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:51 user nova-compute[74850]: DEBUG nova.compute.manager [req-734ba848-0cf8-4d56-850f-0fce50fc2eeb req-2c49abd2-d7f1-43b7-9cda-07e9c9ac7608 service nova] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Received event network-vif-plugged-212d8fe5-766d-46b8-9ea1-8e2127519282 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:04:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-734ba848-0cf8-4d56-850f-0fce50fc2eeb req-2c49abd2-d7f1-43b7-9cda-07e9c9ac7608 service nova] Acquiring lock "b6c2a1f5-1cf1-489b-8100-325833c9a42f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:04:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-734ba848-0cf8-4d56-850f-0fce50fc2eeb req-2c49abd2-d7f1-43b7-9cda-07e9c9ac7608 service nova] Lock "b6c2a1f5-1cf1-489b-8100-325833c9a42f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:04:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-734ba848-0cf8-4d56-850f-0fce50fc2eeb req-2c49abd2-d7f1-43b7-9cda-07e9c9ac7608 service nova] Lock "b6c2a1f5-1cf1-489b-8100-325833c9a42f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:04:51 user nova-compute[74850]: DEBUG nova.compute.manager [req-734ba848-0cf8-4d56-850f-0fce50fc2eeb req-2c49abd2-d7f1-43b7-9cda-07e9c9ac7608 service nova] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] No waiting events found dispatching network-vif-plugged-212d8fe5-766d-46b8-9ea1-8e2127519282 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:04:51 user nova-compute[74850]: WARNING nova.compute.manager [req-734ba848-0cf8-4d56-850f-0fce50fc2eeb req-2c49abd2-d7f1-43b7-9cda-07e9c9ac7608 service nova] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Received unexpected event network-vif-plugged-212d8fe5-766d-46b8-9ea1-8e2127519282 for instance with vm_state building and task_state spawning.
Nov 14 01:04:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f4a33d61-5468-4933-a11a-01a7acfd5915 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "6f0cb80d-dfec-4278-81ff-0e292bad880a" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:04:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f4a33d61-5468-4933-a11a-01a7acfd5915 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "6f0cb80d-dfec-4278-81ff-0e292bad880a" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:04:52 user nova-compute[74850]: DEBUG nova.compute.manager [None req-f4a33d61-5468-4933-a11a-01a7acfd5915 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Going to confirm migration 2 {{(pid=74850) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 14 01:04:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f4a33d61-5468-4933-a11a-01a7acfd5915 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "refresh_cache-6f0cb80d-dfec-4278-81ff-0e292bad880a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:04:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f4a33d61-5468-4933-a11a-01a7acfd5915 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquired lock "refresh_cache-6f0cb80d-dfec-4278-81ff-0e292bad880a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:04:52 user nova-compute[74850]: DEBUG nova.network.neutron [None req-f4a33d61-5468-4933-a11a-01a7acfd5915 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 01:04:52 user nova-compute[74850]: DEBUG nova.objects.instance [None req-f4a33d61-5468-4933-a11a-01a7acfd5915 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lazy-loading 'info_cache' on Instance uuid 6f0cb80d-dfec-4278-81ff-0e292bad880a {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:04:52 user nova-compute[74850]: DEBUG nova.compute.manager [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 01:04:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 01:04:52 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Instance spawned successfully.
Nov 14 01:04:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 01:04:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:04:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:04:52 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:04:52 user nova-compute[74850]: INFO nova.compute.manager [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Took 4.93 seconds to spawn the instance on the hypervisor.
Nov 14 01:04:52 user nova-compute[74850]: DEBUG nova.compute.manager [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 01:04:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:04:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:04:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:04:52 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 01:04:53 user nova-compute[74850]: INFO nova.compute.manager [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Took 15.79 seconds to build instance.
Nov 14 01:04:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a2f5f690-9a0b-42f5-bc9d-abba40a89205 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "b6c2a1f5-1cf1-489b-8100-325833c9a42f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.886s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:04:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:04:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:04:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:04:53 user nova-compute[74850]: DEBUG nova.network.neutron [None req-f4a33d61-5468-4933-a11a-01a7acfd5915 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Updating instance_info_cache with network_info: [{"id": "430fc00c-2c5c-4139-8344-47c701006287", "address": "fa:16:3e:ff:f2:a3", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap430fc00c-2c", "ovs_interfaceid": "430fc00c-2c5c-4139-8344-47c701006287", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:04:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f4a33d61-5468-4933-a11a-01a7acfd5915 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Releasing lock "refresh_cache-6f0cb80d-dfec-4278-81ff-0e292bad880a" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:04:53 user nova-compute[74850]: DEBUG nova.objects.instance [None req-f4a33d61-5468-4933-a11a-01a7acfd5915 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lazy-loading 'migration_context' on Instance uuid 6f0cb80d-dfec-4278-81ff-0e292bad880a {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:04:53 user nova-compute[74850]: DEBUG nova.objects.base [None req-f4a33d61-5468-4933-a11a-01a7acfd5915 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Object Instance<6f0cb80d-dfec-4278-81ff-0e292bad880a> lazy-loaded attributes: info_cache,migration_context {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 01:04:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f4a33d61-5468-4933-a11a-01a7acfd5915 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:04:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f4a33d61-5468-4933-a11a-01a7acfd5915 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:04:53 user nova-compute[74850]: DEBUG nova.compute.manager [req-d3090865-5d7a-4c5d-9c36-2941c0d3af9c req-363a5df7-d4b0-4404-9578-77fa11f18468 service nova] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Received event network-vif-plugged-212d8fe5-766d-46b8-9ea1-8e2127519282 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:04:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d3090865-5d7a-4c5d-9c36-2941c0d3af9c req-363a5df7-d4b0-4404-9578-77fa11f18468 service nova] Acquiring lock "b6c2a1f5-1cf1-489b-8100-325833c9a42f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:04:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d3090865-5d7a-4c5d-9c36-2941c0d3af9c req-363a5df7-d4b0-4404-9578-77fa11f18468 service nova] Lock "b6c2a1f5-1cf1-489b-8100-325833c9a42f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:04:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d3090865-5d7a-4c5d-9c36-2941c0d3af9c req-363a5df7-d4b0-4404-9578-77fa11f18468 service nova] Lock "b6c2a1f5-1cf1-489b-8100-325833c9a42f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:04:53 user nova-compute[74850]: DEBUG nova.compute.manager [req-d3090865-5d7a-4c5d-9c36-2941c0d3af9c req-363a5df7-d4b0-4404-9578-77fa11f18468 service nova] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] No waiting events found dispatching network-vif-plugged-212d8fe5-766d-46b8-9ea1-8e2127519282 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:04:53 user nova-compute[74850]: WARNING nova.compute.manager [req-d3090865-5d7a-4c5d-9c36-2941c0d3af9c req-363a5df7-d4b0-4404-9578-77fa11f18468 service nova] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Received unexpected event network-vif-plugged-212d8fe5-766d-46b8-9ea1-8e2127519282 for instance with vm_state active and task_state None.
Nov 14 01:04:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:04:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:04:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:04:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:04:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:04:53 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-f4a33d61-5468-4933-a11a-01a7acfd5915 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:04:53 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-f4a33d61-5468-4933-a11a-01a7acfd5915 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:04:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:04:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f4a33d61-5468-4933-a11a-01a7acfd5915 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.492s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:04:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:04:54 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-f4a33d61-5468-4933-a11a-01a7acfd5915 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Deleted allocation for migration f37dd344-02f5-4e16-8ff0-d1fefe9f215e
Nov 14 01:04:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:04:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:04:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f4a33d61-5468-4933-a11a-01a7acfd5915 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "6f0cb80d-dfec-4278-81ff-0e292bad880a" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.751s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:04:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:04:54 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:04:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:04:54 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:04:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:04:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:04:54 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:04:54 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:04:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbdb3ee1-4129-4378-8771-a2e8ccff53a4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:04:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbdb3ee1-4129-4378-8771-a2e8ccff53a4/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:04:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbdb3ee1-4129-4378-8771-a2e8ccff53a4/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:04:55 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbdb3ee1-4129-4378-8771-a2e8ccff53a4/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:04:55 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:04:55 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:04:55 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:04:55 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:04:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:04:55 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:04:55 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:04:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=7985MB free_disk=25.002952575683594GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 01:04:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:04:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:04:56 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 748d0da7-bbb9-4e86-aae3-e48b1fa04c14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:04:56 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance c7952bff-87d6-46c1-a6d4-7729dc4893ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:04:56 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 702746f7-305f-4eac-a71a-6c08b7cbccd8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:04:56 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 782a85d0-b427-4ee2-8d6c-778602f00bcd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:04:56 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 3504ddd3-bdd8-465e-aec5-190acdd563f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:04:56 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 998f2d6a-e3b6-4135-9485-b042a5e094c4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:04:56 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:04:56 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 6f0cb80d-dfec-4278-81ff-0e292bad880a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:04:56 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance dbdb3ee1-4129-4378-8771-a2e8ccff53a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:04:56 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance b6c2a1f5-1cf1-489b-8100-325833c9a42f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:04:56 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 01:04:56 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 01:04:56 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:04:56 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:04:56 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 01:04:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.491s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:04:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:00 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:05:00 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:05:00 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:05:02 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:05:02 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:05:02 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:05:02 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:05:02 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 01:05:03 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:05:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:04 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:05:04 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:05:04 user nova-compute[74850]: DEBUG nova.compute.manager [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 01:05:04 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:05:04 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:05:04 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 01:05:04 user nova-compute[74850]: INFO nova.compute.claims [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Claim successful on node user
Nov 14 01:05:04 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:05:04 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 01:05:04 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Rebuilding the list of instances to heal {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 01:05:04 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Skipping network cache update for instance because it is Building. {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 01:05:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "refresh_cache-748d0da7-bbb9-4e86-aae3-e48b1fa04c14" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:05:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquired lock "refresh_cache-748d0da7-bbb9-4e86-aae3-e48b1fa04c14" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:05:05 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Forcefully refreshing network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 01:05:05 user nova-compute[74850]: DEBUG nova.objects.instance [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lazy-loading 'info_cache' on Instance uuid 748d0da7-bbb9-4e86-aae3-e48b1fa04c14 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:05:05 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:05:05 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:05:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:05:05 user nova-compute[74850]: DEBUG nova.compute.manager [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 01:05:05 user nova-compute[74850]: DEBUG nova.compute.manager [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 01:05:05 user nova-compute[74850]: DEBUG nova.network.neutron [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 01:05:05 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 01:05:05 user nova-compute[74850]: DEBUG nova.compute.manager [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 01:05:05 user nova-compute[74850]: DEBUG nova.policy [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a5bb5d788a3b4871ae41f57d06f785f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491aa2a4f38140788cb0de9762a8baf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 01:05:05 user nova-compute[74850]: INFO nova.virt.block_device [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Booting with volume-backed-image 5ed46099-4abf-4916-8deb-e38edb515c26 at /dev/vda
Nov 14 01:05:05 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Updating instance_info_cache with network_info: [{"id": "11d8d21f-e53e-4277-a1d1-36e99c3bcd62", "address": "fa:16:3e:f2:d6:a0", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d8d21f-e5", "ovs_interfaceid": "11d8d21f-e53e-4277-a1d1-36e99c3bcd62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:05:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Releasing lock "refresh_cache-748d0da7-bbb9-4e86-aae3-e48b1fa04c14" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:05:05 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Updated the network info_cache for instance {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 01:05:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "a1fa283c-79c2-4b52-9e91-70ec0e01115d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:05:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "a1fa283c-79c2-4b52-9e91-70ec0e01115d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:05:05 user nova-compute[74850]: DEBUG nova.compute.manager [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 01:05:06 user nova-compute[74850]: INFO nova.compute.claims [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Claim successful on node user
Nov 14 01:05:06 user nova-compute[74850]: DEBUG nova.network.neutron [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Successfully created port: 9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.473s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG nova.compute.manager [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 01:05:06 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-f1a2170b-1952-4899-ab06-5918eea8bdec tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e is timed out.
Nov 14 01:05:06 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-f1a2170b-1952-4899-ab06-5918eea8bdec tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Successfully detached device vdc from instance 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e from the live domain config.
Nov 14 01:05:06 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1a2170b-1952-4899-ab06-5918eea8bdec tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a2170b-1952-4899-ab06-5918eea8bdec tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CjhpabUW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:05:06 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-f1a2170b-1952-4899-ab06-5918eea8bdec tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:05:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-f1a2170b-1952-4899-ab06-5918eea8bdec tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-f1a2170b-1952-4899-ab06-5918eea8bdec tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG nova.compute.manager [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG nova.network.neutron [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 01:05:06 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ccde4fe-806e-416f-8f73-aa7bcea910e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a2170b-1952-4899-ab06-5918eea8bdec tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 01:05:06 user nova-compute[74850]: No targets found.
Nov 14 01:05:06 user nova-compute[74850]: iSNS:
Nov 14 01:05:06 user nova-compute[74850]: No targets found.
Nov 14 01:05:06 user nova-compute[74850]: STATIC:
Nov 14 01:05:06 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d
Nov 14 01:05:06 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:05:06 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:05:06 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7
Nov 14 01:05:06 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:05:06 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:05:06 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f
Nov 14 01:05:06 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:05:06 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:05:06 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d
Nov 14 01:05:06 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:05:06 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:05:06 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d
Nov 14 01:05:06 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:05:06 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:05:06 user nova-compute[74850]: FIRMWARE:
Nov 14 01:05:06 user nova-compute[74850]: No targets found.
Nov 14 01:05:06 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a2170b-1952-4899-ab06-5918eea8bdec tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 01:05:06 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 01:05:06 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a2170b-1952-4899-ab06-5918eea8bdec tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG nova.compute.manager [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a142061b-36c8-4834-b0cc-03ff0bbb3e76]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db0e2a1-d477-4e63-95c5-f6987afb5f26]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a2170b-1952-4899-ab06-5918eea8bdec tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:05:06 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:05:06 user nova-compute[74850]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 (non-flash)
Nov 14 01:05:06 user nova-compute[74850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:05:06 user nova-compute[74850]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f (non-flash)
Nov 14 01:05:06 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a2170b-1952-4899-ab06-5918eea8bdec tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:05:06 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:05:06 user nova-compute[74850]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 (non-flash)
Nov 14 01:05:06 user nova-compute[74850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:05:06 user nova-compute[74850]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f (non-flash)
Nov 14 01:05:06 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a2170b-1952-4899-ab06-5918eea8bdec tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a68993d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7'): ({'sde'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-f1a2170b-1952-4899-ab06-5918eea8bdec tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Removing single pathed devices sde {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG nova.policy [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb027592ab214b57b389227a97576a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f609057d1e44679838d565d80cade3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c672da-f455-452a-832e-c45343b89195]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a2d72e-5bf7-494d-9147-1e170a4d286c]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-f1a2170b-1952-4899-ab06-5918eea8bdec tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Flushing IO for device /dev/sde {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG nova.network.neutron [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Successfully updated port: 9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[65debb7d-6765-4e53-992b-e96c8639a3b7]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-f1a2170b-1952-4899-ab06-5918eea8bdec tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG nova.compute.manager [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 01:05:06 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Creating image(s)
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "/opt/stack/data/nova/instances/a1fa283c-79c2-4b52-9e91-70ec0e01115d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "/opt/stack/data/nova/instances/a1fa283c-79c2-4b52-9e91-70ec0e01115d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "/opt/stack/data/nova/instances/a1fa283c-79c2-4b52-9e91-70ec0e01115d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "refresh_cache-e6e38d20-9aac-4037-b1b4-0c25005a9a67" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquired lock "refresh_cache-e6e38d20-9aac-4037-b1b4-0c25005a9a67" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG nova.network.neutron [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5406b7f-9c83-40c2-80eb-96dc264c8d3c]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG nova.compute.manager [req-bdb4b57f-53ac-48b3-a1f2-f01ddb8ab40e req-b86923e3-3b14-4c9e-b289-353a43f2834b service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Received event network-changed-9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG nova.compute.manager [req-bdb4b57f-53ac-48b3-a1f2-f01ddb8ab40e req-b86923e3-3b14-4c9e-b289-353a43f2834b service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Refreshing instance network info cache due to event network-changed-9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-bdb4b57f-53ac-48b3-a1f2-f01ddb8ab40e req-b86923e3-3b14-4c9e-b289-353a43f2834b service nova] Acquiring lock "refresh_cache-e6e38d20-9aac-4037-b1b4-0c25005a9a67" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-f1a2170b-1952-4899-ab06-5918eea8bdec tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-f1a2170b-1952-4899-ab06-5918eea8bdec tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] SCSI volumes sde have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a2170b-1952-4899-ab06-5918eea8bdec tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a19559-a2ae-46a8-b6ac-72e33e3585c0]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a2170b-1952-4899-ab06-5918eea8bdec tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG nova.network.neutron [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bb170d-42fe-4f84-a86e-ac0c59b8db99]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a2170b-1952-4899-ab06-5918eea8bdec tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7, portal: 172.16.0.220,3260]
Nov 14 01:05:06 user nova-compute[74850]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7, portal: 172.16.0.220,3260] successful.
Nov 14 01:05:06 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.197s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:05:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91095b5a-8d12-4f4a-9a2c-d07cc14fe6c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:07 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[75193946-7762-48e4-b984-17ca1ea012df]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a2170b-1952-4899-ab06-5918eea8bdec tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:05:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-f1a2170b-1952-4899-ab06-5918eea8bdec tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.446s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:05:07 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a2170b-1952-4899-ab06-5918eea8bdec tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] <== disconnect_volume: return (448ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:05:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1a2170b-1952-4899-ab06-5918eea8bdec tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 01:05:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.180s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/a1fa283c-79c2-4b52-9e91-70ec0e01115d/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/a1fa283c-79c2-4b52-9e91-70ec0e01115d/disk 1073741824" returned: 0 in 0.067s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:05:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:07 user nova-compute[74850]: DEBUG nova.network.neutron [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Updating instance_info_cache with network_info: [{"id": "9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe", "address": "fa:16:3e:f7:6e:24", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c0cbd8f-1b", "ovs_interfaceid": "9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:05:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Releasing lock "refresh_cache-e6e38d20-9aac-4037-b1b4-0c25005a9a67" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:05:07 user nova-compute[74850]: DEBUG nova.compute.manager [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Instance network_info: |[{"id": "9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe", "address": "fa:16:3e:f7:6e:24", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c0cbd8f-1b", "ovs_interfaceid": "9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 01:05:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-bdb4b57f-53ac-48b3-a1f2-f01ddb8ab40e req-b86923e3-3b14-4c9e-b289-353a43f2834b service nova] Acquired lock "refresh_cache-e6e38d20-9aac-4037-b1b4-0c25005a9a67" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:05:07 user nova-compute[74850]: DEBUG nova.network.neutron [req-bdb4b57f-53ac-48b3-a1f2-f01ddb8ab40e req-b86923e3-3b14-4c9e-b289-353a43f2834b service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Refreshing network info cache for port 9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:05:07 user nova-compute[74850]: DEBUG nova.network.neutron [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Successfully created port: 0bd9a14c-20bb-49e2-9af2-d84aef11483b {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 01:05:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.181s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:07 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a1fa283c-79c2-4b52-9e91-70ec0e01115d/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 01:05:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1fa283c-79c2-4b52-9e91-70ec0e01115d/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1fa283c-79c2-4b52-9e91-70ec0e01115d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:07 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Cannot resize image /opt/stack/data/nova/instances/a1fa283c-79c2-4b52-9e91-70ec0e01115d/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 01:05:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 01:05:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Ensure instance console log exists: /opt/stack/data/nova/instances/a1fa283c-79c2-4b52-9e91-70ec0e01115d/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 01:05:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:05:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:05:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:05:07 user nova-compute[74850]: DEBUG nova.network.neutron [req-bdb4b57f-53ac-48b3-a1f2-f01ddb8ab40e req-b86923e3-3b14-4c9e-b289-353a43f2834b service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Updated VIF entry in instance network info cache for port 9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:05:07 user nova-compute[74850]: DEBUG nova.network.neutron [req-bdb4b57f-53ac-48b3-a1f2-f01ddb8ab40e req-b86923e3-3b14-4c9e-b289-353a43f2834b service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Updating instance_info_cache with network_info: [{"id": "9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe", "address": "fa:16:3e:f7:6e:24", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c0cbd8f-1b", "ovs_interfaceid": "9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:05:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-bdb4b57f-53ac-48b3-a1f2-f01ddb8ab40e req-b86923e3-3b14-4c9e-b289-353a43f2834b service nova] Releasing lock "refresh_cache-e6e38d20-9aac-4037-b1b4-0c25005a9a67" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:05:07 user nova-compute[74850]: DEBUG nova.objects.instance [None req-f1a2170b-1952-4899-ab06-5918eea8bdec tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lazy-loading 'flavor' on Instance uuid 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:05:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-f1a2170b-1952-4899-ab06-5918eea8bdec tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.805s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:05:07 user nova-compute[74850]: DEBUG nova.network.neutron [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Successfully updated port: 0bd9a14c-20bb-49e2-9af2-d84aef11483b {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 01:05:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "refresh_cache-a1fa283c-79c2-4b52-9e91-70ec0e01115d" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:05:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquired lock "refresh_cache-a1fa283c-79c2-4b52-9e91-70ec0e01115d" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:05:07 user nova-compute[74850]: DEBUG nova.network.neutron [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 01:05:07 user nova-compute[74850]: DEBUG nova.compute.manager [req-e27ce1cb-438f-44da-994b-67872bad1224 req-6be9b559-2f9b-4080-95ae-7b4ecda1c168 service nova] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Received event network-changed-0bd9a14c-20bb-49e2-9af2-d84aef11483b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:05:07 user nova-compute[74850]: DEBUG nova.compute.manager [req-e27ce1cb-438f-44da-994b-67872bad1224 req-6be9b559-2f9b-4080-95ae-7b4ecda1c168 service nova] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Refreshing instance network info cache due to event network-changed-0bd9a14c-20bb-49e2-9af2-d84aef11483b. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:05:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e27ce1cb-438f-44da-994b-67872bad1224 req-6be9b559-2f9b-4080-95ae-7b4ecda1c168 service nova] Acquiring lock "refresh_cache-a1fa283c-79c2-4b52-9e91-70ec0e01115d" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG nova.network.neutron [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG nova.network.neutron [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Updating instance_info_cache with network_info: [{"id": "0bd9a14c-20bb-49e2-9af2-d84aef11483b", "address": "fa:16:3e:c6:1f:a9", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9a14c-20", "ovs_interfaceid": "0bd9a14c-20bb-49e2-9af2-d84aef11483b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Releasing lock "refresh_cache-a1fa283c-79c2-4b52-9e91-70ec0e01115d" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG nova.compute.manager [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Instance network_info: |[{"id": "0bd9a14c-20bb-49e2-9af2-d84aef11483b", "address": "fa:16:3e:c6:1f:a9", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9a14c-20", "ovs_interfaceid": "0bd9a14c-20bb-49e2-9af2-d84aef11483b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e27ce1cb-438f-44da-994b-67872bad1224 req-6be9b559-2f9b-4080-95ae-7b4ecda1c168 service nova] Acquired lock "refresh_cache-a1fa283c-79c2-4b52-9e91-70ec0e01115d" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG nova.network.neutron [req-e27ce1cb-438f-44da-994b-67872bad1224 req-6be9b559-2f9b-4080-95ae-7b4ecda1c168 service nova] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Refreshing network info cache for port 0bd9a14c-20bb-49e2-9af2-d84aef11483b {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Start _get_guest_xml network_info=[{"id": "0bd9a14c-20bb-49e2-9af2-d84aef11483b", "address": "fa:16:3e:c6:1f:a9", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9a14c-20", "ovs_interfaceid": "0bd9a14c-20bb-49e2-9af2-d84aef11483b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 01:05:08 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:05:08 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:05:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:05:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-354361353',display_name='tempest-AttachVolumeNegativeTest-server-354361353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-354361353',id=41,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9T86AxQUjfy8aU/sp+Pjw+2BVeZTWrZsbX3mMir4RSNygZMeB9pv7Whrz7fC4we5tT3bVzqcGY53GRuYp7HwcU/zgIT1TLdbJPknvX7uFcLk6isOy/0bKIKTwR3T4fcw==',key_name='tempest-keypair-858077389',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35f609057d1e44679838d565d80cade3',ramdisk_id='',reservation_id='r-w2zz9r1m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1995397455',owner_user_name='tempest-AttachVolumeNegativeTest-1995397455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:05:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb027592ab214b57b389227a97576a43',uuid=a1fa283c-79c2-4b52-9e91-70ec0e01115d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bd9a14c-20bb-49e2-9af2-d84aef11483b", "address": "fa:16:3e:c6:1f:a9", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9a14c-20", "ovs_interfaceid": "0bd9a14c-20bb-49e2-9af2-d84aef11483b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Converting VIF {"id": "0bd9a14c-20bb-49e2-9af2-d84aef11483b", "address": "fa:16:3e:c6:1f:a9", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9a14c-20", "ovs_interfaceid": "0bd9a14c-20bb-49e2-9af2-d84aef11483b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:1f:a9,bridge_name='br-int',has_traffic_filtering=True,id=0bd9a14c-20bb-49e2-9af2-d84aef11483b,network=Network(11208f55-0e63-4c33-a12c-e061c8061eec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bd9a14c-20') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG nova.objects.instance [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lazy-loading 'pci_devices' on Instance uuid a1fa283c-79c2-4b52-9e91-70ec0e01115d {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 01:05:08 user nova-compute[74850]:   <uuid>a1fa283c-79c2-4b52-9e91-70ec0e01115d</uuid>
Nov 14 01:05:08 user nova-compute[74850]:   <name>instance-00000029</name>
Nov 14 01:05:08 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 01:05:08 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 01:05:08 user nova-compute[74850]:   <metadata>
Nov 14 01:05:08 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 01:05:08 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 01:05:08 user nova-compute[74850]:       <nova:name>tempest-AttachVolumeNegativeTest-server-354361353</nova:name>
Nov 14 01:05:08 user nova-compute[74850]:       <nova:creationTime>2023-11-14 01:05:08</nova:creationTime>
Nov 14 01:05:08 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 01:05:08 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 01:05:08 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 01:05:08 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 01:05:08 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 01:05:08 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 01:05:08 user nova-compute[74850]:       </nova:flavor>
Nov 14 01:05:08 user nova-compute[74850]:       <nova:owner>
Nov 14 01:05:08 user nova-compute[74850]:         <nova:user uuid="fb027592ab214b57b389227a97576a43">tempest-AttachVolumeNegativeTest-1995397455-project-member</nova:user>
Nov 14 01:05:08 user nova-compute[74850]:         <nova:project uuid="35f609057d1e44679838d565d80cade3">tempest-AttachVolumeNegativeTest-1995397455</nova:project>
Nov 14 01:05:08 user nova-compute[74850]:       </nova:owner>
Nov 14 01:05:08 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 01:05:08 user nova-compute[74850]:       <nova:ports>
Nov 14 01:05:08 user nova-compute[74850]:         <nova:port uuid="0bd9a14c-20bb-49e2-9af2-d84aef11483b">
Nov 14 01:05:08 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 01:05:08 user nova-compute[74850]:         </nova:port>
Nov 14 01:05:08 user nova-compute[74850]:       </nova:ports>
Nov 14 01:05:08 user nova-compute[74850]:     </nova:instance>
Nov 14 01:05:08 user nova-compute[74850]:   </metadata>
Nov 14 01:05:08 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 01:05:08 user nova-compute[74850]:     <system>
Nov 14 01:05:08 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 01:05:08 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 01:05:08 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 01:05:08 user nova-compute[74850]:       <entry name="serial">a1fa283c-79c2-4b52-9e91-70ec0e01115d</entry>
Nov 14 01:05:08 user nova-compute[74850]:       <entry name="uuid">a1fa283c-79c2-4b52-9e91-70ec0e01115d</entry>
Nov 14 01:05:08 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 01:05:08 user nova-compute[74850]:     </system>
Nov 14 01:05:08 user nova-compute[74850]:   </sysinfo>
Nov 14 01:05:08 user nova-compute[74850]:   <os>
Nov 14 01:05:08 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 01:05:08 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 01:05:08 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 01:05:08 user nova-compute[74850]:   </os>
Nov 14 01:05:08 user nova-compute[74850]:   <features>
Nov 14 01:05:08 user nova-compute[74850]:     <acpi/>
Nov 14 01:05:08 user nova-compute[74850]:     <apic/>
Nov 14 01:05:08 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 01:05:08 user nova-compute[74850]:   </features>
Nov 14 01:05:08 user nova-compute[74850]:   <clock offset="utc">
Nov 14 01:05:08 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 01:05:08 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 01:05:08 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 01:05:08 user nova-compute[74850]:   </clock>
Nov 14 01:05:08 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 01:05:08 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 01:05:08 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 01:05:08 user nova-compute[74850]:   </cpu>
Nov 14 01:05:08 user nova-compute[74850]:   <devices>
Nov 14 01:05:08 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 01:05:08 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 01:05:08 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/a1fa283c-79c2-4b52-9e91-70ec0e01115d/disk"/>
Nov 14 01:05:08 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 01:05:08 user nova-compute[74850]:     </disk>
Nov 14 01:05:08 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 01:05:08 user nova-compute[74850]:       <mac address="fa:16:3e:c6:1f:a9"/>
Nov 14 01:05:08 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:05:08 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 01:05:08 user nova-compute[74850]:       <target dev="tap0bd9a14c-20"/>
Nov 14 01:05:08 user nova-compute[74850]:     </interface>
Nov 14 01:05:08 user nova-compute[74850]:     <serial type="pty">
Nov 14 01:05:08 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/a1fa283c-79c2-4b52-9e91-70ec0e01115d/console.log" append="off"/>
Nov 14 01:05:08 user nova-compute[74850]:     </serial>
Nov 14 01:05:08 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 01:05:08 user nova-compute[74850]:     <video>
Nov 14 01:05:08 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:05:08 user nova-compute[74850]:     </video>
Nov 14 01:05:08 user nova-compute[74850]:     <rng model="virtio">
Nov 14 01:05:08 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 01:05:08 user nova-compute[74850]:     </rng>
Nov 14 01:05:08 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 01:05:08 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 01:05:08 user nova-compute[74850]:       <stats period="10"/>
Nov 14 01:05:08 user nova-compute[74850]:     </memballoon>
Nov 14 01:05:08 user nova-compute[74850]:   </devices>
Nov 14 01:05:08 user nova-compute[74850]: </domain>
Nov 14 01:05:08 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:05:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-354361353',display_name='tempest-AttachVolumeNegativeTest-server-354361353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-354361353',id=41,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9T86AxQUjfy8aU/sp+Pjw+2BVeZTWrZsbX3mMir4RSNygZMeB9pv7Whrz7fC4we5tT3bVzqcGY53GRuYp7HwcU/zgIT1TLdbJPknvX7uFcLk6isOy/0bKIKTwR3T4fcw==',key_name='tempest-keypair-858077389',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35f609057d1e44679838d565d80cade3',ramdisk_id='',reservation_id='r-w2zz9r1m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1995397455',owner_user_name='tempest-AttachVolumeNegativeTest-1995397455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:05:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb027592ab214b57b389227a97576a43',uuid=a1fa283c-79c2-4b52-9e91-70ec0e01115d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bd9a14c-20bb-49e2-9af2-d84aef11483b", "address": "fa:16:3e:c6:1f:a9", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9a14c-20", "ovs_interfaceid": "0bd9a14c-20bb-49e2-9af2-d84aef11483b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Converting VIF {"id": "0bd9a14c-20bb-49e2-9af2-d84aef11483b", "address": "fa:16:3e:c6:1f:a9", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9a14c-20", "ovs_interfaceid": "0bd9a14c-20bb-49e2-9af2-d84aef11483b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:1f:a9,bridge_name='br-int',has_traffic_filtering=True,id=0bd9a14c-20bb-49e2-9af2-d84aef11483b,network=Network(11208f55-0e63-4c33-a12c-e061c8061eec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bd9a14c-20') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG os_vif [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:1f:a9,bridge_name='br-int',has_traffic_filtering=True,id=0bd9a14c-20bb-49e2-9af2-d84aef11483b,network=Network(11208f55-0e63-4c33-a12c-e061c8061eec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bd9a14c-20') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5aded851-69be-5ab1-9d84-fbbaabb02579', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0bd9a14c-20, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0bd9a14c-20, col_values=(('qos', UUID('32c43e3c-bbc0-4ea5-b88c-97621579ffa3')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0bd9a14c-20, col_values=(('external_ids', {'iface-id': '0bd9a14c-20bb-49e2-9af2-d84aef11483b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:1f:a9', 'vm-uuid': 'a1fa283c-79c2-4b52-9e91-70ec0e01115d'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:08 user nova-compute[74850]: INFO os_vif [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:1f:a9,bridge_name='br-int',has_traffic_filtering=True,id=0bd9a14c-20bb-49e2-9af2-d84aef11483b,network=Network(11208f55-0e63-4c33-a12c-e061c8061eec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bd9a14c-20')
Nov 14 01:05:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] No VIF found with MAC fa:16:3e:c6:1f:a9, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG nova.network.neutron [req-e27ce1cb-438f-44da-994b-67872bad1224 req-6be9b559-2f9b-4080-95ae-7b4ecda1c168 service nova] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Updated VIF entry in instance network info cache for port 0bd9a14c-20bb-49e2-9af2-d84aef11483b. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG nova.network.neutron [req-e27ce1cb-438f-44da-994b-67872bad1224 req-6be9b559-2f9b-4080-95ae-7b4ecda1c168 service nova] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Updating instance_info_cache with network_info: [{"id": "0bd9a14c-20bb-49e2-9af2-d84aef11483b", "address": "fa:16:3e:c6:1f:a9", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9a14c-20", "ovs_interfaceid": "0bd9a14c-20bb-49e2-9af2-d84aef11483b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:05:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e27ce1cb-438f-44da-994b-67872bad1224 req-6be9b559-2f9b-4080-95ae-7b4ecda1c168 service nova] Releasing lock "refresh_cache-a1fa283c-79c2-4b52-9e91-70ec0e01115d" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:05:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:10 user nova-compute[74850]: DEBUG nova.compute.manager [req-9b0c89e3-d242-42f9-a931-4c934139dbac req-05294ca9-ed35-4e7a-9200-c81629149bea service nova] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Received event network-vif-plugged-0bd9a14c-20bb-49e2-9af2-d84aef11483b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:05:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9b0c89e3-d242-42f9-a931-4c934139dbac req-05294ca9-ed35-4e7a-9200-c81629149bea service nova] Acquiring lock "a1fa283c-79c2-4b52-9e91-70ec0e01115d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:05:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9b0c89e3-d242-42f9-a931-4c934139dbac req-05294ca9-ed35-4e7a-9200-c81629149bea service nova] Lock "a1fa283c-79c2-4b52-9e91-70ec0e01115d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:05:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9b0c89e3-d242-42f9-a931-4c934139dbac req-05294ca9-ed35-4e7a-9200-c81629149bea service nova] Lock "a1fa283c-79c2-4b52-9e91-70ec0e01115d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:05:10 user nova-compute[74850]: DEBUG nova.compute.manager [req-9b0c89e3-d242-42f9-a931-4c934139dbac req-05294ca9-ed35-4e7a-9200-c81629149bea service nova] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] No waiting events found dispatching network-vif-plugged-0bd9a14c-20bb-49e2-9af2-d84aef11483b {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:05:10 user nova-compute[74850]: WARNING nova.compute.manager [req-9b0c89e3-d242-42f9-a931-4c934139dbac req-05294ca9-ed35-4e7a-9200-c81629149bea service nova] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Received unexpected event network-vif-plugged-0bd9a14c-20bb-49e2-9af2-d84aef11483b for instance with vm_state building and task_state spawning.
Nov 14 01:05:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:10 user nova-compute[74850]: DEBUG os_brick.utils [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:05:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b175bbe-c125-4a9b-9fe5-e0494e0767de]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07cdc00-f60c-42ca-af4d-2e3f3cee1457]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a24ca2-ab29-4829-953b-969519ada857]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[576561f1-cccb-4898-8e42-e0685ee6c2ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:05:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 01:05:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:05:11 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 01:05:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2370b138-890e-4cb9-8c84-94e9d526dd67]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 01:05:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 01:05:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 01:05:11 user nova-compute[74850]: DEBUG os_brick.utils [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:05:11 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Updating existing volume attachment record: 1b4303f6-3763-4d78-a7d2-03889eb230f8 {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 01:05:11 user nova-compute[74850]: DEBUG nova.objects.instance [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lazy-loading 'flavor' on Instance uuid 782a85d0-b427-4ee2-8d6c-778602f00bcd {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:05:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "refresh_cache-782a85d0-b427-4ee2-8d6c-778602f00bcd" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:05:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquired lock "refresh_cache-782a85d0-b427-4ee2-8d6c-778602f00bcd" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:05:11 user nova-compute[74850]: DEBUG nova.network.neutron [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 01:05:11 user nova-compute[74850]: DEBUG nova.objects.instance [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lazy-loading 'info_cache' on Instance uuid 782a85d0-b427-4ee2-8d6c-778602f00bcd {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:05:11 user nova-compute[74850]: DEBUG nova.objects.base [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Object Instance<782a85d0-b427-4ee2-8d6c-778602f00bcd> lazy-loaded attributes: flavor,info_cache {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 01:05:11 user nova-compute[74850]: DEBUG nova.compute.manager [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 01:05:11 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 01:05:11 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Instance spawned successfully.
Nov 14 01:05:11 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 01:05:11 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:05:11 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:05:11 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:05:11 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:05:11 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:05:11 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:05:11 user nova-compute[74850]: DEBUG nova.network.neutron [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Updating instance_info_cache with network_info: [{"id": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "address": "fa:16:3e:70:96:bf", "network": {"id": "75650b3d-1169-46fa-a1cf-7ae51dd28e18", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227679489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3e629e632d444faf3898681aaafa79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744a9e-48", "ovs_interfaceid": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:05:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Releasing lock "refresh_cache-782a85d0-b427-4ee2-8d6c-778602f00bcd" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:05:11 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Instance destroyed successfully.
Nov 14 01:05:11 user nova-compute[74850]: DEBUG nova.objects.instance [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lazy-loading 'resources' on Instance uuid 782a85d0-b427-4ee2-8d6c-778602f00bcd {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:05:11 user nova-compute[74850]: INFO nova.compute.manager [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Took 5.24 seconds to spawn the instance on the hypervisor.
Nov 14 01:05:11 user nova-compute[74850]: DEBUG nova.compute.manager [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.objects.base [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Object Instance<782a85d0-b427-4ee2-8d6c-778602f00bcd> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:57:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-931477227',display_name='tempest-AttachVolumeTestJSON-server-931477227',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-931477227',id=30,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqGPtaAqtRvdnzrU67gWLSZdIWQoykWaBYabKPElkLS5sz5jLsrZV0zgILMNEA+Yd/7TrkBFbU+t9G+drRSGt2wGNzDluZHtIgMdrMvm4dKLEvsHluVt5xKssaIW0AwAg==',key_name='tempest-keypair-1840551366',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:57:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0c3e629e632d444faf3898681aaafa79',ramdisk_id='',reservation_id='r-iuno8cu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1639440895',owner_user_name='tempest-AttachVolumeTestJSON-1639440895-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T01:03:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b677f8f7b06431cbeac4cbdfa2dcbf5',uuid=782a85d0-b427-4ee2-8d6c-778602f00bcd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "address": "fa:16:3e:70:96:bf", "network": {"id": "75650b3d-1169-46fa-a1cf-7ae51dd28e18", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227679489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3e629e632d444faf3898681aaafa79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744a9e-48", "ovs_interfaceid": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Converting VIF {"id": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "address": "fa:16:3e:70:96:bf", "network": {"id": "75650b3d-1169-46fa-a1cf-7ae51dd28e18", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227679489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3e629e632d444faf3898681aaafa79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744a9e-48", "ovs_interfaceid": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:96:bf,bridge_name='br-int',has_traffic_filtering=True,id=b4744a9e-4848-49b9-9f58-7d29e0ecb9c7,network=Network(75650b3d-1169-46fa-a1cf-7ae51dd28e18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4744a9e-48') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG os_vif [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:96:bf,bridge_name='br-int',has_traffic_filtering=True,id=b4744a9e-4848-49b9-9f58-7d29e0ecb9c7,network=Network(75650b3d-1169-46fa-a1cf-7ae51dd28e18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4744a9e-48') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4744a9e-48, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=704d1741-10d2-41be-98d7-f3c791000117) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:12 user nova-compute[74850]: INFO os_vif [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:96:bf,bridge_name='br-int',has_traffic_filtering=True,id=b4744a9e-4848-49b9-9f58-7d29e0ecb9c7,network=Network(75650b3d-1169-46fa-a1cf-7ae51dd28e18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4744a9e-48')
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Start _get_guest_xml network_info=[{"id": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "address": "fa:16:3e:70:96:bf", "network": {"id": "75650b3d-1169-46fa-a1cf-7ae51dd28e18", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227679489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3e629e632d444faf3898681aaafa79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744a9e-48", "ovs_interfaceid": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.objects.instance [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lazy-loading 'numa_topology' on Instance uuid 782a85d0-b427-4ee2-8d6c-778602f00bcd {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.objects.base [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Object Instance<782a85d0-b427-4ee2-8d6c-778602f00bcd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 01:05:12 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:05:12 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.objects.instance [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lazy-loading 'vcpu_model' on Instance uuid 782a85d0-b427-4ee2-8d6c-778602f00bcd {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:05:12 user nova-compute[74850]: INFO nova.compute.manager [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Took 6.06 seconds to build instance.
Nov 14 01:05:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-380b285d-2ba4-4dda-a42c-9bb9f7bab5eb tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "a1fa283c-79c2-4b52-9e91-70ec0e01115d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.154s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.objects.base [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Object Instance<782a85d0-b427-4ee2-8d6c-778602f00bcd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:57:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-931477227',display_name='tempest-AttachVolumeTestJSON-server-931477227',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-931477227',id=30,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqGPtaAqtRvdnzrU67gWLSZdIWQoykWaBYabKPElkLS5sz5jLsrZV0zgILMNEA+Yd/7TrkBFbU+t9G+drRSGt2wGNzDluZHtIgMdrMvm4dKLEvsHluVt5xKssaIW0AwAg==',key_name='tempest-keypair-1840551366',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:57:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0c3e629e632d444faf3898681aaafa79',ramdisk_id='',reservation_id='r-iuno8cu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1639440895',owner_user_name='tempest-AttachVolumeTestJSON-1639440895-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T01:03:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b677f8f7b06431cbeac4cbdfa2dcbf5',uuid=782a85d0-b427-4ee2-8d6c-778602f00bcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "address": "fa:16:3e:70:96:bf", "network": {"id": "75650b3d-1169-46fa-a1cf-7ae51dd28e18", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227679489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3e629e632d444faf3898681aaafa79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744a9e-48", "ovs_interfaceid": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Converting VIF {"id": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "address": "fa:16:3e:70:96:bf", "network": {"id": "75650b3d-1169-46fa-a1cf-7ae51dd28e18", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227679489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3e629e632d444faf3898681aaafa79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744a9e-48", "ovs_interfaceid": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:96:bf,bridge_name='br-int',has_traffic_filtering=True,id=b4744a9e-4848-49b9-9f58-7d29e0ecb9c7,network=Network(75650b3d-1169-46fa-a1cf-7ae51dd28e18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4744a9e-48') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.objects.instance [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lazy-loading 'pci_devices' on Instance uuid 782a85d0-b427-4ee2-8d6c-778602f00bcd {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.compute.manager [req-1d2f4653-a7e5-4b07-9d34-70b7ab97aafc req-ff73496d-b3f6-4a8d-be76-915937f334f2 service nova] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Received event network-vif-plugged-0bd9a14c-20bb-49e2-9af2-d84aef11483b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-1d2f4653-a7e5-4b07-9d34-70b7ab97aafc req-ff73496d-b3f6-4a8d-be76-915937f334f2 service nova] Acquiring lock "a1fa283c-79c2-4b52-9e91-70ec0e01115d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-1d2f4653-a7e5-4b07-9d34-70b7ab97aafc req-ff73496d-b3f6-4a8d-be76-915937f334f2 service nova] Lock "a1fa283c-79c2-4b52-9e91-70ec0e01115d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-1d2f4653-a7e5-4b07-9d34-70b7ab97aafc req-ff73496d-b3f6-4a8d-be76-915937f334f2 service nova] Lock "a1fa283c-79c2-4b52-9e91-70ec0e01115d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.compute.manager [req-1d2f4653-a7e5-4b07-9d34-70b7ab97aafc req-ff73496d-b3f6-4a8d-be76-915937f334f2 service nova] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] No waiting events found dispatching network-vif-plugged-0bd9a14c-20bb-49e2-9af2-d84aef11483b {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:05:12 user nova-compute[74850]: WARNING nova.compute.manager [req-1d2f4653-a7e5-4b07-9d34-70b7ab97aafc req-ff73496d-b3f6-4a8d-be76-915937f334f2 service nova] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Received unexpected event network-vif-plugged-0bd9a14c-20bb-49e2-9af2-d84aef11483b for instance with vm_state active and task_state None.
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.objects.base [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Object Instance<782a85d0-b427-4ee2-8d6c-778602f00bcd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] End _get_guest_xml xml=<domain type="kvm">
Nov 14 01:05:12 user nova-compute[74850]:   <uuid>782a85d0-b427-4ee2-8d6c-778602f00bcd</uuid>
Nov 14 01:05:12 user nova-compute[74850]:   <name>instance-0000001e</name>
Nov 14 01:05:12 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 01:05:12 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 01:05:12 user nova-compute[74850]:   <metadata>
Nov 14 01:05:12 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 01:05:12 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 01:05:12 user nova-compute[74850]:       <nova:name>tempest-AttachVolumeTestJSON-server-931477227</nova:name>
Nov 14 01:05:12 user nova-compute[74850]:       <nova:creationTime>2023-11-14 01:05:12</nova:creationTime>
Nov 14 01:05:12 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 01:05:12 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 01:05:12 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 01:05:12 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 01:05:12 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 01:05:12 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 01:05:12 user nova-compute[74850]:       </nova:flavor>
Nov 14 01:05:12 user nova-compute[74850]:       <nova:owner>
Nov 14 01:05:12 user nova-compute[74850]:         <nova:user uuid="4b677f8f7b06431cbeac4cbdfa2dcbf5">tempest-AttachVolumeTestJSON-1639440895-project-member</nova:user>
Nov 14 01:05:12 user nova-compute[74850]:         <nova:project uuid="0c3e629e632d444faf3898681aaafa79">tempest-AttachVolumeTestJSON-1639440895</nova:project>
Nov 14 01:05:12 user nova-compute[74850]:       </nova:owner>
Nov 14 01:05:12 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 01:05:12 user nova-compute[74850]:       <nova:ports>
Nov 14 01:05:12 user nova-compute[74850]:         <nova:port uuid="b4744a9e-4848-49b9-9f58-7d29e0ecb9c7">
Nov 14 01:05:12 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 01:05:12 user nova-compute[74850]:         </nova:port>
Nov 14 01:05:12 user nova-compute[74850]:       </nova:ports>
Nov 14 01:05:12 user nova-compute[74850]:     </nova:instance>
Nov 14 01:05:12 user nova-compute[74850]:   </metadata>
Nov 14 01:05:12 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 01:05:12 user nova-compute[74850]:     <system>
Nov 14 01:05:12 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 01:05:12 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 01:05:12 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 01:05:12 user nova-compute[74850]:       <entry name="serial">782a85d0-b427-4ee2-8d6c-778602f00bcd</entry>
Nov 14 01:05:12 user nova-compute[74850]:       <entry name="uuid">782a85d0-b427-4ee2-8d6c-778602f00bcd</entry>
Nov 14 01:05:12 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 01:05:12 user nova-compute[74850]:     </system>
Nov 14 01:05:12 user nova-compute[74850]:   </sysinfo>
Nov 14 01:05:12 user nova-compute[74850]:   <os>
Nov 14 01:05:12 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 01:05:12 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 01:05:12 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 01:05:12 user nova-compute[74850]:   </os>
Nov 14 01:05:12 user nova-compute[74850]:   <features>
Nov 14 01:05:12 user nova-compute[74850]:     <acpi/>
Nov 14 01:05:12 user nova-compute[74850]:     <apic/>
Nov 14 01:05:12 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 01:05:12 user nova-compute[74850]:   </features>
Nov 14 01:05:12 user nova-compute[74850]:   <clock offset="utc">
Nov 14 01:05:12 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 01:05:12 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 01:05:12 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 01:05:12 user nova-compute[74850]:   </clock>
Nov 14 01:05:12 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 01:05:12 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 01:05:12 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 01:05:12 user nova-compute[74850]:   </cpu>
Nov 14 01:05:12 user nova-compute[74850]:   <devices>
Nov 14 01:05:12 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 01:05:12 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 01:05:12 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk"/>
Nov 14 01:05:12 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 01:05:12 user nova-compute[74850]:     </disk>
Nov 14 01:05:12 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 01:05:12 user nova-compute[74850]:       <mac address="fa:16:3e:70:96:bf"/>
Nov 14 01:05:12 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:05:12 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 01:05:12 user nova-compute[74850]:       <target dev="tapb4744a9e-48"/>
Nov 14 01:05:12 user nova-compute[74850]:     </interface>
Nov 14 01:05:12 user nova-compute[74850]:     <serial type="pty">
Nov 14 01:05:12 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/console.log" append="off"/>
Nov 14 01:05:12 user nova-compute[74850]:     </serial>
Nov 14 01:05:12 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 01:05:12 user nova-compute[74850]:     <video>
Nov 14 01:05:12 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:05:12 user nova-compute[74850]:     </video>
Nov 14 01:05:12 user nova-compute[74850]:     <rng model="virtio">
Nov 14 01:05:12 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 01:05:12 user nova-compute[74850]:     </rng>
Nov 14 01:05:12 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 01:05:12 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 01:05:12 user nova-compute[74850]:       <stats period="10"/>
Nov 14 01:05:12 user nova-compute[74850]:     </memballoon>
Nov 14 01:05:12 user nova-compute[74850]:   </devices>
Nov 14 01:05:12 user nova-compute[74850]: </domain>
Nov 14 01:05:12 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.objects.instance [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lazy-loading 'trusted_certs' on Instance uuid 782a85d0-b427-4ee2-8d6c-778602f00bcd {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.objects.base [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Object Instance<782a85d0-b427-4ee2-8d6c-778602f00bcd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.177s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Checking if we can resize image /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Cannot resize image /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.objects.instance [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lazy-loading 'migration_context' on Instance uuid 782a85d0-b427-4ee2-8d6c-778602f00bcd {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.objects.base [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Object Instance<782a85d0-b427-4ee2-8d6c-778602f00bcd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:57:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-931477227',display_name='tempest-AttachVolumeTestJSON-server-931477227',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-931477227',id=30,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqGPtaAqtRvdnzrU67gWLSZdIWQoykWaBYabKPElkLS5sz5jLsrZV0zgILMNEA+Yd/7TrkBFbU+t9G+drRSGt2wGNzDluZHtIgMdrMvm4dKLEvsHluVt5xKssaIW0AwAg==',key_name='tempest-keypair-1840551366',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:57:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='0c3e629e632d444faf3898681aaafa79',ramdisk_id='',reservation_id='r-iuno8cu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1639440895',owner_user_name='tempest-AttachVolumeTestJSON-1639440895-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:03:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b677f8f7b06431cbeac4cbdfa2dcbf5',uuid=782a85d0-b427-4ee2-8d6c-778602f00bcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "address": "fa:16:3e:70:96:bf", "network": {"id": "75650b3d-1169-46fa-a1cf-7ae51dd28e18", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227679489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3e629e632d444faf3898681aaafa79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744a9e-48", "ovs_interfaceid": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Converting VIF {"id": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "address": "fa:16:3e:70:96:bf", "network": {"id": "75650b3d-1169-46fa-a1cf-7ae51dd28e18", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227679489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3e629e632d444faf3898681aaafa79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744a9e-48", "ovs_interfaceid": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:96:bf,bridge_name='br-int',has_traffic_filtering=True,id=b4744a9e-4848-49b9-9f58-7d29e0ecb9c7,network=Network(75650b3d-1169-46fa-a1cf-7ae51dd28e18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4744a9e-48') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG os_vif [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:96:bf,bridge_name='br-int',has_traffic_filtering=True,id=b4744a9e-4848-49b9-9f58-7d29e0ecb9c7,network=Network(75650b3d-1169-46fa-a1cf-7ae51dd28e18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4744a9e-48') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cd61ce09-cb12-585b-b714-5c8b7381bd2b', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4744a9e-48, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb4744a9e-48, col_values=(('qos', UUID('50db65f4-47e5-40d8-b9f9-31de2b80d369')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb4744a9e-48, col_values=(('external_ids', {'iface-id': 'b4744a9e-4848-49b9-9f58-7d29e0ecb9c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:96:bf', 'vm-uuid': '782a85d0-b427-4ee2-8d6c-778602f00bcd'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:05:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:12 user nova-compute[74850]: INFO os_vif [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:96:bf,bridge_name='br-int',has_traffic_filtering=True,id=b4744a9e-4848-49b9-9f58-7d29e0ecb9c7,network=Network(75650b3d-1169-46fa-a1cf-7ae51dd28e18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4744a9e-48')
Nov 14 01:05:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:14 user nova-compute[74850]: DEBUG nova.compute.manager [req-61873ddf-3ed9-4a10-8b06-843698ec3d74 req-466c479f-d9f2-4430-a3fa-50f428411236 service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Received event network-vif-plugged-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:05:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-61873ddf-3ed9-4a10-8b06-843698ec3d74 req-466c479f-d9f2-4430-a3fa-50f428411236 service nova] Acquiring lock "782a85d0-b427-4ee2-8d6c-778602f00bcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:05:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-61873ddf-3ed9-4a10-8b06-843698ec3d74 req-466c479f-d9f2-4430-a3fa-50f428411236 service nova] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:05:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-61873ddf-3ed9-4a10-8b06-843698ec3d74 req-466c479f-d9f2-4430-a3fa-50f428411236 service nova] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:05:14 user nova-compute[74850]: DEBUG nova.compute.manager [req-61873ddf-3ed9-4a10-8b06-843698ec3d74 req-466c479f-d9f2-4430-a3fa-50f428411236 service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] No waiting events found dispatching network-vif-plugged-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:05:14 user nova-compute[74850]: WARNING nova.compute.manager [req-61873ddf-3ed9-4a10-8b06-843698ec3d74 req-466c479f-d9f2-4430-a3fa-50f428411236 service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Received unexpected event network-vif-plugged-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 for instance with vm_state stopped and task_state powering-on.
Nov 14 01:05:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG nova.compute.manager [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 01:05:15 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Creating image(s)
Nov 14 01:05:15 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Did not create local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Ensure instance console log exists: /opt/stack/data/nova/instances/e6e38d20-9aac-4037-b1b4-0c25005a9a67/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Start _get_guest_xml network_info=[{"id": "9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe", "address": "fa:16:3e:f7:6e:24", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c0cbd8f-1b", "ovs_interfaceid": "9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '1b4303f6-3763-4d78-a7d2-03889eb230f8', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmWXAKaB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e6e38d20-9aac-4037-b1b4-0c25005a9a67', 'attached_at': '', 'detached_at': '', 'volume_id': '6e39afd2-04ef-410c-b7e3-d0eeceb59f5a', 'serial': '6e39afd2-04ef-410c-b7e3-d0eeceb59f5a'}, 'volume_type': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 01:05:15 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:05:15 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:05:15 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmWXAKaB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:05:15 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:05:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:05:15 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:05:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:05:15 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 01:05:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[108b28a1-ea34-4fb4-928f-952b219c822a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 01:05:15 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b9b0ee-85a2-43f5-a7c4-b20bcfccb302]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a] added
Nov 14 01:05:15 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1496f91-250c-4f98-84f4-33142d5b4275]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ac4092-b1d6-4732-b3dc-40dc0f6a3c21]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zmWXAKaB {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zmWXAKaB" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7dfcfcb-5527-47f9-bf00-96a71bdc1d5e]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zmWXAKaB'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ec9188-4219-4325-a90f-3794211f6c8b]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e1f836-feb2-4885-a770-9c1a200df4d0]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:05:15 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:05:15 user nova-compute[74850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:05:15 user nova-compute[74850]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f (non-flash)
Nov 14 01:05:15 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:05:15 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:05:15 user nova-compute[74850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:05:15 user nova-compute[74850]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f (non-flash)
Nov 14 01:05:15 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37d312f-3820-442e-ba75-6cc19a31c80d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a, portal: 172.16.0.220,3260]
Nov 14 01:05:15 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a, portal: 172.16.0.220,3260] successful.
Nov 14 01:05:15 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[93112f67-9124-4ea4-b73b-b6b74ce84657]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:05:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:16 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5032fa65-bb15-4094-8c45-2ece533759fd]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:05:16 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:05:16 user nova-compute[74850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:05:16 user nova-compute[74850]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f (non-flash)
Nov 14 01:05:16 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:05:16 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:05:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:05:16 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:05:16 user nova-compute[74850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:05:16 user nova-compute[74850]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f (non-flash)
Nov 14 01:05:16 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:05:16 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:05:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:05:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 01:05:16 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 01:05:16 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 01:05:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:16 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c98d4b-0287-496b-8ec7-019f8f92b1f1]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:16 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: None {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:05:16 user nova-compute[74850]: DEBUG nova.compute.manager [req-3ffc54cf-588e-400a-9d9a-6a43f7fc9ea9 req-685957a9-8a61-4370-a91c-247dfa780ba2 service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Received event network-vif-plugged-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:05:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3ffc54cf-588e-400a-9d9a-6a43f7fc9ea9 req-685957a9-8a61-4370-a91c-247dfa780ba2 service nova] Acquiring lock "782a85d0-b427-4ee2-8d6c-778602f00bcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:05:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3ffc54cf-588e-400a-9d9a-6a43f7fc9ea9 req-685957a9-8a61-4370-a91c-247dfa780ba2 service nova] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:05:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3ffc54cf-588e-400a-9d9a-6a43f7fc9ea9 req-685957a9-8a61-4370-a91c-247dfa780ba2 service nova] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:05:16 user nova-compute[74850]: DEBUG nova.compute.manager [req-3ffc54cf-588e-400a-9d9a-6a43f7fc9ea9 req-685957a9-8a61-4370-a91c-247dfa780ba2 service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] No waiting events found dispatching network-vif-plugged-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:05:16 user nova-compute[74850]: WARNING nova.compute.manager [req-3ffc54cf-588e-400a-9d9a-6a43f7fc9ea9 req-685957a9-8a61-4370-a91c-247dfa780ba2 service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Received unexpected event network-vif-plugged-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 for instance with vm_state stopped and task_state powering-on.
Nov 14 01:05:16 user nova-compute[74850]: DEBUG nova.compute.manager [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 01:05:16 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Instance rebooted successfully.
Nov 14 01:05:16 user nova-compute[74850]: DEBUG nova.compute.manager [None req-361aca52-9d6f-40c6-982f-55d525da716c tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 01:05:17 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:05:17 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmWXAKaB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 01:05:17 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:05:17 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23565356266363438', 'path': '/dev/sdd'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:05:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565356266363438', 'path': '/dev/sdd'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 01:05:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-836607346',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-836607346',id=40,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='491aa2a4f38140788cb0de9762a8baf4',ramdisk_id='',reservation_id='r-0bztva0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-726213232',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:05:05Z,user_data=None,user_id='a5bb5d788a3b4871ae41f57d06f785f2',uuid=e6e38d20-9aac-4037-b1b4-0c25005a9a67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe", "address": "fa:16:3e:f7:6e:24", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c0cbd8f-1b", "ovs_interfaceid": "9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 01:05:17 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Converting VIF {"id": "9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe", "address": "fa:16:3e:f7:6e:24", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c0cbd8f-1b", "ovs_interfaceid": "9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:05:17 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:6e:24,bridge_name='br-int',has_traffic_filtering=True,id=9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe,network=Network(6f8f66ca-e2e8-4565-a05c-df75a16699ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c0cbd8f-1b') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:05:17 user nova-compute[74850]: DEBUG nova.objects.instance [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lazy-loading 'pci_devices' on Instance uuid e6e38d20-9aac-4037-b1b4-0c25005a9a67 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:05:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] End _get_guest_xml xml=<domain type="kvm">
Nov 14 01:05:17 user nova-compute[74850]:   <uuid>e6e38d20-9aac-4037-b1b4-0c25005a9a67</uuid>
Nov 14 01:05:17 user nova-compute[74850]:   <name>instance-00000028</name>
Nov 14 01:05:17 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 01:05:17 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 01:05:17 user nova-compute[74850]:   <metadata>
Nov 14 01:05:17 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 01:05:17 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 01:05:17 user nova-compute[74850]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-836607346</nova:name>
Nov 14 01:05:17 user nova-compute[74850]:       <nova:creationTime>2023-11-14 01:05:15</nova:creationTime>
Nov 14 01:05:17 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 01:05:17 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 01:05:17 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 01:05:17 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 01:05:17 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 01:05:17 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 01:05:17 user nova-compute[74850]:       </nova:flavor>
Nov 14 01:05:17 user nova-compute[74850]:       <nova:owner>
Nov 14 01:05:17 user nova-compute[74850]:         <nova:user uuid="a5bb5d788a3b4871ae41f57d06f785f2">tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member</nova:user>
Nov 14 01:05:17 user nova-compute[74850]:         <nova:project uuid="491aa2a4f38140788cb0de9762a8baf4">tempest-ServerBootFromVolumeStableRescueTest-726213232</nova:project>
Nov 14 01:05:17 user nova-compute[74850]:       </nova:owner>
Nov 14 01:05:17 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 01:05:17 user nova-compute[74850]:       <nova:ports>
Nov 14 01:05:17 user nova-compute[74850]:         <nova:port uuid="9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe">
Nov 14 01:05:17 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 01:05:17 user nova-compute[74850]:         </nova:port>
Nov 14 01:05:17 user nova-compute[74850]:       </nova:ports>
Nov 14 01:05:17 user nova-compute[74850]:     </nova:instance>
Nov 14 01:05:17 user nova-compute[74850]:   </metadata>
Nov 14 01:05:17 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 01:05:17 user nova-compute[74850]:     <system>
Nov 14 01:05:17 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 01:05:17 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 01:05:17 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 01:05:17 user nova-compute[74850]:       <entry name="serial">e6e38d20-9aac-4037-b1b4-0c25005a9a67</entry>
Nov 14 01:05:17 user nova-compute[74850]:       <entry name="uuid">e6e38d20-9aac-4037-b1b4-0c25005a9a67</entry>
Nov 14 01:05:17 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 01:05:17 user nova-compute[74850]:     </system>
Nov 14 01:05:17 user nova-compute[74850]:   </sysinfo>
Nov 14 01:05:17 user nova-compute[74850]:   <os>
Nov 14 01:05:17 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 01:05:17 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 01:05:17 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 01:05:17 user nova-compute[74850]:   </os>
Nov 14 01:05:17 user nova-compute[74850]:   <features>
Nov 14 01:05:17 user nova-compute[74850]:     <acpi/>
Nov 14 01:05:17 user nova-compute[74850]:     <apic/>
Nov 14 01:05:17 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 01:05:17 user nova-compute[74850]:   </features>
Nov 14 01:05:17 user nova-compute[74850]:   <clock offset="utc">
Nov 14 01:05:17 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 01:05:17 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 01:05:17 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 01:05:17 user nova-compute[74850]:   </clock>
Nov 14 01:05:17 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 01:05:17 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 01:05:17 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 01:05:17 user nova-compute[74850]:   </cpu>
Nov 14 01:05:17 user nova-compute[74850]:   <devices>
Nov 14 01:05:17 user nova-compute[74850]:     <disk type="block" device="disk">
Nov 14 01:05:17 user nova-compute[74850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:05:17 user nova-compute[74850]:       <source dev="/dev/sdd"/>
Nov 14 01:05:17 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 01:05:17 user nova-compute[74850]:       <serial>6e39afd2-04ef-410c-b7e3-d0eeceb59f5a</serial>
Nov 14 01:05:17 user nova-compute[74850]:     </disk>
Nov 14 01:05:17 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 01:05:17 user nova-compute[74850]:       <mac address="fa:16:3e:f7:6e:24"/>
Nov 14 01:05:17 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:05:17 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 01:05:17 user nova-compute[74850]:       <target dev="tap9c0cbd8f-1b"/>
Nov 14 01:05:17 user nova-compute[74850]:     </interface>
Nov 14 01:05:17 user nova-compute[74850]:     <serial type="pty">
Nov 14 01:05:17 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/e6e38d20-9aac-4037-b1b4-0c25005a9a67/console.log" append="off"/>
Nov 14 01:05:17 user nova-compute[74850]:     </serial>
Nov 14 01:05:17 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 01:05:17 user nova-compute[74850]:     <video>
Nov 14 01:05:17 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:05:17 user nova-compute[74850]:     </video>
Nov 14 01:05:17 user nova-compute[74850]:     <rng model="virtio">
Nov 14 01:05:17 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 01:05:17 user nova-compute[74850]:     </rng>
Nov 14 01:05:17 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 01:05:17 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 01:05:17 user nova-compute[74850]:       <stats period="10"/>
Nov 14 01:05:17 user nova-compute[74850]:     </memballoon>
Nov 14 01:05:17 user nova-compute[74850]:   </devices>
Nov 14 01:05:17 user nova-compute[74850]: </domain>
Nov 14 01:05:17 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 01:05:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-836607346',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-836607346',id=40,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='491aa2a4f38140788cb0de9762a8baf4',ramdisk_id='',reservation_id='r-0bztva0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-726213232',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:05:05Z,user_data=None,user_id='a5bb5d788a3b4871ae41f57d06f785f2',uuid=e6e38d20-9aac-4037-b1b4-0c25005a9a67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe", "address": "fa:16:3e:f7:6e:24", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c0cbd8f-1b", "ovs_interfaceid": "9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 01:05:17 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Converting VIF {"id": "9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe", "address": "fa:16:3e:f7:6e:24", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c0cbd8f-1b", "ovs_interfaceid": "9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:05:17 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:6e:24,bridge_name='br-int',has_traffic_filtering=True,id=9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe,network=Network(6f8f66ca-e2e8-4565-a05c-df75a16699ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c0cbd8f-1b') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:05:17 user nova-compute[74850]: DEBUG os_vif [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:6e:24,bridge_name='br-int',has_traffic_filtering=True,id=9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe,network=Network(6f8f66ca-e2e8-4565-a05c-df75a16699ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c0cbd8f-1b') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 01:05:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:05:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 01:05:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b64093a0-5787-5df5-beb3-1d65ddb3e6d7', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:05:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:05:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c0cbd8f-1b, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:05:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c0cbd8f-1b, col_values=(('qos', UUID('99962546-0f6c-41d9-a86a-b66d96f1b742')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:05:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c0cbd8f-1b, col_values=(('external_ids', {'iface-id': '9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:6e:24', 'vm-uuid': 'e6e38d20-9aac-4037-b1b4-0c25005a9a67'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:05:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:05:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:17 user nova-compute[74850]: INFO os_vif [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:6e:24,bridge_name='br-int',has_traffic_filtering=True,id=9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe,network=Network(6f8f66ca-e2e8-4565-a05c-df75a16699ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c0cbd8f-1b')
Nov 14 01:05:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:05:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] No VIF found with MAC fa:16:3e:f7:6e:24, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:05:18 user nova-compute[74850]: DEBUG nova.compute.manager [req-87abe034-d7e9-470a-a1bb-927823bc2faa req-26ebb6c8-c89a-46e4-92fa-5ee9a41e8052 service nova] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Received event network-changed-32218b9b-be7a-426b-b741-f0bdf28a3a2e {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:05:18 user nova-compute[74850]: DEBUG nova.compute.manager [req-87abe034-d7e9-470a-a1bb-927823bc2faa req-26ebb6c8-c89a-46e4-92fa-5ee9a41e8052 service nova] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Refreshing instance network info cache due to event network-changed-32218b9b-be7a-426b-b741-f0bdf28a3a2e. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:05:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-87abe034-d7e9-470a-a1bb-927823bc2faa req-26ebb6c8-c89a-46e4-92fa-5ee9a41e8052 service nova] Acquiring lock "refresh_cache-dbdb3ee1-4129-4378-8771-a2e8ccff53a4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:05:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-87abe034-d7e9-470a-a1bb-927823bc2faa req-26ebb6c8-c89a-46e4-92fa-5ee9a41e8052 service nova] Acquired lock "refresh_cache-dbdb3ee1-4129-4378-8771-a2e8ccff53a4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:05:18 user nova-compute[74850]: DEBUG nova.network.neutron [req-87abe034-d7e9-470a-a1bb-927823bc2faa req-26ebb6c8-c89a-46e4-92fa-5ee9a41e8052 service nova] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Refreshing network info cache for port 32218b9b-be7a-426b-b741-f0bdf28a3a2e {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:05:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Acquiring lock "dbdb3ee1-4129-4378-8771-a2e8ccff53a4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:05:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "dbdb3ee1-4129-4378-8771-a2e8ccff53a4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:05:18 user nova-compute[74850]: DEBUG nova.objects.instance [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lazy-loading 'flavor' on Instance uuid dbdb3ee1-4129-4378-8771-a2e8ccff53a4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:05:18 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Ignoring supplied device name: /dev/vdb
Nov 14 01:05:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "dbdb3ee1-4129-4378-8771-a2e8ccff53a4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:05:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:18 user nova-compute[74850]: DEBUG nova.network.neutron [req-87abe034-d7e9-470a-a1bb-927823bc2faa req-26ebb6c8-c89a-46e4-92fa-5ee9a41e8052 service nova] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Updated VIF entry in instance network info cache for port 32218b9b-be7a-426b-b741-f0bdf28a3a2e. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:05:18 user nova-compute[74850]: DEBUG nova.network.neutron [req-87abe034-d7e9-470a-a1bb-927823bc2faa req-26ebb6c8-c89a-46e4-92fa-5ee9a41e8052 service nova] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Updating instance_info_cache with network_info: [{"id": "32218b9b-be7a-426b-b741-f0bdf28a3a2e", "address": "fa:16:3e:f1:53:0f", "network": {"id": "e822a969-afbd-4415-a246-324f9b0c98ce", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1543025211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84022f7a63234abba05ae4e88035fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32218b9b-be", "ovs_interfaceid": "32218b9b-be7a-426b-b741-f0bdf28a3a2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:05:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Acquiring lock "dbdb3ee1-4129-4378-8771-a2e8ccff53a4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:05:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "dbdb3ee1-4129-4378-8771-a2e8ccff53a4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:05:18 user nova-compute[74850]: INFO nova.compute.manager [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Attaching volume cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0 to /dev/vdb
Nov 14 01:05:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-87abe034-d7e9-470a-a1bb-927823bc2faa req-26ebb6c8-c89a-46e4-92fa-5ee9a41e8052 service nova] Releasing lock "refresh_cache-dbdb3ee1-4129-4378-8771-a2e8ccff53a4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:05:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:19 user nova-compute[74850]: DEBUG os_brick.utils [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:05:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8f037a-702d-428b-829e-3ec35aa37001]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[226cae40-7530-4503-8a80-09d027611416]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cbb5e9-95a8-40ca-965d-a457d2ac4271]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[22585e9e-aed5-4e41-8c5d-f8ca46c6bfee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:05:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 01:05:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:05:19 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 01:05:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a900b1c8-4664-43be-9154-70e342b4e5f1]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 01:05:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 01:05:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 01:05:19 user nova-compute[74850]: DEBUG os_brick.utils [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:05:19 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Updating existing volume attachment record: 3e96df18-f823-4d49-ad70-a08f9f7d4800 {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 01:05:20 user nova-compute[74850]: DEBUG nova.compute.manager [req-8334b999-915c-4591-b802-22a108751a5c req-d715b206-22d8-4726-8b1a-33593f960ac4 service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Received event network-vif-plugged-9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:05:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-8334b999-915c-4591-b802-22a108751a5c req-d715b206-22d8-4726-8b1a-33593f960ac4 service nova] Acquiring lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:05:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-8334b999-915c-4591-b802-22a108751a5c req-d715b206-22d8-4726-8b1a-33593f960ac4 service nova] Lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:05:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-8334b999-915c-4591-b802-22a108751a5c req-d715b206-22d8-4726-8b1a-33593f960ac4 service nova] Lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:05:20 user nova-compute[74850]: DEBUG nova.compute.manager [req-8334b999-915c-4591-b802-22a108751a5c req-d715b206-22d8-4726-8b1a-33593f960ac4 service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] No waiting events found dispatching network-vif-plugged-9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:05:20 user nova-compute[74850]: WARNING nova.compute.manager [req-8334b999-915c-4591-b802-22a108751a5c req-d715b206-22d8-4726-8b1a-33593f960ac4 service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Received unexpected event network-vif-plugged-9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe for instance with vm_state building and task_state spawning.
Nov 14 01:05:20 user nova-compute[74850]: DEBUG nova.compute.manager [req-8334b999-915c-4591-b802-22a108751a5c req-d715b206-22d8-4726-8b1a-33593f960ac4 service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Received event network-vif-plugged-9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:05:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-8334b999-915c-4591-b802-22a108751a5c req-d715b206-22d8-4726-8b1a-33593f960ac4 service nova] Acquiring lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:05:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-8334b999-915c-4591-b802-22a108751a5c req-d715b206-22d8-4726-8b1a-33593f960ac4 service nova] Lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:05:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-8334b999-915c-4591-b802-22a108751a5c req-d715b206-22d8-4726-8b1a-33593f960ac4 service nova] Lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:05:20 user nova-compute[74850]: DEBUG nova.compute.manager [req-8334b999-915c-4591-b802-22a108751a5c req-d715b206-22d8-4726-8b1a-33593f960ac4 service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] No waiting events found dispatching network-vif-plugged-9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:05:20 user nova-compute[74850]: WARNING nova.compute.manager [req-8334b999-915c-4591-b802-22a108751a5c req-d715b206-22d8-4726-8b1a-33593f960ac4 service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Received unexpected event network-vif-plugged-9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe for instance with vm_state building and task_state spawning.
Nov 14 01:05:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:20 user nova-compute[74850]: DEBUG nova.compute.manager [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 01:05:20 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 01:05:20 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Instance spawned successfully.
Nov 14 01:05:20 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 01:05:20 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:05:20 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:05:20 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:05:20 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:05:20 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:05:20 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:05:21 user nova-compute[74850]: INFO nova.compute.manager [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Took 5.40 seconds to spawn the instance on the hypervisor.
Nov 14 01:05:21 user nova-compute[74850]: DEBUG nova.compute.manager [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 01:05:21 user nova-compute[74850]: INFO nova.compute.manager [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Took 16.54 seconds to build instance.
Nov 14 01:05:21 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-3dec6d7a-177f-42c3-958d-835402ab9bde tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.656s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:05:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dBYiwqCV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:05:24 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:05:24 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:05:24 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:05:24 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:05:24 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 01:05:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0 -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2dde3b-e5bc-4fb8-94cf-39c0859b3871]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 01:05:24 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fb9564-96f3-44b1-8087-ac4fee8954be]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0] added
Nov 14 01:05:24 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb26b508-07ce-4663-affd-2e5f0f91edf1]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3464a71-1c8a-4969-8e01-24613575dcc4]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dBYiwqCV {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dBYiwqCV" returned: 0 in 0.118s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7047985b-7a83-4d41-b842-a18b2f7e7389]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dBYiwqCV'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f62951-3dd6-4b98-9f82-f45160f14bad]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5061bf34-3dcd-415a-a31f-e8a9603c49bd]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:05:24 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:05:24 user nova-compute[74850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:05:24 user nova-compute[74850]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f (non-flash)
Nov 14 01:05:24 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:05:24 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:05:24 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:05:24 user nova-compute[74850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:05:24 user nova-compute[74850]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f (non-flash)
Nov 14 01:05:24 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:05:24 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0 -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[92320d4b-b520-4676-8d9a-2407b6ab2714]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0, portal: 172.16.0.220,3260]
Nov 14 01:05:24 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0, portal: 172.16.0.220,3260] successful.
Nov 14 01:05:24 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c98df4d-e220-41eb-8c10-7b0ba12634d2]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3647638b-06c2-4971-ae6e-3580528b9bb3]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:05:24 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:05:24 user nova-compute[74850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:05:24 user nova-compute[74850]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f (non-flash)
Nov 14 01:05:24 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:05:24 user nova-compute[74850]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0 (non-flash)
Nov 14 01:05:24 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:05:24 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:05:24 user nova-compute[74850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:05:24 user nova-compute[74850]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f (non-flash)
Nov 14 01:05:24 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:05:24 user nova-compute[74850]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0 (non-flash)
Nov 14 01:05:24 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.424s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] HCTL ('36', '-', '-', 0) found on session 45 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.028s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[48175c1e-963d-4e69-98f7-fbe6cfbd883a]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Searching for a device in session 45 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:05:24 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dBYiwqCV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 01:05:25 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.473s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:05:25 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] <== connect_volume: return (1476ms) {'type': 'block', 'scsi_wwn': '23831366234396362', 'path': '/dev/sde'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:05:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831366234396362', 'path': '/dev/sde'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 01:05:25 user nova-compute[74850]: DEBUG nova.objects.instance [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lazy-loading 'flavor' on Instance uuid dbdb3ee1-4129-4378-8771-a2e8ccff53a4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:05:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 01:05:25 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:05:25 user nova-compute[74850]:   <source dev="/dev/sde"/>
Nov 14 01:05:25 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:05:25 user nova-compute[74850]:   <serial>cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0</serial>
Nov 14 01:05:25 user nova-compute[74850]: </disk>
Nov 14 01:05:25 user nova-compute[74850]:  {{(pid=74850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 01:05:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:26 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:05:26 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:05:26 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] No VIF found with MAC fa:16:3e:f1:53:0f, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:05:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b5a7cf6e-43de-4861-8433-527007a7064a tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "dbdb3ee1-4129-4378-8771-a2e8ccff53a4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.207s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:05:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:30 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4620665f-83c3-412e-be83-f132caa4fd82 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Acquiring lock "dbdb3ee1-4129-4378-8771-a2e8ccff53a4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:05:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4620665f-83c3-412e-be83-f132caa4fd82 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "dbdb3ee1-4129-4378-8771-a2e8ccff53a4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:05:34 user nova-compute[74850]: INFO nova.compute.manager [None req-4620665f-83c3-412e-be83-f132caa4fd82 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Detaching volume cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0
Nov 14 01:05:34 user nova-compute[74850]: INFO nova.virt.block_device [None req-4620665f-83c3-412e-be83-f132caa4fd82 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Attempting to driver detach volume cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0 from mountpoint /dev/vdb
Nov 14 01:05:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4620665f-83c3-412e-be83-f132caa4fd82 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Attempting to detach device vdb from instance dbdb3ee1-4129-4378-8771-a2e8ccff53a4 from the persistent domain config. {{(pid=74850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 01:05:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-4620665f-83c3-412e-be83-f132caa4fd82 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:05:34 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:05:34 user nova-compute[74850]:   <source dev="/dev/sde"/>
Nov 14 01:05:34 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:05:34 user nova-compute[74850]:   <serial>cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0</serial>
Nov 14 01:05:34 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 01:05:34 user nova-compute[74850]: </disk>
Nov 14 01:05:34 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:05:34 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-4620665f-83c3-412e-be83-f132caa4fd82 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Successfully detached device vdb from instance dbdb3ee1-4129-4378-8771-a2e8ccff53a4 from the persistent domain config.
Nov 14 01:05:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4620665f-83c3-412e-be83-f132caa4fd82 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dbdb3ee1-4129-4378-8771-a2e8ccff53a4 from the live domain config. {{(pid=74850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 01:05:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-4620665f-83c3-412e-be83-f132caa4fd82 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:05:34 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:05:34 user nova-compute[74850]:   <source dev="/dev/sde"/>
Nov 14 01:05:34 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:05:34 user nova-compute[74850]:   <serial>cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0</serial>
Nov 14 01:05:34 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 01:05:34 user nova-compute[74850]: </disk>
Nov 14 01:05:34 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:05:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Acquiring lock "dbdb3ee1-4129-4378-8771-a2e8ccff53a4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:05:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4620665f-83c3-412e-be83-f132caa4fd82 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dbdb3ee1-4129-4378-8771-a2e8ccff53a4 {{(pid=74850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 01:05:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c592421a-e4b7-410c-91fc-b490c3aa9f5a tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:05:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c592421a-e4b7-410c-91fc-b490c3aa9f5a tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:05:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c592421a-e4b7-410c-91fc-b490c3aa9f5a tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:05:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c592421a-e4b7-410c-91fc-b490c3aa9f5a tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:05:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c592421a-e4b7-410c-91fc-b490c3aa9f5a tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:05:36 user nova-compute[74850]: INFO nova.compute.manager [None req-c592421a-e4b7-410c-91fc-b490c3aa9f5a tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Terminating instance
Nov 14 01:05:36 user nova-compute[74850]: DEBUG nova.compute.manager [None req-c592421a-e4b7-410c-91fc-b490c3aa9f5a tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 01:05:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:36 user nova-compute[74850]: DEBUG nova.compute.manager [req-38ad4cdd-b43b-4ef5-99ee-7c8da488170b req-ed38edca-38c5-4b18-8dd6-995da3427a68 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Received event network-vif-unplugged-ee3e224b-fade-4ac4-bb64-1bf1a4df045c {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:05:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-38ad4cdd-b43b-4ef5-99ee-7c8da488170b req-ed38edca-38c5-4b18-8dd6-995da3427a68 service nova] Acquiring lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:05:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-38ad4cdd-b43b-4ef5-99ee-7c8da488170b req-ed38edca-38c5-4b18-8dd6-995da3427a68 service nova] Lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:05:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-38ad4cdd-b43b-4ef5-99ee-7c8da488170b req-ed38edca-38c5-4b18-8dd6-995da3427a68 service nova] Lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:05:36 user nova-compute[74850]: DEBUG nova.compute.manager [req-38ad4cdd-b43b-4ef5-99ee-7c8da488170b req-ed38edca-38c5-4b18-8dd6-995da3427a68 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] No waiting events found dispatching network-vif-unplugged-ee3e224b-fade-4ac4-bb64-1bf1a4df045c {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:05:36 user nova-compute[74850]: DEBUG nova.compute.manager [req-38ad4cdd-b43b-4ef5-99ee-7c8da488170b req-ed38edca-38c5-4b18-8dd6-995da3427a68 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Received event network-vif-unplugged-ee3e224b-fade-4ac4-bb64-1bf1a4df045c for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 01:05:37 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Instance destroyed successfully.
Nov 14 01:05:37 user nova-compute[74850]: DEBUG nova.objects.instance [None req-c592421a-e4b7-410c-91fc-b490c3aa9f5a tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lazy-loading 'resources' on Instance uuid 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:05:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-c592421a-e4b7-410c-91fc-b490c3aa9f5a tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T00:59:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-589429054',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-589429054',id=32,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlYimApQkMypM1Jjvk0FBuh/aRLC/vPd/t+SoVKgbKU6stO3sCw/jpQFU3J/aANjVRSOq807ChnwPcFRUlfzkxpk30iEXkNZZFCxlyV6ZflIjFflWG7QN4jpLjTPyifHw==',key_name='tempest-keypair-553908575',keypairs=<?>,launch_index=0,launched_at=2023-11-14T01:03:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e396f5de82e54abfa812bf8a7e89b0c4',ramdisk_id='',reservation_id='r-s21f41qa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-270753956',owner_user_name='tempest-AttachVolumeShelveTestJSON-270753956-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T01:03:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe8332d8221a49db86a402c5851b4882',uuid=7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "address": "fa:16:3e:06:ff:75", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3e224b-fa", "ovs_interfaceid": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 01:05:37 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-c592421a-e4b7-410c-91fc-b490c3aa9f5a tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Converting VIF {"id": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "address": "fa:16:3e:06:ff:75", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee3e224b-fa", "ovs_interfaceid": "ee3e224b-fade-4ac4-bb64-1bf1a4df045c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:05:37 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-c592421a-e4b7-410c-91fc-b490c3aa9f5a tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:ff:75,bridge_name='br-int',has_traffic_filtering=True,id=ee3e224b-fade-4ac4-bb64-1bf1a4df045c,network=Network(dfd22096-9f0c-4e0f-aac4-06c224b5b9f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee3e224b-fa') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:05:37 user nova-compute[74850]: DEBUG os_vif [None req-c592421a-e4b7-410c-91fc-b490c3aa9f5a tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:ff:75,bridge_name='br-int',has_traffic_filtering=True,id=ee3e224b-fade-4ac4-bb64-1bf1a4df045c,network=Network(dfd22096-9f0c-4e0f-aac4-06c224b5b9f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee3e224b-fa') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 01:05:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee3e224b-fa, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:05:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:05:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4061fb02-add6-44a6-aaa4-30e575227930) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:05:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:37 user nova-compute[74850]: INFO os_vif [None req-c592421a-e4b7-410c-91fc-b490c3aa9f5a tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:ff:75,bridge_name='br-int',has_traffic_filtering=True,id=ee3e224b-fade-4ac4-bb64-1bf1a4df045c,network=Network(dfd22096-9f0c-4e0f-aac4-06c224b5b9f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee3e224b-fa')
Nov 14 01:05:37 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-c592421a-e4b7-410c-91fc-b490c3aa9f5a tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Deleting instance files /opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e_del
Nov 14 01:05:37 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-c592421a-e4b7-410c-91fc-b490c3aa9f5a tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Deletion of /opt/stack/data/nova/instances/7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e_del complete
Nov 14 01:05:37 user nova-compute[74850]: INFO nova.compute.manager [None req-c592421a-e4b7-410c-91fc-b490c3aa9f5a tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 01:05:37 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-c592421a-e4b7-410c-91fc-b490c3aa9f5a tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 01:05:37 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 01:05:37 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 01:05:38 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:05:38 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Took 0.91 seconds to deallocate network for instance.
Nov 14 01:05:38 user nova-compute[74850]: DEBUG nova.compute.manager [req-9a74ae1a-4e4f-4bb0-b91f-8d5b819094e7 req-c79811c7-591d-4d34-aee1-942923be6719 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Received event network-vif-deleted-ee3e224b-fade-4ac4-bb64-1bf1a4df045c {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:05:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c592421a-e4b7-410c-91fc-b490c3aa9f5a tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:05:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c592421a-e4b7-410c-91fc-b490c3aa9f5a tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:05:38 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-c592421a-e4b7-410c-91fc-b490c3aa9f5a tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:05:38 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-c592421a-e4b7-410c-91fc-b490c3aa9f5a tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:05:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c592421a-e4b7-410c-91fc-b490c3aa9f5a tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.386s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:05:38 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-c592421a-e4b7-410c-91fc-b490c3aa9f5a tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Deleted allocations for instance 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e
Nov 14 01:05:38 user nova-compute[74850]: DEBUG nova.compute.manager [req-a252eeff-6cef-4f36-83f6-dc93429afc8b req-34dc629a-ed09-47d7-84ac-db1c0b6eab00 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Received event network-vif-plugged-ee3e224b-fade-4ac4-bb64-1bf1a4df045c {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:05:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a252eeff-6cef-4f36-83f6-dc93429afc8b req-34dc629a-ed09-47d7-84ac-db1c0b6eab00 service nova] Acquiring lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:05:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a252eeff-6cef-4f36-83f6-dc93429afc8b req-34dc629a-ed09-47d7-84ac-db1c0b6eab00 service nova] Lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:05:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a252eeff-6cef-4f36-83f6-dc93429afc8b req-34dc629a-ed09-47d7-84ac-db1c0b6eab00 service nova] Lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:05:38 user nova-compute[74850]: DEBUG nova.compute.manager [req-a252eeff-6cef-4f36-83f6-dc93429afc8b req-34dc629a-ed09-47d7-84ac-db1c0b6eab00 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] No waiting events found dispatching network-vif-plugged-ee3e224b-fade-4ac4-bb64-1bf1a4df045c {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:05:38 user nova-compute[74850]: WARNING nova.compute.manager [req-a252eeff-6cef-4f36-83f6-dc93429afc8b req-34dc629a-ed09-47d7-84ac-db1c0b6eab00 service nova] [instance: 7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e] Received unexpected event network-vif-plugged-ee3e224b-fade-4ac4-bb64-1bf1a4df045c for instance with vm_state deleted and task_state None.
Nov 14 01:05:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c592421a-e4b7-410c-91fc-b490c3aa9f5a tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "7d8e3a60-cd52-4b5a-a8da-4eed88eddc1e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.341s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:05:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:54 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4620665f-83c3-412e-be83-f132caa4fd82 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dbdb3ee1-4129-4378-8771-a2e8ccff53a4 is timed out.
Nov 14 01:05:54 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-4620665f-83c3-412e-be83-f132caa4fd82 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Successfully detached device vdb from instance dbdb3ee1-4129-4378-8771-a2e8ccff53a4 from the live domain config.
Nov 14 01:05:54 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4620665f-83c3-412e-be83-f132caa4fd82 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4620665f-83c3-412e-be83-f132caa4fd82 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dBYiwqCV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:05:54 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-4620665f-83c3-412e-be83-f132caa4fd82 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:05:54 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4620665f-83c3-412e-be83-f132caa4fd82 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4620665f-83c3-412e-be83-f132caa4fd82 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b911e4-0206-464f-9459-c8f0b94fcdd6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4620665f-83c3-412e-be83-f132caa4fd82 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 01:05:54 user nova-compute[74850]: No targets found.
Nov 14 01:05:54 user nova-compute[74850]: iSNS:
Nov 14 01:05:54 user nova-compute[74850]: No targets found.
Nov 14 01:05:54 user nova-compute[74850]: STATIC:
Nov 14 01:05:54 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d
Nov 14 01:05:54 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:05:54 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:05:54 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f
Nov 14 01:05:54 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:05:54 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:05:54 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d
Nov 14 01:05:54 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:05:54 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:05:54 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a
Nov 14 01:05:54 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:05:54 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:05:54 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d
Nov 14 01:05:54 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:05:54 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:05:54 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0
Nov 14 01:05:54 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:05:54 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:05:54 user nova-compute[74850]: FIRMWARE:
Nov 14 01:05:54 user nova-compute[74850]: No targets found.
Nov 14 01:05:54 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4620665f-83c3-412e-be83-f132caa4fd82 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 01:05:54 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 01:05:54 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4620665f-83c3-412e-be83-f132caa4fd82 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac07923-57da-4e39-a5a9-c3d1b3a6a4c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda4a8e2-6714-496f-ac9f-cd9cc9197273]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4620665f-83c3-412e-be83-f132caa4fd82 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:05:54 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:05:54 user nova-compute[74850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:05:54 user nova-compute[74850]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f (non-flash)
Nov 14 01:05:54 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:05:54 user nova-compute[74850]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0 (non-flash)
Nov 14 01:05:54 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4620665f-83c3-412e-be83-f132caa4fd82 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:05:54 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:05:54 user nova-compute[74850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:05:54 user nova-compute[74850]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f (non-flash)
Nov 14 01:05:54 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:05:54 user nova-compute[74850]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0 (non-flash)
Nov 14 01:05:54 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4620665f-83c3-412e-be83-f132caa4fd82 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a5fe03be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0'): ({'sde'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-4620665f-83c3-412e-be83-f132caa4fd82 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Removing single pathed devices sde {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7c8a81-5301-4c64-9244-6ee9070a2eed]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.028s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f027ad-ab29-4e43-af8a-a78b7382a82d]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-4620665f-83c3-412e-be83-f132caa4fd82 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Flushing IO for device /dev/sde {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2a5f64-1226-40bd-a39c-032f2dd28ba3]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-4620665f-83c3-412e-be83-f132caa4fd82 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.080s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b62f486-1eb7-443b-bcca-ec0867bdb314]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-4620665f-83c3-412e-be83-f132caa4fd82 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-4620665f-83c3-412e-be83-f132caa4fd82 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] SCSI volumes sde have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4620665f-83c3-412e-be83-f132caa4fd82 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0551fc-426d-4ed1-b008-318e016dcf0f]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4620665f-83c3-412e-be83-f132caa4fd82 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0 -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30f34a1-920f-47f9-ae27-76305e8f9f25]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4620665f-83c3-412e-be83-f132caa4fd82 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0, portal: 172.16.0.220,3260]
Nov 14 01:05:54 user nova-compute[74850]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0, portal: 172.16.0.220,3260] successful.
Nov 14 01:05:54 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:05:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0 -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:55 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:55 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[791439e7-0d15-4864-84e5-43bc1c0553f7]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:55 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4620665f-83c3-412e-be83-f132caa4fd82 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:05:55 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4620665f-83c3-412e-be83-f132caa4fd82 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:05:55 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4620665f-83c3-412e-be83-f132caa4fd82 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] <== disconnect_volume: return (381ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:05:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4620665f-83c3-412e-be83-f132caa4fd82 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 01:05:55 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:55 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:55 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:55 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:05:55 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:55 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:55 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:55 user nova-compute[74850]: DEBUG nova.objects.instance [None req-4620665f-83c3-412e-be83-f132caa4fd82 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lazy-loading 'flavor' on Instance uuid dbdb3ee1-4129-4378-8771-a2e8ccff53a4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:05:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4620665f-83c3-412e-be83-f132caa4fd82 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "dbdb3ee1-4129-4378-8771-a2e8ccff53a4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.822s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:05:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "dbdb3ee1-4129-4378-8771-a2e8ccff53a4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.568s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:05:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Acquiring lock "dbdb3ee1-4129-4378-8771-a2e8ccff53a4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:05:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "dbdb3ee1-4129-4378-8771-a2e8ccff53a4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:05:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "dbdb3ee1-4129-4378-8771-a2e8ccff53a4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:05:55 user nova-compute[74850]: INFO nova.compute.manager [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Terminating instance
Nov 14 01:05:55 user nova-compute[74850]: DEBUG nova.compute.manager [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 01:05:55 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:55 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG nova.compute.manager [req-a56c28a0-3635-46f7-856e-1b5a1f788baf req-44ba261b-f1c9-4a43-81ea-a8b792fe71a2 service nova] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Received event network-vif-unplugged-32218b9b-be7a-426b-b741-f0bdf28a3a2e {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a56c28a0-3635-46f7-856e-1b5a1f788baf req-44ba261b-f1c9-4a43-81ea-a8b792fe71a2 service nova] Acquiring lock "dbdb3ee1-4129-4378-8771-a2e8ccff53a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a56c28a0-3635-46f7-856e-1b5a1f788baf req-44ba261b-f1c9-4a43-81ea-a8b792fe71a2 service nova] Lock "dbdb3ee1-4129-4378-8771-a2e8ccff53a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a56c28a0-3635-46f7-856e-1b5a1f788baf req-44ba261b-f1c9-4a43-81ea-a8b792fe71a2 service nova] Lock "dbdb3ee1-4129-4378-8771-a2e8ccff53a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG nova.compute.manager [req-a56c28a0-3635-46f7-856e-1b5a1f788baf req-44ba261b-f1c9-4a43-81ea-a8b792fe71a2 service nova] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] No waiting events found dispatching network-vif-unplugged-32218b9b-be7a-426b-b741-f0bdf28a3a2e {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG nova.compute.manager [req-a56c28a0-3635-46f7-856e-1b5a1f788baf req-44ba261b-f1c9-4a43-81ea-a8b792fe71a2 service nova] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Received event network-vif-unplugged-32218b9b-be7a-426b-b741-f0bdf28a3a2e for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1fa283c-79c2-4b52-9e91-70ec0e01115d/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1fa283c-79c2-4b52-9e91-70ec0e01115d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1fa283c-79c2-4b52-9e91-70ec0e01115d/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:56 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Instance destroyed successfully.
Nov 14 01:05:56 user nova-compute[74850]: DEBUG nova.objects.instance [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lazy-loading 'resources' on Instance uuid dbdb3ee1-4129-4378-8771-a2e8ccff53a4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:03:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1019630848',display_name='tempest-VolumesSnapshotTestJSON-instance-1019630848',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1019630848',id=38,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHhFrRr6CysDUvL/yVsmnt0+1XIjMZW/b1jWJTSD5PsWcd8zjEasE0kVJeIYxqDiUUv9n0X4vmCMVWyMNiJGx/lyDlCyWWKNReNMzOrs31jsEBkN7hDLzjKsv9gveupfw==',key_name='tempest-keypair-1355653026',keypairs=<?>,launch_index=0,launched_at=2023-11-14T01:03:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84022f7a63234abba05ae4e88035fd34',ramdisk_id='',reservation_id='r-7nmxqeyo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1878797663',owner_user_name='tempest-VolumesSnapshotTestJSON-1878797663-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T01:03:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7ab31389a2f415eb08ca3ddaae08ddd',uuid=dbdb3ee1-4129-4378-8771-a2e8ccff53a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32218b9b-be7a-426b-b741-f0bdf28a3a2e", "address": "fa:16:3e:f1:53:0f", "network": {"id": "e822a969-afbd-4415-a246-324f9b0c98ce", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1543025211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84022f7a63234abba05ae4e88035fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32218b9b-be", "ovs_interfaceid": "32218b9b-be7a-426b-b741-f0bdf28a3a2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Converting VIF {"id": "32218b9b-be7a-426b-b741-f0bdf28a3a2e", "address": "fa:16:3e:f1:53:0f", "network": {"id": "e822a969-afbd-4415-a246-324f9b0c98ce", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1543025211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84022f7a63234abba05ae4e88035fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32218b9b-be", "ovs_interfaceid": "32218b9b-be7a-426b-b741-f0bdf28a3a2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:53:0f,bridge_name='br-int',has_traffic_filtering=True,id=32218b9b-be7a-426b-b741-f0bdf28a3a2e,network=Network(e822a969-afbd-4415-a246-324f9b0c98ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32218b9b-be') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG os_vif [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:53:0f,bridge_name='br-int',has_traffic_filtering=True,id=32218b9b-be7a-426b-b741-f0bdf28a3a2e,network=Network(e822a969-afbd-4415-a246-324f9b0c98ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32218b9b-be') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32218b9b-be, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b035c781-60d5-4f02-a55d-e1cf09971359) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:05:56 user nova-compute[74850]: INFO os_vif [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:53:0f,bridge_name='br-int',has_traffic_filtering=True,id=32218b9b-be7a-426b-b741-f0bdf28a3a2e,network=Network(e822a969-afbd-4415-a246-324f9b0c98ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32218b9b-be')
Nov 14 01:05:56 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dBYiwqCV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:05:56 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:05:56 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[882c32d3-5539-45f7-96c8-ea796ba6ee7f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 01:05:56 user nova-compute[74850]: No targets found.
Nov 14 01:05:56 user nova-compute[74850]: iSNS:
Nov 14 01:05:56 user nova-compute[74850]: No targets found.
Nov 14 01:05:56 user nova-compute[74850]: STATIC:
Nov 14 01:05:56 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d
Nov 14 01:05:56 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:05:56 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:05:56 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f
Nov 14 01:05:56 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:05:56 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:05:56 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d
Nov 14 01:05:56 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:05:56 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:05:56 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a
Nov 14 01:05:56 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:05:56 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:05:56 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d
Nov 14 01:05:56 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:05:56 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:05:56 user nova-compute[74850]: FIRMWARE:
Nov 14 01:05:56 user nova-compute[74850]: No targets found.
Nov 14 01:05:56 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 01:05:56 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 01:05:56 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf1638e8-9fa3-42b4-a50c-dc1ad7e662a0', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1fa283c-79c2-4b52-9e91-70ec0e01115d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7cd688-70db-49fa-9d42-c5b7b8bb2627]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a7f388-2c4a-4396-8d2a-0554835c92c9]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:05:56 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:05:56 user nova-compute[74850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:05:56 user nova-compute[74850]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f (non-flash)
Nov 14 01:05:56 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:05:56 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:05:56 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:05:56 user nova-compute[74850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:05:56 user nova-compute[74850]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f (non-flash)
Nov 14 01:05:56 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:05:56 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a3c71f490>, {}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Disconnecting from: [] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.088s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] <== disconnect_volume: return (90ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 01:05:56 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Deleting instance files /opt/stack/data/nova/instances/dbdb3ee1-4129-4378-8771-a2e8ccff53a4_del
Nov 14 01:05:56 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Deletion of /opt/stack/data/nova/instances/dbdb3ee1-4129-4378-8771-a2e8ccff53a4_del complete
Nov 14 01:05:56 user nova-compute[74850]: INFO nova.compute.manager [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 14 01:05:56 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:05:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:05:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:05:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:05:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:05:57 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Error from libvirt while getting description of instance-00000026: [Error Code 42] Domain not found: no domain with matching uuid 'dbdb3ee1-4129-4378-8771-a2e8ccff53a4' (instance-00000026): libvirt.libvirtError: Domain not found: no domain with matching uuid 'dbdb3ee1-4129-4378-8771-a2e8ccff53a4' (instance-00000026)
Nov 14 01:05:57 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:05:57 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:05:57 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=7509MB free_disk=24.98255157470703GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 01:05:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:05:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:05:57 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 748d0da7-bbb9-4e86-aae3-e48b1fa04c14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:05:57 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance c7952bff-87d6-46c1-a6d4-7729dc4893ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:05:57 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 702746f7-305f-4eac-a71a-6c08b7cbccd8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:05:57 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 782a85d0-b427-4ee2-8d6c-778602f00bcd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:05:57 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 3504ddd3-bdd8-465e-aec5-190acdd563f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:05:57 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 998f2d6a-e3b6-4135-9485-b042a5e094c4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:05:57 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 6f0cb80d-dfec-4278-81ff-0e292bad880a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:05:57 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance dbdb3ee1-4129-4378-8771-a2e8ccff53a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:05:57 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance b6c2a1f5-1cf1-489b-8100-325833c9a42f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:05:57 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance e6e38d20-9aac-4037-b1b4-0c25005a9a67 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:05:57 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance a1fa283c-79c2-4b52-9e91-70ec0e01115d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:05:57 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 01:05:57 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 01:05:57 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:05:57 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:05:57 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 01:05:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.511s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:05:57 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:05:57 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74850) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 01:05:58 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:05:58 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Took 1.26 seconds to deallocate network for instance.
Nov 14 01:05:58 user nova-compute[74850]: WARNING nova.volume.cinder [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Attachment 3e96df18-f823-4d49-ad70-a08f9f7d4800 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 3e96df18-f823-4d49-ad70-a08f9f7d4800. (HTTP 404) (Request-ID: req-23765668-efa7-44af-8665-cfca026b3476)
Nov 14 01:05:58 user nova-compute[74850]: INFO nova.compute.manager [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Took 0.03 seconds to detach 1 volumes for instance.
Nov 14 01:05:58 user nova-compute[74850]: DEBUG nova.compute.manager [req-29c53f3c-bf19-4503-845f-e450146e97de req-52cc89cd-52fb-43db-8a03-5b2e39716069 service nova] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Received event network-vif-deleted-32218b9b-be7a-426b-b741-f0bdf28a3a2e {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:05:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:05:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:05:58 user nova-compute[74850]: DEBUG nova.compute.manager [req-d17a2d79-23d2-4be2-9696-2563d9b9439a req-92e65bb8-5f60-45be-9922-472c7a50fc39 service nova] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Received event network-vif-plugged-32218b9b-be7a-426b-b741-f0bdf28a3a2e {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:05:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d17a2d79-23d2-4be2-9696-2563d9b9439a req-92e65bb8-5f60-45be-9922-472c7a50fc39 service nova] Acquiring lock "dbdb3ee1-4129-4378-8771-a2e8ccff53a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:05:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d17a2d79-23d2-4be2-9696-2563d9b9439a req-92e65bb8-5f60-45be-9922-472c7a50fc39 service nova] Lock "dbdb3ee1-4129-4378-8771-a2e8ccff53a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:05:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d17a2d79-23d2-4be2-9696-2563d9b9439a req-92e65bb8-5f60-45be-9922-472c7a50fc39 service nova] Lock "dbdb3ee1-4129-4378-8771-a2e8ccff53a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:05:58 user nova-compute[74850]: DEBUG nova.compute.manager [req-d17a2d79-23d2-4be2-9696-2563d9b9439a req-92e65bb8-5f60-45be-9922-472c7a50fc39 service nova] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] No waiting events found dispatching network-vif-plugged-32218b9b-be7a-426b-b741-f0bdf28a3a2e {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:05:58 user nova-compute[74850]: WARNING nova.compute.manager [req-d17a2d79-23d2-4be2-9696-2563d9b9439a req-92e65bb8-5f60-45be-9922-472c7a50fc39 service nova] [instance: dbdb3ee1-4129-4378-8771-a2e8ccff53a4] Received unexpected event network-vif-plugged-32218b9b-be7a-426b-b741-f0bdf28a3a2e for instance with vm_state deleted and task_state None.
Nov 14 01:05:58 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:05:58 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:05:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.311s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:05:58 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Deleted allocations for instance dbdb3ee1-4129-4378-8771-a2e8ccff53a4
Nov 14 01:05:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1634b7c4-2161-4840-a636-68fa83b110be tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "dbdb3ee1-4129-4378-8771-a2e8ccff53a4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.743s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:05:59 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:06:00 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:06:00 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:06:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:02 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:06:02 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:06:02 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 01:06:02 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:06:04 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:06:04 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:06:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:06:06 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:06:06 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 01:06:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "refresh_cache-c7952bff-87d6-46c1-a6d4-7729dc4893ff" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:06:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquired lock "refresh_cache-c7952bff-87d6-46c1-a6d4-7729dc4893ff" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:06:07 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Forcefully refreshing network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 01:06:07 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Updating instance_info_cache with network_info: [{"id": "de35d2a9-b199-4dbc-8394-915938223e27", "address": "fa:16:3e:b9:56:80", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde35d2a9-b1", "ovs_interfaceid": "de35d2a9-b199-4dbc-8394-915938223e27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:06:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Releasing lock "refresh_cache-c7952bff-87d6-46c1-a6d4-7729dc4893ff" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:06:07 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Updated the network info_cache for instance {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 01:06:08 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:06:08 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Cleaning up deleted instances {{(pid=74850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 01:06:08 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] There are 0 instances to clean {{(pid=74850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 01:06:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:06:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74850) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 01:06:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:06:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:06:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:06:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:06:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:28 user nova-compute[74850]: DEBUG nova.compute.manager [req-b783c5c8-7d69-4ca3-b4fe-8514f66ad5c7 req-214647fd-8d26-4e45-b76d-8aa5089cdbde service nova] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Received event network-changed-212d8fe5-766d-46b8-9ea1-8e2127519282 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:06:28 user nova-compute[74850]: DEBUG nova.compute.manager [req-b783c5c8-7d69-4ca3-b4fe-8514f66ad5c7 req-214647fd-8d26-4e45-b76d-8aa5089cdbde service nova] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Refreshing instance network info cache due to event network-changed-212d8fe5-766d-46b8-9ea1-8e2127519282. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:06:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b783c5c8-7d69-4ca3-b4fe-8514f66ad5c7 req-214647fd-8d26-4e45-b76d-8aa5089cdbde service nova] Acquiring lock "refresh_cache-b6c2a1f5-1cf1-489b-8100-325833c9a42f" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:06:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b783c5c8-7d69-4ca3-b4fe-8514f66ad5c7 req-214647fd-8d26-4e45-b76d-8aa5089cdbde service nova] Acquired lock "refresh_cache-b6c2a1f5-1cf1-489b-8100-325833c9a42f" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:06:28 user nova-compute[74850]: DEBUG nova.network.neutron [req-b783c5c8-7d69-4ca3-b4fe-8514f66ad5c7 req-214647fd-8d26-4e45-b76d-8aa5089cdbde service nova] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Refreshing network info cache for port 212d8fe5-766d-46b8-9ea1-8e2127519282 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:06:28 user nova-compute[74850]: DEBUG nova.network.neutron [req-b783c5c8-7d69-4ca3-b4fe-8514f66ad5c7 req-214647fd-8d26-4e45-b76d-8aa5089cdbde service nova] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Updated VIF entry in instance network info cache for port 212d8fe5-766d-46b8-9ea1-8e2127519282. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:06:28 user nova-compute[74850]: DEBUG nova.network.neutron [req-b783c5c8-7d69-4ca3-b4fe-8514f66ad5c7 req-214647fd-8d26-4e45-b76d-8aa5089cdbde service nova] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Updating instance_info_cache with network_info: [{"id": "212d8fe5-766d-46b8-9ea1-8e2127519282", "address": "fa:16:3e:53:56:58", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap212d8fe5-76", "ovs_interfaceid": "212d8fe5-766d-46b8-9ea1-8e2127519282", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:06:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b783c5c8-7d69-4ca3-b4fe-8514f66ad5c7 req-214647fd-8d26-4e45-b76d-8aa5089cdbde service nova] Releasing lock "refresh_cache-b6c2a1f5-1cf1-489b-8100-325833c9a42f" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:06:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "b6c2a1f5-1cf1-489b-8100-325833c9a42f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:06:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "b6c2a1f5-1cf1-489b-8100-325833c9a42f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:06:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "b6c2a1f5-1cf1-489b-8100-325833c9a42f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:06:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "b6c2a1f5-1cf1-489b-8100-325833c9a42f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:06:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "b6c2a1f5-1cf1-489b-8100-325833c9a42f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:06:28 user nova-compute[74850]: INFO nova.compute.manager [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Terminating instance
Nov 14 01:06:28 user nova-compute[74850]: DEBUG nova.compute.manager [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 01:06:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:28 user nova-compute[74850]: DEBUG nova.compute.manager [req-c4db668a-8243-4a70-81fb-1ad6ea53fda1 req-b22acdc0-e541-41b8-923d-cab2019f797d service nova] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Received event network-vif-unplugged-212d8fe5-766d-46b8-9ea1-8e2127519282 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:06:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c4db668a-8243-4a70-81fb-1ad6ea53fda1 req-b22acdc0-e541-41b8-923d-cab2019f797d service nova] Acquiring lock "b6c2a1f5-1cf1-489b-8100-325833c9a42f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:06:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c4db668a-8243-4a70-81fb-1ad6ea53fda1 req-b22acdc0-e541-41b8-923d-cab2019f797d service nova] Lock "b6c2a1f5-1cf1-489b-8100-325833c9a42f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:06:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c4db668a-8243-4a70-81fb-1ad6ea53fda1 req-b22acdc0-e541-41b8-923d-cab2019f797d service nova] Lock "b6c2a1f5-1cf1-489b-8100-325833c9a42f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:06:28 user nova-compute[74850]: DEBUG nova.compute.manager [req-c4db668a-8243-4a70-81fb-1ad6ea53fda1 req-b22acdc0-e541-41b8-923d-cab2019f797d service nova] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] No waiting events found dispatching network-vif-unplugged-212d8fe5-766d-46b8-9ea1-8e2127519282 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:06:28 user nova-compute[74850]: DEBUG nova.compute.manager [req-c4db668a-8243-4a70-81fb-1ad6ea53fda1 req-b22acdc0-e541-41b8-923d-cab2019f797d service nova] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Received event network-vif-unplugged-212d8fe5-766d-46b8-9ea1-8e2127519282 for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:29 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Instance destroyed successfully.
Nov 14 01:06:29 user nova-compute[74850]: DEBUG nova.objects.instance [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lazy-loading 'resources' on Instance uuid b6c2a1f5-1cf1-489b-8100-325833c9a42f {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:04:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-349198214',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-349198214',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-349198214',id=39,image_ref='4991ba75-d413-4c65-91b6-64223678da1c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrQLa6nPznAFIXCLtN7Qn08ramo6AGebbzjXDkjAZvsUhmESOZUJqVSmYCony8eeSOdX4aGxqxLMlIpg7p76OXRoYvyHZG+FpZHGrLjFFIwpfpsov9cSRPrWeiQNvUd7A==',key_name='tempest-keypair-1566661028',keypairs=<?>,launch_index=0,launched_at=2023-11-14T01:04:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fdb1eb4b5fc841d1952b8db9ae05e446',ramdisk_id='',reservation_id='r-dlugt778',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1536334624',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1536334624-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1536334624',owner_user_name='tempest-TestVolumeBootPattern-1536334624-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T01:04:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c91ddcee4e54a769eb626c816596bed',uuid=b6c2a1f5-1cf1-489b-8100-325833c9a42f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "212d8fe5-766d-46b8-9ea1-8e2127519282", "address": "fa:16:3e:53:56:58", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap212d8fe5-76", "ovs_interfaceid": "212d8fe5-766d-46b8-9ea1-8e2127519282", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Converting VIF {"id": "212d8fe5-766d-46b8-9ea1-8e2127519282", "address": "fa:16:3e:53:56:58", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap212d8fe5-76", "ovs_interfaceid": "212d8fe5-766d-46b8-9ea1-8e2127519282", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:56:58,bridge_name='br-int',has_traffic_filtering=True,id=212d8fe5-766d-46b8-9ea1-8e2127519282,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap212d8fe5-76') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG os_vif [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:56:58,bridge_name='br-int',has_traffic_filtering=True,id=212d8fe5-766d-46b8-9ea1-8e2127519282,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap212d8fe5-76') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap212d8fe5-76, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1fa2ca22-2058-4e4e-a6d4-50abdff7bc69) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:06:29 user nova-compute[74850]: INFO os_vif [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:56:58,bridge_name='br-int',has_traffic_filtering=True,id=212d8fe5-766d-46b8-9ea1-8e2127519282,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap212d8fe5-76')
Nov 14 01:06:29 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WyOGSUHz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:06:29 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:06:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6097ae5b-6cb5-4dac-89d7-a69bc11e268a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 01:06:29 user nova-compute[74850]: No targets found.
Nov 14 01:06:29 user nova-compute[74850]: iSNS:
Nov 14 01:06:29 user nova-compute[74850]: No targets found.
Nov 14 01:06:29 user nova-compute[74850]: STATIC:
Nov 14 01:06:29 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d
Nov 14 01:06:29 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:06:29 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:06:29 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f
Nov 14 01:06:29 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:06:29 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:06:29 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d
Nov 14 01:06:29 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:06:29 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:06:29 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a
Nov 14 01:06:29 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:06:29 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:06:29 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d
Nov 14 01:06:29 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:06:29 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:06:29 user nova-compute[74850]: FIRMWARE:
Nov 14 01:06:29 user nova-compute[74850]: No targets found.
Nov 14 01:06:29 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 01:06:29 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 01:06:29 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e939cca-c1a7-40b3-908f-32bedeaac067]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f5760c-80ec-46b6-bdd5-050b6b831dae]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:06:29 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:06:29 user nova-compute[74850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:06:29 user nova-compute[74850]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f (non-flash)
Nov 14 01:06:29 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:06:29 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:06:29 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:06:29 user nova-compute[74850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:06:29 user nova-compute[74850]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f (non-flash)
Nov 14 01:06:29 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:06:29 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a3c735000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f'): ({'sdb'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Removing single pathed devices sdb {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3da2d20-56a7-46f2-87e3-a33501ed511d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0348a9d-0ae8-448b-9470-218ea5394b3f]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Flushing IO for device /dev/sdb {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fdcf01-769f-4ddc-81ed-83d27760de4d]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8441495d-a2e9-4337-a580-8930ea6f9459]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23766653863633239', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_67b6146e', '/dev/disk/by-id/scsi-1SCST_BIO67b6146e-7fe8cc29dfd8d786') {{(pid=84948) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11a7e76-a6d3-4ec3-9c51-47d3fe5e6090]: (4, None) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d9afdb-296c-4750-9244-fe930e1c96c4]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[29293f14-2023-46b4-8dcd-032f318c82cf]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f, portal: 172.16.0.220,3260]
Nov 14 01:06:29 user nova-compute[74850]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f, portal: 172.16.0.220,3260] successful.
Nov 14 01:06:29 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4119b2fa-608f-4679-b0cb-0a9fb73c9b4f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[731a0ce2-2ad3-456a-8f8c-b3d2e7eb46c0]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] <== disconnect_volume: return (329ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 01:06:29 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Deleting instance files /opt/stack/data/nova/instances/b6c2a1f5-1cf1-489b-8100-325833c9a42f_del
Nov 14 01:06:29 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Deletion of /opt/stack/data/nova/instances/b6c2a1f5-1cf1-489b-8100-325833c9a42f_del complete
Nov 14 01:06:29 user nova-compute[74850]: INFO nova.compute.manager [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 14 01:06:29 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 01:06:29 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 01:06:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "efa96c60-9902-4ca9-8f0e-d27bdb883829" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:06:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "efa96c60-9902-4ca9-8f0e-d27bdb883829" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:06:30 user nova-compute[74850]: DEBUG nova.compute.manager [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 01:06:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:06:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:06:30 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 01:06:30 user nova-compute[74850]: INFO nova.compute.claims [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Claim successful on node user
Nov 14 01:06:30 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:06:30 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Took 0.67 seconds to deallocate network for instance.
Nov 14 01:06:30 user nova-compute[74850]: DEBUG nova.compute.manager [req-83d712e6-0aa4-4f2c-9494-65ab23bfc3d8 req-d49a6e43-5610-4159-966c-f96ad3bc48dd service nova] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Received event network-vif-deleted-212d8fe5-766d-46b8-9ea1-8e2127519282 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:06:30 user nova-compute[74850]: INFO nova.compute.manager [req-83d712e6-0aa4-4f2c-9494-65ab23bfc3d8 req-d49a6e43-5610-4159-966c-f96ad3bc48dd service nova] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Neutron deleted interface 212d8fe5-766d-46b8-9ea1-8e2127519282; detaching it from the instance and deleting it from the info cache
Nov 14 01:06:30 user nova-compute[74850]: DEBUG nova.network.neutron [req-83d712e6-0aa4-4f2c-9494-65ab23bfc3d8 req-d49a6e43-5610-4159-966c-f96ad3bc48dd service nova] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:06:30 user nova-compute[74850]: DEBUG nova.compute.manager [req-83d712e6-0aa4-4f2c-9494-65ab23bfc3d8 req-d49a6e43-5610-4159-966c-f96ad3bc48dd service nova] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Detach interface failed, port_id=212d8fe5-766d-46b8-9ea1-8e2127519282, reason: Instance b6c2a1f5-1cf1-489b-8100-325833c9a42f could not be found. {{(pid=74850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 01:06:30 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:06:30 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:06:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:06:30 user nova-compute[74850]: DEBUG nova.compute.manager [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 01:06:30 user nova-compute[74850]: DEBUG nova.compute.manager [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 01:06:30 user nova-compute[74850]: DEBUG nova.network.neutron [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 01:06:30 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 01:06:30 user nova-compute[74850]: DEBUG nova.compute.manager [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 01:06:30 user nova-compute[74850]: DEBUG nova.policy [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe8332d8221a49db86a402c5851b4882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396f5de82e54abfa812bf8a7e89b0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 01:06:30 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:30 user nova-compute[74850]: DEBUG nova.compute.manager [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 01:06:30 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 01:06:30 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Creating image(s)
Nov 14 01:06:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "/opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:06:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "/opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:06:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "/opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:06:30 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:31 user nova-compute[74850]: DEBUG nova.compute.manager [req-7617b930-7cd0-4a44-b5b7-404436399923 req-a5758396-9b5c-4eff-a02c-c2bb866abb3b service nova] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Received event network-vif-plugged-212d8fe5-766d-46b8-9ea1-8e2127519282 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:06:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7617b930-7cd0-4a44-b5b7-404436399923 req-a5758396-9b5c-4eff-a02c-c2bb866abb3b service nova] Acquiring lock "b6c2a1f5-1cf1-489b-8100-325833c9a42f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:06:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7617b930-7cd0-4a44-b5b7-404436399923 req-a5758396-9b5c-4eff-a02c-c2bb866abb3b service nova] Lock "b6c2a1f5-1cf1-489b-8100-325833c9a42f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:06:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7617b930-7cd0-4a44-b5b7-404436399923 req-a5758396-9b5c-4eff-a02c-c2bb866abb3b service nova] Lock "b6c2a1f5-1cf1-489b-8100-325833c9a42f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:06:31 user nova-compute[74850]: DEBUG nova.compute.manager [req-7617b930-7cd0-4a44-b5b7-404436399923 req-a5758396-9b5c-4eff-a02c-c2bb866abb3b service nova] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] No waiting events found dispatching network-vif-plugged-212d8fe5-766d-46b8-9ea1-8e2127519282 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:06:31 user nova-compute[74850]: WARNING nova.compute.manager [req-7617b930-7cd0-4a44-b5b7-404436399923 req-a5758396-9b5c-4eff-a02c-c2bb866abb3b service nova] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Received unexpected event network-vif-plugged-212d8fe5-766d-46b8-9ea1-8e2127519282 for instance with vm_state active and task_state deleting.
Nov 14 01:06:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.181s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:06:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:06:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.177s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/disk 1073741824" returned: 0 in 0.053s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:06:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:31 user nova-compute[74850]: INFO nova.compute.manager [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Took 0.85 seconds to detach 1 volumes for instance.
Nov 14 01:06:31 user nova-compute[74850]: DEBUG nova.compute.manager [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: b6c2a1f5-1cf1-489b-8100-325833c9a42f] Deleting volume: 4119b2fa-608f-4679-b0cb-0a9fb73c9b4f {{(pid=74850) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 01:06:31 user nova-compute[74850]: DEBUG nova.network.neutron [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Successfully created port: 5e053f78-6ef6-4f30-aedb-30306f10975b {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 01:06:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:06:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:06:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.196s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:31 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Checking if we can resize image /opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 01:06:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:31 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Cannot resize image /opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 01:06:31 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 01:06:31 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Ensure instance console log exists: /opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 01:06:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:06:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:06:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:06:31 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:06:31 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.501s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:06:32 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Deleted allocations for instance b6c2a1f5-1cf1-489b-8100-325833c9a42f
Nov 14 01:06:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-161b1e9a-0fb0-4256-bf73-d7c46eab3613 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "b6c2a1f5-1cf1-489b-8100-325833c9a42f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.488s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG nova.network.neutron [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Successfully updated port: 5e053f78-6ef6-4f30-aedb-30306f10975b {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "refresh_cache-efa96c60-9902-4ca9-8f0e-d27bdb883829" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquired lock "refresh_cache-efa96c60-9902-4ca9-8f0e-d27bdb883829" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG nova.network.neutron [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG nova.network.neutron [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG nova.compute.manager [req-2dfa2884-7689-4351-99e7-f3162a80354e req-95df5139-e5ed-45b9-b594-eb8f2a4267d8 service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Received event network-changed-5e053f78-6ef6-4f30-aedb-30306f10975b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG nova.compute.manager [req-2dfa2884-7689-4351-99e7-f3162a80354e req-95df5139-e5ed-45b9-b594-eb8f2a4267d8 service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Refreshing instance network info cache due to event network-changed-5e053f78-6ef6-4f30-aedb-30306f10975b. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-2dfa2884-7689-4351-99e7-f3162a80354e req-95df5139-e5ed-45b9-b594-eb8f2a4267d8 service nova] Acquiring lock "refresh_cache-efa96c60-9902-4ca9-8f0e-d27bdb883829" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG nova.network.neutron [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Updating instance_info_cache with network_info: [{"id": "5e053f78-6ef6-4f30-aedb-30306f10975b", "address": "fa:16:3e:fc:2e:f2", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e053f78-6e", "ovs_interfaceid": "5e053f78-6ef6-4f30-aedb-30306f10975b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Releasing lock "refresh_cache-efa96c60-9902-4ca9-8f0e-d27bdb883829" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG nova.compute.manager [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Instance network_info: |[{"id": "5e053f78-6ef6-4f30-aedb-30306f10975b", "address": "fa:16:3e:fc:2e:f2", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e053f78-6e", "ovs_interfaceid": "5e053f78-6ef6-4f30-aedb-30306f10975b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-2dfa2884-7689-4351-99e7-f3162a80354e req-95df5139-e5ed-45b9-b594-eb8f2a4267d8 service nova] Acquired lock "refresh_cache-efa96c60-9902-4ca9-8f0e-d27bdb883829" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG nova.network.neutron [req-2dfa2884-7689-4351-99e7-f3162a80354e req-95df5139-e5ed-45b9-b594-eb8f2a4267d8 service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Refreshing network info cache for port 5e053f78-6ef6-4f30-aedb-30306f10975b {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Start _get_guest_xml network_info=[{"id": "5e053f78-6ef6-4f30-aedb-30306f10975b", "address": "fa:16:3e:fc:2e:f2", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e053f78-6e", "ovs_interfaceid": "5e053f78-6ef6-4f30-aedb-30306f10975b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 01:06:32 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:06:32 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:06:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:06:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-133275307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-133275307',id=42,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg2H30iyGq6swB2GrSqVRe5DtzdlWmt0jQC0U9I+/EN3haXyWHelTuvYsSUnUJrIukK4ZeGdNI+eYhTEQ/ZgDVAkbq+5RP8TRJqgY4+Kj2EGhPN8Eb7+ExDQLVf3Qgg+g==',key_name='tempest-keypair-1001532645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e396f5de82e54abfa812bf8a7e89b0c4',ramdisk_id='',reservation_id='r-gpaxa90f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-270753956',owner_user_name='tempest-AttachVolumeShelveTestJSON-270753956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:06:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe8332d8221a49db86a402c5851b4882',uuid=efa96c60-9902-4ca9-8f0e-d27bdb883829,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e053f78-6ef6-4f30-aedb-30306f10975b", "address": "fa:16:3e:fc:2e:f2", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e053f78-6e", "ovs_interfaceid": "5e053f78-6ef6-4f30-aedb-30306f10975b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Converting VIF {"id": "5e053f78-6ef6-4f30-aedb-30306f10975b", "address": "fa:16:3e:fc:2e:f2", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e053f78-6e", "ovs_interfaceid": "5e053f78-6ef6-4f30-aedb-30306f10975b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:2e:f2,bridge_name='br-int',has_traffic_filtering=True,id=5e053f78-6ef6-4f30-aedb-30306f10975b,network=Network(dfd22096-9f0c-4e0f-aac4-06c224b5b9f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e053f78-6e') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG nova.objects.instance [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lazy-loading 'pci_devices' on Instance uuid efa96c60-9902-4ca9-8f0e-d27bdb883829 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] End _get_guest_xml xml=<domain type="kvm">
Nov 14 01:06:32 user nova-compute[74850]:   <uuid>efa96c60-9902-4ca9-8f0e-d27bdb883829</uuid>
Nov 14 01:06:32 user nova-compute[74850]:   <name>instance-0000002a</name>
Nov 14 01:06:32 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 01:06:32 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 01:06:32 user nova-compute[74850]:   <metadata>
Nov 14 01:06:32 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 01:06:32 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 01:06:32 user nova-compute[74850]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-133275307</nova:name>
Nov 14 01:06:32 user nova-compute[74850]:       <nova:creationTime>2023-11-14 01:06:32</nova:creationTime>
Nov 14 01:06:32 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 01:06:32 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 01:06:32 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 01:06:32 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 01:06:32 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 01:06:32 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 01:06:32 user nova-compute[74850]:       </nova:flavor>
Nov 14 01:06:32 user nova-compute[74850]:       <nova:owner>
Nov 14 01:06:32 user nova-compute[74850]:         <nova:user uuid="fe8332d8221a49db86a402c5851b4882">tempest-AttachVolumeShelveTestJSON-270753956-project-member</nova:user>
Nov 14 01:06:32 user nova-compute[74850]:         <nova:project uuid="e396f5de82e54abfa812bf8a7e89b0c4">tempest-AttachVolumeShelveTestJSON-270753956</nova:project>
Nov 14 01:06:32 user nova-compute[74850]:       </nova:owner>
Nov 14 01:06:32 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 01:06:32 user nova-compute[74850]:       <nova:ports>
Nov 14 01:06:32 user nova-compute[74850]:         <nova:port uuid="5e053f78-6ef6-4f30-aedb-30306f10975b">
Nov 14 01:06:32 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 01:06:32 user nova-compute[74850]:         </nova:port>
Nov 14 01:06:32 user nova-compute[74850]:       </nova:ports>
Nov 14 01:06:32 user nova-compute[74850]:     </nova:instance>
Nov 14 01:06:32 user nova-compute[74850]:   </metadata>
Nov 14 01:06:32 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 01:06:32 user nova-compute[74850]:     <system>
Nov 14 01:06:32 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 01:06:32 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 01:06:32 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 01:06:32 user nova-compute[74850]:       <entry name="serial">efa96c60-9902-4ca9-8f0e-d27bdb883829</entry>
Nov 14 01:06:32 user nova-compute[74850]:       <entry name="uuid">efa96c60-9902-4ca9-8f0e-d27bdb883829</entry>
Nov 14 01:06:32 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 01:06:32 user nova-compute[74850]:     </system>
Nov 14 01:06:32 user nova-compute[74850]:   </sysinfo>
Nov 14 01:06:32 user nova-compute[74850]:   <os>
Nov 14 01:06:32 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 01:06:32 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 01:06:32 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 01:06:32 user nova-compute[74850]:   </os>
Nov 14 01:06:32 user nova-compute[74850]:   <features>
Nov 14 01:06:32 user nova-compute[74850]:     <acpi/>
Nov 14 01:06:32 user nova-compute[74850]:     <apic/>
Nov 14 01:06:32 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 01:06:32 user nova-compute[74850]:   </features>
Nov 14 01:06:32 user nova-compute[74850]:   <clock offset="utc">
Nov 14 01:06:32 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 01:06:32 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 01:06:32 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 01:06:32 user nova-compute[74850]:   </clock>
Nov 14 01:06:32 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 01:06:32 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 01:06:32 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 01:06:32 user nova-compute[74850]:   </cpu>
Nov 14 01:06:32 user nova-compute[74850]:   <devices>
Nov 14 01:06:32 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 01:06:32 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 01:06:32 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/disk"/>
Nov 14 01:06:32 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 01:06:32 user nova-compute[74850]:     </disk>
Nov 14 01:06:32 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 01:06:32 user nova-compute[74850]:       <mac address="fa:16:3e:fc:2e:f2"/>
Nov 14 01:06:32 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:06:32 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 01:06:32 user nova-compute[74850]:       <target dev="tap5e053f78-6e"/>
Nov 14 01:06:32 user nova-compute[74850]:     </interface>
Nov 14 01:06:32 user nova-compute[74850]:     <serial type="pty">
Nov 14 01:06:32 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/console.log" append="off"/>
Nov 14 01:06:32 user nova-compute[74850]:     </serial>
Nov 14 01:06:32 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 01:06:32 user nova-compute[74850]:     <video>
Nov 14 01:06:32 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:06:32 user nova-compute[74850]:     </video>
Nov 14 01:06:32 user nova-compute[74850]:     <rng model="virtio">
Nov 14 01:06:32 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 01:06:32 user nova-compute[74850]:     </rng>
Nov 14 01:06:32 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 01:06:32 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 01:06:32 user nova-compute[74850]:       <stats period="10"/>
Nov 14 01:06:32 user nova-compute[74850]:     </memballoon>
Nov 14 01:06:32 user nova-compute[74850]:   </devices>
Nov 14 01:06:32 user nova-compute[74850]: </domain>
Nov 14 01:06:32 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:06:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-133275307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-133275307',id=42,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg2H30iyGq6swB2GrSqVRe5DtzdlWmt0jQC0U9I+/EN3haXyWHelTuvYsSUnUJrIukK4ZeGdNI+eYhTEQ/ZgDVAkbq+5RP8TRJqgY4+Kj2EGhPN8Eb7+ExDQLVf3Qgg+g==',key_name='tempest-keypair-1001532645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e396f5de82e54abfa812bf8a7e89b0c4',ramdisk_id='',reservation_id='r-gpaxa90f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-270753956',owner_user_name='tempest-AttachVolumeShelveTestJSON-270753956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:06:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe8332d8221a49db86a402c5851b4882',uuid=efa96c60-9902-4ca9-8f0e-d27bdb883829,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e053f78-6ef6-4f30-aedb-30306f10975b", "address": "fa:16:3e:fc:2e:f2", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e053f78-6e", "ovs_interfaceid": "5e053f78-6ef6-4f30-aedb-30306f10975b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Converting VIF {"id": "5e053f78-6ef6-4f30-aedb-30306f10975b", "address": "fa:16:3e:fc:2e:f2", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e053f78-6e", "ovs_interfaceid": "5e053f78-6ef6-4f30-aedb-30306f10975b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:2e:f2,bridge_name='br-int',has_traffic_filtering=True,id=5e053f78-6ef6-4f30-aedb-30306f10975b,network=Network(dfd22096-9f0c-4e0f-aac4-06c224b5b9f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e053f78-6e') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG os_vif [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:2e:f2,bridge_name='br-int',has_traffic_filtering=True,id=5e053f78-6ef6-4f30-aedb-30306f10975b,network=Network(dfd22096-9f0c-4e0f-aac4-06c224b5b9f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e053f78-6e') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc3a99d2-9b32-582f-bf78-275a252ee9be', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e053f78-6e, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5e053f78-6e, col_values=(('qos', UUID('aac2ce21-fa64-48ac-a809-ead36e5b75ed')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5e053f78-6e, col_values=(('external_ids', {'iface-id': '5e053f78-6ef6-4f30-aedb-30306f10975b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:2e:f2', 'vm-uuid': 'efa96c60-9902-4ca9-8f0e-d27bdb883829'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:32 user nova-compute[74850]: INFO os_vif [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:2e:f2,bridge_name='br-int',has_traffic_filtering=True,id=5e053f78-6ef6-4f30-aedb-30306f10975b,network=Network(dfd22096-9f0c-4e0f-aac4-06c224b5b9f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e053f78-6e')
Nov 14 01:06:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:06:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] No VIF found with MAC fa:16:3e:fc:2e:f2, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:06:33 user nova-compute[74850]: DEBUG nova.network.neutron [req-2dfa2884-7689-4351-99e7-f3162a80354e req-95df5139-e5ed-45b9-b594-eb8f2a4267d8 service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Updated VIF entry in instance network info cache for port 5e053f78-6ef6-4f30-aedb-30306f10975b. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:06:33 user nova-compute[74850]: DEBUG nova.network.neutron [req-2dfa2884-7689-4351-99e7-f3162a80354e req-95df5139-e5ed-45b9-b594-eb8f2a4267d8 service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Updating instance_info_cache with network_info: [{"id": "5e053f78-6ef6-4f30-aedb-30306f10975b", "address": "fa:16:3e:fc:2e:f2", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e053f78-6e", "ovs_interfaceid": "5e053f78-6ef6-4f30-aedb-30306f10975b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:06:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-2dfa2884-7689-4351-99e7-f3162a80354e req-95df5139-e5ed-45b9-b594-eb8f2a4267d8 service nova] Releasing lock "refresh_cache-efa96c60-9902-4ca9-8f0e-d27bdb883829" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:06:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Acquiring lock "2294e4d8-7e62-4875-822f-bc9020721881" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:06:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "2294e4d8-7e62-4875-822f-bc9020721881" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:06:34 user nova-compute[74850]: DEBUG nova.compute.manager [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 01:06:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:06:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:06:34 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 01:06:34 user nova-compute[74850]: INFO nova.compute.claims [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Claim successful on node user
Nov 14 01:06:34 user nova-compute[74850]: DEBUG nova.compute.manager [req-0586a54d-4fba-49bd-8402-fa4b0a616822 req-d9da2311-86ee-477c-93d9-9f90bef7700b service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Received event network-vif-plugged-5e053f78-6ef6-4f30-aedb-30306f10975b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:06:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-0586a54d-4fba-49bd-8402-fa4b0a616822 req-d9da2311-86ee-477c-93d9-9f90bef7700b service nova] Acquiring lock "efa96c60-9902-4ca9-8f0e-d27bdb883829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:06:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-0586a54d-4fba-49bd-8402-fa4b0a616822 req-d9da2311-86ee-477c-93d9-9f90bef7700b service nova] Lock "efa96c60-9902-4ca9-8f0e-d27bdb883829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:06:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-0586a54d-4fba-49bd-8402-fa4b0a616822 req-d9da2311-86ee-477c-93d9-9f90bef7700b service nova] Lock "efa96c60-9902-4ca9-8f0e-d27bdb883829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:06:34 user nova-compute[74850]: DEBUG nova.compute.manager [req-0586a54d-4fba-49bd-8402-fa4b0a616822 req-d9da2311-86ee-477c-93d9-9f90bef7700b service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] No waiting events found dispatching network-vif-plugged-5e053f78-6ef6-4f30-aedb-30306f10975b {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:06:34 user nova-compute[74850]: WARNING nova.compute.manager [req-0586a54d-4fba-49bd-8402-fa4b0a616822 req-d9da2311-86ee-477c-93d9-9f90bef7700b service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Received unexpected event network-vif-plugged-5e053f78-6ef6-4f30-aedb-30306f10975b for instance with vm_state building and task_state spawning.
Nov 14 01:06:34 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:06:34 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:06:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:06:34 user nova-compute[74850]: DEBUG nova.compute.manager [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 01:06:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:34 user nova-compute[74850]: DEBUG nova.compute.manager [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 01:06:34 user nova-compute[74850]: DEBUG nova.network.neutron [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 01:06:34 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 01:06:34 user nova-compute[74850]: DEBUG nova.compute.manager [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 01:06:34 user nova-compute[74850]: DEBUG nova.policy [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7ab31389a2f415eb08ca3ddaae08ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84022f7a63234abba05ae4e88035fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 01:06:34 user nova-compute[74850]: DEBUG nova.compute.manager [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 01:06:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 01:06:34 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Creating image(s)
Nov 14 01:06:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Acquiring lock "/opt/stack/data/nova/instances/2294e4d8-7e62-4875-822f-bc9020721881/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:06:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "/opt/stack/data/nova/instances/2294e4d8-7e62-4875-822f-bc9020721881/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:06:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "/opt/stack/data/nova/instances/2294e4d8-7e62-4875-822f-bc9020721881/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:06:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.203s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:06:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:06:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.198s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/2294e4d8-7e62-4875-822f-bc9020721881/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:35 user nova-compute[74850]: DEBUG nova.network.neutron [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Successfully created port: 2822a7a1-9ee8-4cf0-8019-d6910111297a {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 01:06:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/2294e4d8-7e62-4875-822f-bc9020721881/disk 1073741824" returned: 0 in 0.060s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:06:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.182s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:35 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2294e4d8-7e62-4875-822f-bc9020721881/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 01:06:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2294e4d8-7e62-4875-822f-bc9020721881/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2294e4d8-7e62-4875-822f-bc9020721881/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:35 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Cannot resize image /opt/stack/data/nova/instances/2294e4d8-7e62-4875-822f-bc9020721881/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 01:06:35 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 01:06:35 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Ensure instance console log exists: /opt/stack/data/nova/instances/2294e4d8-7e62-4875-822f-bc9020721881/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 01:06:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:06:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:06:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:06:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.network.neutron [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Successfully updated port: 2822a7a1-9ee8-4cf0-8019-d6910111297a {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Acquiring lock "refresh_cache-2294e4d8-7e62-4875-822f-bc9020721881" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Acquired lock "refresh_cache-2294e4d8-7e62-4875-822f-bc9020721881" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.network.neutron [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.compute.manager [req-db13cf13-0108-44f6-bdd7-450f46ac0f5f req-12e7bcc0-2e1c-4114-b9b5-af25642fedb5 service nova] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Received event network-changed-2822a7a1-9ee8-4cf0-8019-d6910111297a {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.compute.manager [req-db13cf13-0108-44f6-bdd7-450f46ac0f5f req-12e7bcc0-2e1c-4114-b9b5-af25642fedb5 service nova] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Refreshing instance network info cache due to event network-changed-2822a7a1-9ee8-4cf0-8019-d6910111297a. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-db13cf13-0108-44f6-bdd7-450f46ac0f5f req-12e7bcc0-2e1c-4114-b9b5-af25642fedb5 service nova] Acquiring lock "refresh_cache-2294e4d8-7e62-4875-822f-bc9020721881" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.network.neutron [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.compute.manager [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 01:06:36 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Instance spawned successfully.
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.compute.manager [req-49155b82-0bd2-45e6-93f7-7120a3d119a5 req-f2776128-76a1-4d68-a5f2-93a6a2aa6c46 service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Received event network-vif-plugged-5e053f78-6ef6-4f30-aedb-30306f10975b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-49155b82-0bd2-45e6-93f7-7120a3d119a5 req-f2776128-76a1-4d68-a5f2-93a6a2aa6c46 service nova] Acquiring lock "efa96c60-9902-4ca9-8f0e-d27bdb883829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-49155b82-0bd2-45e6-93f7-7120a3d119a5 req-f2776128-76a1-4d68-a5f2-93a6a2aa6c46 service nova] Lock "efa96c60-9902-4ca9-8f0e-d27bdb883829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-49155b82-0bd2-45e6-93f7-7120a3d119a5 req-f2776128-76a1-4d68-a5f2-93a6a2aa6c46 service nova] Lock "efa96c60-9902-4ca9-8f0e-d27bdb883829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.compute.manager [req-49155b82-0bd2-45e6-93f7-7120a3d119a5 req-f2776128-76a1-4d68-a5f2-93a6a2aa6c46 service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] No waiting events found dispatching network-vif-plugged-5e053f78-6ef6-4f30-aedb-30306f10975b {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:06:36 user nova-compute[74850]: WARNING nova.compute.manager [req-49155b82-0bd2-45e6-93f7-7120a3d119a5 req-f2776128-76a1-4d68-a5f2-93a6a2aa6c46 service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Received unexpected event network-vif-plugged-5e053f78-6ef6-4f30-aedb-30306f10975b for instance with vm_state building and task_state spawning.
Nov 14 01:06:36 user nova-compute[74850]: INFO nova.compute.manager [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Took 5.61 seconds to spawn the instance on the hypervisor.
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.compute.manager [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.network.neutron [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Updating instance_info_cache with network_info: [{"id": "2822a7a1-9ee8-4cf0-8019-d6910111297a", "address": "fa:16:3e:8f:6d:ed", "network": {"id": "e822a969-afbd-4415-a246-324f9b0c98ce", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1543025211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84022f7a63234abba05ae4e88035fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2822a7a1-9e", "ovs_interfaceid": "2822a7a1-9ee8-4cf0-8019-d6910111297a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:06:36 user nova-compute[74850]: INFO nova.compute.manager [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Took 6.47 seconds to build instance.
Nov 14 01:06:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Releasing lock "refresh_cache-2294e4d8-7e62-4875-822f-bc9020721881" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.compute.manager [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Instance network_info: |[{"id": "2822a7a1-9ee8-4cf0-8019-d6910111297a", "address": "fa:16:3e:8f:6d:ed", "network": {"id": "e822a969-afbd-4415-a246-324f9b0c98ce", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1543025211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84022f7a63234abba05ae4e88035fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2822a7a1-9e", "ovs_interfaceid": "2822a7a1-9ee8-4cf0-8019-d6910111297a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-db13cf13-0108-44f6-bdd7-450f46ac0f5f req-12e7bcc0-2e1c-4114-b9b5-af25642fedb5 service nova] Acquired lock "refresh_cache-2294e4d8-7e62-4875-822f-bc9020721881" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.network.neutron [req-db13cf13-0108-44f6-bdd7-450f46ac0f5f req-12e7bcc0-2e1c-4114-b9b5-af25642fedb5 service nova] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Refreshing network info cache for port 2822a7a1-9ee8-4cf0-8019-d6910111297a {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Start _get_guest_xml network_info=[{"id": "2822a7a1-9ee8-4cf0-8019-d6910111297a", "address": "fa:16:3e:8f:6d:ed", "network": {"id": "e822a969-afbd-4415-a246-324f9b0c98ce", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1543025211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84022f7a63234abba05ae4e88035fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2822a7a1-9e", "ovs_interfaceid": "2822a7a1-9ee8-4cf0-8019-d6910111297a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2fd1c08c-91b6-4a1c-9efd-f5a78241e11d tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "efa96c60-9902-4ca9-8f0e-d27bdb883829" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.585s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:06:36 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:06:36 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:06:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-821876197',display_name='tempest-VolumesSnapshotTestJSON-instance-821876197',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-821876197',id=43,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaTjcArpdQs3aIoEAmtnHXCY79HzOL5GCGOWaCP4CxYbO1Ymf+RMBx2oF5vYKKCsZNRCiKP5IUWLc5moMXp1AKZy4tICMZ3aBmamtPrDe6bqzU280rm1yAgNa6kRP9IAw==',key_name='tempest-keypair-857764945',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84022f7a63234abba05ae4e88035fd34',ramdisk_id='',reservation_id='r-ot223e0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1878797663',owner_user_name='tempest-VolumesSnapshotTestJSON-1878797663-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:06:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7ab31389a2f415eb08ca3ddaae08ddd',uuid=2294e4d8-7e62-4875-822f-bc9020721881,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2822a7a1-9ee8-4cf0-8019-d6910111297a", "address": "fa:16:3e:8f:6d:ed", "network": {"id": "e822a969-afbd-4415-a246-324f9b0c98ce", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1543025211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84022f7a63234abba05ae4e88035fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2822a7a1-9e", "ovs_interfaceid": "2822a7a1-9ee8-4cf0-8019-d6910111297a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Converting VIF {"id": "2822a7a1-9ee8-4cf0-8019-d6910111297a", "address": "fa:16:3e:8f:6d:ed", "network": {"id": "e822a969-afbd-4415-a246-324f9b0c98ce", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1543025211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84022f7a63234abba05ae4e88035fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2822a7a1-9e", "ovs_interfaceid": "2822a7a1-9ee8-4cf0-8019-d6910111297a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:6d:ed,bridge_name='br-int',has_traffic_filtering=True,id=2822a7a1-9ee8-4cf0-8019-d6910111297a,network=Network(e822a969-afbd-4415-a246-324f9b0c98ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2822a7a1-9e') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.objects.instance [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lazy-loading 'pci_devices' on Instance uuid 2294e4d8-7e62-4875-822f-bc9020721881 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] End _get_guest_xml xml=<domain type="kvm">
Nov 14 01:06:36 user nova-compute[74850]:   <uuid>2294e4d8-7e62-4875-822f-bc9020721881</uuid>
Nov 14 01:06:36 user nova-compute[74850]:   <name>instance-0000002b</name>
Nov 14 01:06:36 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 01:06:36 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 01:06:36 user nova-compute[74850]:   <metadata>
Nov 14 01:06:36 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 01:06:36 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 01:06:36 user nova-compute[74850]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-821876197</nova:name>
Nov 14 01:06:36 user nova-compute[74850]:       <nova:creationTime>2023-11-14 01:06:36</nova:creationTime>
Nov 14 01:06:36 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 01:06:36 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 01:06:36 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 01:06:36 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 01:06:36 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 01:06:36 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 01:06:36 user nova-compute[74850]:       </nova:flavor>
Nov 14 01:06:36 user nova-compute[74850]:       <nova:owner>
Nov 14 01:06:36 user nova-compute[74850]:         <nova:user uuid="d7ab31389a2f415eb08ca3ddaae08ddd">tempest-VolumesSnapshotTestJSON-1878797663-project-member</nova:user>
Nov 14 01:06:36 user nova-compute[74850]:         <nova:project uuid="84022f7a63234abba05ae4e88035fd34">tempest-VolumesSnapshotTestJSON-1878797663</nova:project>
Nov 14 01:06:36 user nova-compute[74850]:       </nova:owner>
Nov 14 01:06:36 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 01:06:36 user nova-compute[74850]:       <nova:ports>
Nov 14 01:06:36 user nova-compute[74850]:         <nova:port uuid="2822a7a1-9ee8-4cf0-8019-d6910111297a">
Nov 14 01:06:36 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 01:06:36 user nova-compute[74850]:         </nova:port>
Nov 14 01:06:36 user nova-compute[74850]:       </nova:ports>
Nov 14 01:06:36 user nova-compute[74850]:     </nova:instance>
Nov 14 01:06:36 user nova-compute[74850]:   </metadata>
Nov 14 01:06:36 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 01:06:36 user nova-compute[74850]:     <system>
Nov 14 01:06:36 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 01:06:36 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 01:06:36 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 01:06:36 user nova-compute[74850]:       <entry name="serial">2294e4d8-7e62-4875-822f-bc9020721881</entry>
Nov 14 01:06:36 user nova-compute[74850]:       <entry name="uuid">2294e4d8-7e62-4875-822f-bc9020721881</entry>
Nov 14 01:06:36 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 01:06:36 user nova-compute[74850]:     </system>
Nov 14 01:06:36 user nova-compute[74850]:   </sysinfo>
Nov 14 01:06:36 user nova-compute[74850]:   <os>
Nov 14 01:06:36 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 01:06:36 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 01:06:36 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 01:06:36 user nova-compute[74850]:   </os>
Nov 14 01:06:36 user nova-compute[74850]:   <features>
Nov 14 01:06:36 user nova-compute[74850]:     <acpi/>
Nov 14 01:06:36 user nova-compute[74850]:     <apic/>
Nov 14 01:06:36 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 01:06:36 user nova-compute[74850]:   </features>
Nov 14 01:06:36 user nova-compute[74850]:   <clock offset="utc">
Nov 14 01:06:36 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 01:06:36 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 01:06:36 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 01:06:36 user nova-compute[74850]:   </clock>
Nov 14 01:06:36 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 01:06:36 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 01:06:36 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 01:06:36 user nova-compute[74850]:   </cpu>
Nov 14 01:06:36 user nova-compute[74850]:   <devices>
Nov 14 01:06:36 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 01:06:36 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 01:06:36 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/2294e4d8-7e62-4875-822f-bc9020721881/disk"/>
Nov 14 01:06:36 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 01:06:36 user nova-compute[74850]:     </disk>
Nov 14 01:06:36 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 01:06:36 user nova-compute[74850]:       <mac address="fa:16:3e:8f:6d:ed"/>
Nov 14 01:06:36 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:06:36 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 01:06:36 user nova-compute[74850]:       <target dev="tap2822a7a1-9e"/>
Nov 14 01:06:36 user nova-compute[74850]:     </interface>
Nov 14 01:06:36 user nova-compute[74850]:     <serial type="pty">
Nov 14 01:06:36 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/2294e4d8-7e62-4875-822f-bc9020721881/console.log" append="off"/>
Nov 14 01:06:36 user nova-compute[74850]:     </serial>
Nov 14 01:06:36 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 01:06:36 user nova-compute[74850]:     <video>
Nov 14 01:06:36 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:06:36 user nova-compute[74850]:     </video>
Nov 14 01:06:36 user nova-compute[74850]:     <rng model="virtio">
Nov 14 01:06:36 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 01:06:36 user nova-compute[74850]:     </rng>
Nov 14 01:06:36 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 01:06:36 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 01:06:36 user nova-compute[74850]:       <stats period="10"/>
Nov 14 01:06:36 user nova-compute[74850]:     </memballoon>
Nov 14 01:06:36 user nova-compute[74850]:   </devices>
Nov 14 01:06:36 user nova-compute[74850]: </domain>
Nov 14 01:06:36 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:06:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-821876197',display_name='tempest-VolumesSnapshotTestJSON-instance-821876197',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-821876197',id=43,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaTjcArpdQs3aIoEAmtnHXCY79HzOL5GCGOWaCP4CxYbO1Ymf+RMBx2oF5vYKKCsZNRCiKP5IUWLc5moMXp1AKZy4tICMZ3aBmamtPrDe6bqzU280rm1yAgNa6kRP9IAw==',key_name='tempest-keypair-857764945',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84022f7a63234abba05ae4e88035fd34',ramdisk_id='',reservation_id='r-ot223e0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1878797663',owner_user_name='tempest-VolumesSnapshotTestJSON-1878797663-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:06:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7ab31389a2f415eb08ca3ddaae08ddd',uuid=2294e4d8-7e62-4875-822f-bc9020721881,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2822a7a1-9ee8-4cf0-8019-d6910111297a", "address": "fa:16:3e:8f:6d:ed", "network": {"id": "e822a969-afbd-4415-a246-324f9b0c98ce", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1543025211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84022f7a63234abba05ae4e88035fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2822a7a1-9e", "ovs_interfaceid": "2822a7a1-9ee8-4cf0-8019-d6910111297a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Converting VIF {"id": "2822a7a1-9ee8-4cf0-8019-d6910111297a", "address": "fa:16:3e:8f:6d:ed", "network": {"id": "e822a969-afbd-4415-a246-324f9b0c98ce", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1543025211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84022f7a63234abba05ae4e88035fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2822a7a1-9e", "ovs_interfaceid": "2822a7a1-9ee8-4cf0-8019-d6910111297a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:6d:ed,bridge_name='br-int',has_traffic_filtering=True,id=2822a7a1-9ee8-4cf0-8019-d6910111297a,network=Network(e822a969-afbd-4415-a246-324f9b0c98ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2822a7a1-9e') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG os_vif [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:6d:ed,bridge_name='br-int',has_traffic_filtering=True,id=2822a7a1-9ee8-4cf0-8019-d6910111297a,network=Network(e822a969-afbd-4415-a246-324f9b0c98ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2822a7a1-9e') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dc42a657-fc1e-5ead-b0c8-6803260875e6', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2822a7a1-9e, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2822a7a1-9e, col_values=(('qos', UUID('8e4257a3-5c4a-45dd-a3f7-39678b8e9be6')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2822a7a1-9e, col_values=(('external_ids', {'iface-id': '2822a7a1-9ee8-4cf0-8019-d6910111297a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:6d:ed', 'vm-uuid': '2294e4d8-7e62-4875-822f-bc9020721881'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:36 user nova-compute[74850]: INFO os_vif [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:6d:ed,bridge_name='br-int',has_traffic_filtering=True,id=2822a7a1-9ee8-4cf0-8019-d6910111297a,network=Network(e822a969-afbd-4415-a246-324f9b0c98ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2822a7a1-9e')
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] No VIF found with MAC fa:16:3e:8f:6d:ed, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.network.neutron [req-db13cf13-0108-44f6-bdd7-450f46ac0f5f req-12e7bcc0-2e1c-4114-b9b5-af25642fedb5 service nova] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Updated VIF entry in instance network info cache for port 2822a7a1-9ee8-4cf0-8019-d6910111297a. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:06:36 user nova-compute[74850]: DEBUG nova.network.neutron [req-db13cf13-0108-44f6-bdd7-450f46ac0f5f req-12e7bcc0-2e1c-4114-b9b5-af25642fedb5 service nova] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Updating instance_info_cache with network_info: [{"id": "2822a7a1-9ee8-4cf0-8019-d6910111297a", "address": "fa:16:3e:8f:6d:ed", "network": {"id": "e822a969-afbd-4415-a246-324f9b0c98ce", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1543025211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84022f7a63234abba05ae4e88035fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2822a7a1-9e", "ovs_interfaceid": "2822a7a1-9ee8-4cf0-8019-d6910111297a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:06:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-db13cf13-0108-44f6-bdd7-450f46ac0f5f req-12e7bcc0-2e1c-4114-b9b5-af25642fedb5 service nova] Releasing lock "refresh_cache-2294e4d8-7e62-4875-822f-bc9020721881" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:06:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:38 user nova-compute[74850]: DEBUG nova.compute.manager [req-49aa67b3-17f0-4ab5-b5f2-81668d16788c req-873d667e-5dae-41e3-8e41-f565b93762e1 service nova] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Received event network-vif-plugged-2822a7a1-9ee8-4cf0-8019-d6910111297a {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:06:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-49aa67b3-17f0-4ab5-b5f2-81668d16788c req-873d667e-5dae-41e3-8e41-f565b93762e1 service nova] Acquiring lock "2294e4d8-7e62-4875-822f-bc9020721881-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:06:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-49aa67b3-17f0-4ab5-b5f2-81668d16788c req-873d667e-5dae-41e3-8e41-f565b93762e1 service nova] Lock "2294e4d8-7e62-4875-822f-bc9020721881-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:06:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-49aa67b3-17f0-4ab5-b5f2-81668d16788c req-873d667e-5dae-41e3-8e41-f565b93762e1 service nova] Lock "2294e4d8-7e62-4875-822f-bc9020721881-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:06:38 user nova-compute[74850]: DEBUG nova.compute.manager [req-49aa67b3-17f0-4ab5-b5f2-81668d16788c req-873d667e-5dae-41e3-8e41-f565b93762e1 service nova] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] No waiting events found dispatching network-vif-plugged-2822a7a1-9ee8-4cf0-8019-d6910111297a {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:06:38 user nova-compute[74850]: WARNING nova.compute.manager [req-49aa67b3-17f0-4ab5-b5f2-81668d16788c req-873d667e-5dae-41e3-8e41-f565b93762e1 service nova] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Received unexpected event network-vif-plugged-2822a7a1-9ee8-4cf0-8019-d6910111297a for instance with vm_state building and task_state spawning.
Nov 14 01:06:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:40 user nova-compute[74850]: DEBUG nova.compute.manager [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 01:06:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 01:06:40 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Instance spawned successfully.
Nov 14 01:06:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 01:06:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:06:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:06:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:06:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:06:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:06:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:06:40 user nova-compute[74850]: INFO nova.compute.manager [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Took 5.68 seconds to spawn the instance on the hypervisor.
Nov 14 01:06:40 user nova-compute[74850]: DEBUG nova.compute.manager [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 01:06:40 user nova-compute[74850]: INFO nova.compute.manager [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Took 6.48 seconds to build instance.
Nov 14 01:06:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-67ba5606-429d-48ae-97ac-34fa6172c095 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "2294e4d8-7e62-4875-822f-bc9020721881" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.597s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:06:40 user nova-compute[74850]: DEBUG nova.compute.manager [req-72438cd3-c43a-4674-9915-af6e1ec81e12 req-b79017e8-f6cf-41f1-a326-9a11345054af service nova] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Received event network-vif-plugged-2822a7a1-9ee8-4cf0-8019-d6910111297a {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:06:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-72438cd3-c43a-4674-9915-af6e1ec81e12 req-b79017e8-f6cf-41f1-a326-9a11345054af service nova] Acquiring lock "2294e4d8-7e62-4875-822f-bc9020721881-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:06:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-72438cd3-c43a-4674-9915-af6e1ec81e12 req-b79017e8-f6cf-41f1-a326-9a11345054af service nova] Lock "2294e4d8-7e62-4875-822f-bc9020721881-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:06:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-72438cd3-c43a-4674-9915-af6e1ec81e12 req-b79017e8-f6cf-41f1-a326-9a11345054af service nova] Lock "2294e4d8-7e62-4875-822f-bc9020721881-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:06:40 user nova-compute[74850]: DEBUG nova.compute.manager [req-72438cd3-c43a-4674-9915-af6e1ec81e12 req-b79017e8-f6cf-41f1-a326-9a11345054af service nova] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] No waiting events found dispatching network-vif-plugged-2822a7a1-9ee8-4cf0-8019-d6910111297a {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:06:40 user nova-compute[74850]: WARNING nova.compute.manager [req-72438cd3-c43a-4674-9915-af6e1ec81e12 req-b79017e8-f6cf-41f1-a326-9a11345054af service nova] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Received unexpected event network-vif-plugged-2822a7a1-9ee8-4cf0-8019-d6910111297a for instance with vm_state active and task_state None.
Nov 14 01:06:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:43 user nova-compute[74850]: INFO nova.compute.manager [None req-e40fd535-1e2e-4038-8fa4-767e60328c31 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Get console output
Nov 14 01:06:43 user nova-compute[74850]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 14 01:06:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:55 user nova-compute[74850]: INFO nova.compute.manager [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Rescuing
Nov 14 01:06:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "refresh_cache-e6e38d20-9aac-4037-b1b4-0c25005a9a67" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:06:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquired lock "refresh_cache-e6e38d20-9aac-4037-b1b4-0c25005a9a67" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:06:55 user nova-compute[74850]: DEBUG nova.network.neutron [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 01:06:55 user nova-compute[74850]: DEBUG nova.network.neutron [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Updating instance_info_cache with network_info: [{"id": "9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe", "address": "fa:16:3e:f7:6e:24", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c0cbd8f-1b", "ovs_interfaceid": "9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:06:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Releasing lock "refresh_cache-e6e38d20-9aac-4037-b1b4-0c25005a9a67" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:06:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:55 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:06:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:06:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:06:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:06:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 01:06:56 user nova-compute[74850]: DEBUG nova.compute.manager [req-0f0857a8-7682-47dd-879f-ae116ddc4604 req-6fc92555-2524-409d-89a3-523471529401 service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Received event network-vif-unplugged-9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:06:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-0f0857a8-7682-47dd-879f-ae116ddc4604 req-6fc92555-2524-409d-89a3-523471529401 service nova] Acquiring lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:06:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-0f0857a8-7682-47dd-879f-ae116ddc4604 req-6fc92555-2524-409d-89a3-523471529401 service nova] Lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:06:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-0f0857a8-7682-47dd-879f-ae116ddc4604 req-6fc92555-2524-409d-89a3-523471529401 service nova] Lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:06:56 user nova-compute[74850]: DEBUG nova.compute.manager [req-0f0857a8-7682-47dd-879f-ae116ddc4604 req-6fc92555-2524-409d-89a3-523471529401 service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] No waiting events found dispatching network-vif-unplugged-9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:06:56 user nova-compute[74850]: WARNING nova.compute.manager [req-0f0857a8-7682-47dd-879f-ae116ddc4604 req-6fc92555-2524-409d-89a3-523471529401 service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Received unexpected event network-vif-unplugged-9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe for instance with vm_state active and task_state rescuing.
Nov 14 01:06:56 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:56 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:56 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Instance destroyed successfully.
Nov 14 01:06:56 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Attempting a stable device rescue
Nov 14 01:06:56 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74850) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 01:06:56 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Instance directory exists: not creating {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 01:06:56 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Creating image(s)
Nov 14 01:06:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6e38d20-9aac-4037-b1b4-0c25005a9a67/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:06:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "/opt/stack/data/nova/instances/e6e38d20-9aac-4037-b1b4-0c25005a9a67/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:06:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "/opt/stack/data/nova/instances/e6e38d20-9aac-4037-b1b4-0c25005a9a67/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:06:56 user nova-compute[74850]: DEBUG nova.objects.instance [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lazy-loading 'trusted_certs' on Instance uuid e6e38d20-9aac-4037-b1b4-0c25005a9a67 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:06:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "245de3558fe3f5aa4cc5d44bc16c5598590e763e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:06:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "245de3558fe3f5aa4cc5d44bc16c5598590e763e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:06:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:56 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:06:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/245de3558fe3f5aa4cc5d44bc16c5598590e763e.part --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:57 user nova-compute[74850]: DEBUG nova.compute.manager [req-dcfeaf2b-1fe7-4898-962a-6d9a02b1972b req-c7d3dd81-27b4-4c1a-902c-2d9906383380 service nova] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Received event network-changed-0bd9a14c-20bb-49e2-9af2-d84aef11483b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:06:57 user nova-compute[74850]: DEBUG nova.compute.manager [req-dcfeaf2b-1fe7-4898-962a-6d9a02b1972b req-c7d3dd81-27b4-4c1a-902c-2d9906383380 service nova] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Refreshing instance network info cache due to event network-changed-0bd9a14c-20bb-49e2-9af2-d84aef11483b. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:06:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-dcfeaf2b-1fe7-4898-962a-6d9a02b1972b req-c7d3dd81-27b4-4c1a-902c-2d9906383380 service nova] Acquiring lock "refresh_cache-a1fa283c-79c2-4b52-9e91-70ec0e01115d" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:06:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-dcfeaf2b-1fe7-4898-962a-6d9a02b1972b req-c7d3dd81-27b4-4c1a-902c-2d9906383380 service nova] Acquired lock "refresh_cache-a1fa283c-79c2-4b52-9e91-70ec0e01115d" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:06:57 user nova-compute[74850]: DEBUG nova.network.neutron [req-dcfeaf2b-1fe7-4898-962a-6d9a02b1972b req-c7d3dd81-27b4-4c1a-902c-2d9906383380 service nova] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Refreshing network info cache for port 0bd9a14c-20bb-49e2-9af2-d84aef11483b {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:06:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json" returned: 0 in 1.155s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/245de3558fe3f5aa4cc5d44bc16c5598590e763e.part --force-share --output=json" returned: 0 in 0.171s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:57 user nova-compute[74850]: DEBUG nova.virt.images [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] 93444a62-bf05-4b5d-bb5c-4563f92ab5f9 was qcow2, converting to raw {{(pid=74850) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 01:06:57 user nova-compute[74850]: DEBUG nova.privsep.utils [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74850) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 01:06:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/245de3558fe3f5aa4cc5d44bc16c5598590e763e.part /opt/stack/data/nova/instances/_base/245de3558fe3f5aa4cc5d44bc16c5598590e763e.converted {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG nova.compute.manager [req-7453c9bd-6ec4-4e20-b214-8a49f6276578 req-ad80b619-c312-4874-b0c4-ff81e7488e35 service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Received event network-vif-plugged-9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7453c9bd-6ec4-4e20-b214-8a49f6276578 req-ad80b619-c312-4874-b0c4-ff81e7488e35 service nova] Acquiring lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7453c9bd-6ec4-4e20-b214-8a49f6276578 req-ad80b619-c312-4874-b0c4-ff81e7488e35 service nova] Lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7453c9bd-6ec4-4e20-b214-8a49f6276578 req-ad80b619-c312-4874-b0c4-ff81e7488e35 service nova] Lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG nova.compute.manager [req-7453c9bd-6ec4-4e20-b214-8a49f6276578 req-ad80b619-c312-4874-b0c4-ff81e7488e35 service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] No waiting events found dispatching network-vif-plugged-9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:06:58 user nova-compute[74850]: WARNING nova.compute.manager [req-7453c9bd-6ec4-4e20-b214-8a49f6276578 req-ad80b619-c312-4874-b0c4-ff81e7488e35 service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Received unexpected event network-vif-plugged-9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe for instance with vm_state active and task_state rescuing.
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/245de3558fe3f5aa4cc5d44bc16c5598590e763e.part /opt/stack/data/nova/instances/_base/245de3558fe3f5aa4cc5d44bc16c5598590e763e.converted" returned: 0 in 0.516s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/245de3558fe3f5aa4cc5d44bc16c5598590e763e.converted --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG nova.network.neutron [req-dcfeaf2b-1fe7-4898-962a-6d9a02b1972b req-c7d3dd81-27b4-4c1a-902c-2d9906383380 service nova] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Updated VIF entry in instance network info cache for port 0bd9a14c-20bb-49e2-9af2-d84aef11483b. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG nova.network.neutron [req-dcfeaf2b-1fe7-4898-962a-6d9a02b1972b req-c7d3dd81-27b4-4c1a-902c-2d9906383380 service nova] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Updating instance_info_cache with network_info: [{"id": "0bd9a14c-20bb-49e2-9af2-d84aef11483b", "address": "fa:16:3e:c6:1f:a9", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9a14c-20", "ovs_interfaceid": "0bd9a14c-20bb-49e2-9af2-d84aef11483b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "a1fa283c-79c2-4b52-9e91-70ec0e01115d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "a1fa283c-79c2-4b52-9e91-70ec0e01115d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-dcfeaf2b-1fe7-4898-962a-6d9a02b1972b req-c7d3dd81-27b4-4c1a-902c-2d9906383380 service nova] Releasing lock "refresh_cache-a1fa283c-79c2-4b52-9e91-70ec0e01115d" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG nova.objects.instance [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lazy-loading 'flavor' on Instance uuid a1fa283c-79c2-4b52-9e91-70ec0e01115d {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "a1fa283c-79c2-4b52-9e91-70ec0e01115d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.096s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/245de3558fe3f5aa4cc5d44bc16c5598590e763e.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "245de3558fe3f5aa4cc5d44bc16c5598590e763e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.071s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "245de3558fe3f5aa4cc5d44bc16c5598590e763e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "245de3558fe3f5aa4cc5d44bc16c5598590e763e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/245de3558fe3f5aa4cc5d44bc16c5598590e763e --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "a1fa283c-79c2-4b52-9e91-70ec0e01115d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "a1fa283c-79c2-4b52-9e91-70ec0e01115d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:06:58 user nova-compute[74850]: INFO nova.compute.manager [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Attaching volume 4d8dd99b-95e3-438d-92a0-1965e80b469a to /dev/vdb
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/245de3558fe3f5aa4cc5d44bc16c5598590e763e --force-share --output=json" returned: 0 in 0.193s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/245de3558fe3f5aa4cc5d44bc16c5598590e763e,backing_fmt=raw /opt/stack/data/nova/instances/e6e38d20-9aac-4037-b1b4-0c25005a9a67/disk.rescue {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG os_brick.utils [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/245de3558fe3f5aa4cc5d44bc16c5598590e763e,backing_fmt=raw /opt/stack/data/nova/instances/e6e38d20-9aac-4037-b1b4-0c25005a9a67/disk.rescue" returned: 0 in 0.059s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "245de3558fe3f5aa4cc5d44bc16c5598590e763e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG nova.objects.instance [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lazy-loading 'migration_context' on Instance uuid e6e38d20-9aac-4037-b1b4-0c25005a9a67 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb31339d-5328-4f96-8ebb-e075689d0a86]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG nova.objects.base [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Object Instance<e6e38d20-9aac-4037-b1b4-0c25005a9a67> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Start _get_guest_xml network_info=[{"id": "9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe", "address": "fa:16:3e:f7:6e:24", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "vif_mac": "fa:16:3e:f7:6e:24"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c0cbd8f-1b", "ovs_interfaceid": "9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '93444a62-bf05-4b5d-bb5c-4563f92ab5f9', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '1b4303f6-3763-4d78-a7d2-03889eb230f8', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmWXAKaB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'e6e38d20-9aac-4037-b1b4-0c25005a9a67', 'attached_at': '', 'detached_at': '', 'volume_id': '6e39afd2-04ef-410c-b7e3-d0eeceb59f5a', 'serial': '6e39afd2-04ef-410c-b7e3-d0eeceb59f5a'}, 'volume_type': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG nova.objects.instance [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lazy-loading 'resources' on Instance uuid e6e38d20-9aac-4037-b1b4-0c25005a9a67 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f6276f-4134-4732-b61a-5fa09e6e1ae6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG nova.objects.base [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Object Instance<e6e38d20-9aac-4037-b1b4-0c25005a9a67> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG nova.objects.instance [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lazy-loading 'numa_topology' on Instance uuid e6e38d20-9aac-4037-b1b4-0c25005a9a67 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4e7a3d-69b8-4e3f-aec7-111a7715b2d8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG nova.objects.base [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Object Instance<e6e38d20-9aac-4037-b1b4-0c25005a9a67> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebf259d-2cff-43a3-bc39-d752c51d53ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:06:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:06:59 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 01:06:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b25ce7-b8a5-48af-a375-1b5b4790c44e]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG os_brick.utils [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Updating existing volume attachment record: 0c8b340c-28b4-4fa6-87d8-b2a907b2c03c {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 01:06:59 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:06:59 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:06:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG nova.objects.instance [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lazy-loading 'vcpu_model' on Instance uuid e6e38d20-9aac-4037-b1b4-0c25005a9a67 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG nova.objects.base [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Object Instance<e6e38d20-9aac-4037-b1b4-0c25005a9a67> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmWXAKaB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:06:59 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:06:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:06:59 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:06:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:06:59 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 01:06:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ffc349-dc89-4241-a7c7-67d3bda6875b]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = zmWXAKaB\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 01:06:59 user nova-compute[74850]: node.name = iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a
Nov 14 01:06:59 user nova-compute[74850]: node.tpgt = -1
Nov 14 01:06:59 user nova-compute[74850]: node.startup = automatic
Nov 14 01:06:59 user nova-compute[74850]: node.leading_login = No
Nov 14 01:06:59 user nova-compute[74850]: iface.iscsi_ifacename = default
Nov 14 01:06:59 user nova-compute[74850]: iface.net_ifacename = <empty>
Nov 14 01:06:59 user nova-compute[74850]: iface.ipaddress = <empty>
Nov 14 01:06:59 user nova-compute[74850]: iface.prefix_len = 0
Nov 14 01:06:59 user nova-compute[74850]: iface.hwaddress = <empty>
Nov 14 01:06:59 user nova-compute[74850]: iface.transport_name = tcp
Nov 14 01:06:59 user nova-compute[74850]: iface.initiatorname = <empty>
Nov 14 01:06:59 user nova-compute[74850]: iface.state = <empty>
Nov 14 01:06:59 user nova-compute[74850]: iface.vlan_id = 0
Nov 14 01:06:59 user nova-compute[74850]: iface.vlan_priority = 0
Nov 14 01:06:59 user nova-compute[74850]: iface.vlan_state = <empty>
Nov 14 01:06:59 user nova-compute[74850]: iface.iface_num = 0
Nov 14 01:06:59 user nova-compute[74850]: iface.mtu = 0
Nov 14 01:06:59 user nova-compute[74850]: iface.port = 0
Nov 14 01:06:59 user nova-compute[74850]: iface.bootproto = <empty>
Nov 14 01:06:59 user nova-compute[74850]: iface.subnet_mask = <empty>
Nov 14 01:06:59 user nova-compute[74850]: iface.gateway = <empty>
Nov 14 01:06:59 user nova-compute[74850]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 01:06:59 user nova-compute[74850]: iface.dhcp_alt_client_id = <empty>
Nov 14 01:06:59 user nova-compute[74850]: iface.dhcp_dns = <empty>
Nov 14 01:06:59 user nova-compute[74850]: iface.dhcp_learn_iqn = <empty>
Nov 14 01:06:59 user nova-compute[74850]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 01:06:59 user nova-compute[74850]: iface.dhcp_vendor_id_state = <empty>
Nov 14 01:06:59 user nova-compute[74850]: iface.dhcp_vendor_id = <empty>
Nov 14 01:06:59 user nova-compute[74850]: iface.dhcp_slp_da = <empty>
Nov 14 01:06:59 user nova-compute[74850]: iface.fragmentation = <empty>
Nov 14 01:06:59 user nova-compute[74850]: iface.gratuitous_arp = <empty>
Nov 14 01:06:59 user nova-compute[74850]: iface.incoming_forwarding = <empty>
Nov 14 01:06:59 user nova-compute[74850]: iface.tos_state = <empty>
Nov 14 01:06:59 user nova-compute[74850]: iface.tos = 0
Nov 14 01:06:59 user nova-compute[74850]: iface.ttl = 0
Nov 14 01:06:59 user nova-compute[74850]: iface.delayed_ack = <empty>
Nov 14 01:06:59 user nova-compute[74850]: iface.tcp_nagle = <empty>
Nov 14 01:06:59 user nova-compute[74850]: iface.tcp_wsf_state = <empty>
Nov 14 01:06:59 user nova-compute[74850]: iface.tcp_wsf = 0
Nov 14 01:06:59 user nova-compute[74850]: iface.tcp_timer_scale = 0
Nov 14 01:06:59 user nova-compute[74850]: iface.tcp_timestamp = <empty>
Nov 14 01:06:59 user nova-compute[74850]: iface.redirect = <empty>
Nov 14 01:06:59 user nova-compute[74850]: iface.def_task_mgmt_timeout = 0
Nov 14 01:06:59 user nova-compute[74850]: iface.header_digest = <empty>
Nov 14 01:06:59 user nova-compute[74850]: iface.data_digest = <empty>
Nov 14 01:06:59 user nova-compute[74850]: iface.immediate_data = <empty>
Nov 14 01:06:59 user nova-compute[74850]: iface.initial_r2t = <empty>
Nov 14 01:06:59 user nova-compute[74850]: iface.data_seq_inorder = <empty>
Nov 14 01:06:59 user nova-compute[74850]: iface.data_pdu_inorder = <empty>
Nov 14 01:06:59 user nova-compute[74850]: iface.erl = 0
Nov 14 01:06:59 user nova-compute[74850]: iface.max_receive_data_len = 0
Nov 14 01:06:59 user nova-compute[74850]: iface.first_burst_len = 0
Nov 14 01:06:59 user nova-compute[74850]: iface.max_outstanding_r2t = 0
Nov 14 01:06:59 user nova-compute[74850]: iface.max_burst_len = 0
Nov 14 01:06:59 user nova-compute[74850]: iface.chap_auth = <empty>
Nov 14 01:06:59 user nova-compute[74850]: iface.bidi_chap = <empty>
Nov 14 01:06:59 user nova-compute[74850]: iface.strict_login_compliance = <empty>
Nov 14 01:06:59 user nova-compute[74850]: iface.discovery_auth = <empty>
Nov 14 01:06:59 user nova-compute[74850]: iface.discovery_logout = <empty>
Nov 14 01:06:59 user nova-compute[74850]: node.discovery_address = <empty>
Nov 14 01:06:59 user nova-compute[74850]: node.discovery_port = 0
Nov 14 01:06:59 user nova-compute[74850]: node.discovery_type = static
Nov 14 01:06:59 user nova-compute[74850]: node.session.initial_cmdsn = 0
Nov 14 01:06:59 user nova-compute[74850]: node.session.initial_login_retry_max = 8
Nov 14 01:06:59 user nova-compute[74850]: node.session.xmit_thread_priority = -20
Nov 14 01:06:59 user nova-compute[74850]: node.session.cmds_max = 128
Nov 14 01:06:59 user nova-compute[74850]: node.session.queue_depth = 32
Nov 14 01:06:59 user nova-compute[74850]: node.session.nr_sessions = 1
Nov 14 01:06:59 user nova-compute[74850]: node.session.auth.authmethod = CHAP
Nov 14 01:06:59 user nova-compute[74850]: node.session.auth.username = zmWXAKaB
Nov 14 01:06:59 user nova-compute[74850]: node.session.auth.password = ***
Nov 14 01:06:59 user nova-compute[74850]: node.session.auth.username_in = <empty>
Nov 14 01:06:59 user nova-compute[74850]: node.session.auth.password_in = <empty>
Nov 14 01:06:59 user nova-compute[74850]: node.session.auth.chap_algs = MD5
Nov 14 01:06:59 user nova-compute[74850]: node.session.timeo.replacement_timeout = 120
Nov 14 01:06:59 user nova-compute[74850]: node.session.err_timeo.abort_timeout = 15
Nov 14 01:06:59 user nova-compute[74850]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 01:06:59 user nova-compute[74850]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 01:06:59 user nova-compute[74850]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 01:06:59 user nova-compute[74850]: node.session.iscsi.FastAbort = Yes
Nov 14 01:06:59 user nova-compute[74850]: node.session.iscsi.InitialR2T = No
Nov 14 01:06:59 user nova-compute[74850]: node.session.iscsi.ImmediateData = Yes
Nov 14 01:06:59 user nova-compute[74850]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 01:06:59 user nova-compute[74850]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 01:06:59 user nova-compute[74850]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 01:06:59 user nova-compute[74850]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 01:06:59 user nova-compute[74850]: node.session.iscsi.MaxConnections = 1
Nov 14 01:06:59 user nova-compute[74850]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 01:06:59 user nova-compute[74850]: node.session.iscsi.ERL = 0
Nov 14 01:06:59 user nova-compute[74850]: node.session.scan = manual
Nov 14 01:06:59 user nova-compute[74850]: node.session.reopen_max = 0
Nov 14 01:06:59 user nova-compute[74850]: node.conn[0].address = 172.16.0.220
Nov 14 01:06:59 user nova-compute[74850]: node.conn[0].port = 3260
Nov 14 01:06:59 user nova-compute[74850]: node.conn[0].startup = manual
Nov 14 01:06:59 user nova-compute[74850]: node.conn[0].tcp.window_size = 524288
Nov 14 01:06:59 user nova-compute[74850]: node.conn[0].tcp.type_of_service = 0
Nov 14 01:06:59 user nova-compute[74850]: node.conn[0].timeo.logout_timeout = 15
Nov 14 01:06:59 user nova-compute[74850]: node.conn[0].timeo.login_timeout = 15
Nov 14 01:06:59 user nova-compute[74850]: node.conn[0].timeo.auth_timeout = 45
Nov 14 01:06:59 user nova-compute[74850]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 01:06:59 user nova-compute[74850]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 01:06:59 user nova-compute[74850]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 01:06:59 user nova-compute[74850]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 01:06:59 user nova-compute[74850]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 01:06:59 user nova-compute[74850]: node.conn[0].iscsi.DataDigest = None
Nov 14 01:06:59 user nova-compute[74850]: node.conn[0].iscsi.IFMarker = No
Nov 14 01:06:59 user nova-compute[74850]: node.conn[0].iscsi.OFMarker = No
Nov 14 01:06:59 user nova-compute[74850]: # END RECORD
Nov 14 01:06:59 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1fa283c-79c2-4b52-9e91-70ec0e01115d/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[16957cc6-9347-49c2-a826-9bba14ebd6c0]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[21738347-8f62-430c-82e3-2b5ca26bd694]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zmWXAKaB {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zmWXAKaB" returned: 0 in 0.026s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f558b63-36b5-469f-a86a-e1694e1ac8d2]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zmWXAKaB'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7210d46-6078-45cb-b86c-ff082c5f1db1]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[451232aa-98f8-41f8-b086-2feb2d69e707]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:06:59 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:06:59 user nova-compute[74850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:06:59 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:06:59 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:06:59 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:06:59 user nova-compute[74850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:06:59 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:06:59 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.196s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] HCTL ('35', '0', '0', 0) found on session 44 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32f26ed-ed21-4fe4-bd9a-d467ab907764]: (4, ('0 0 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Searching for a device in session 44 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmWXAKaB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.222s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] <== connect_volume: return (223ms) {'type': 'block', 'scsi_wwn': '23565356266363438', 'path': '/dev/sdd'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565356266363438', 'path': '/dev/sdd'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1fa283c-79c2-4b52-9e91-70ec0e01115d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1fa283c-79c2-4b52-9e91-70ec0e01115d/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-836607346',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-836607346',id=40,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T01:05:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='491aa2a4f38140788cb0de9762a8baf4',ramdisk_id='',reservation_id='r-0bztva0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-726213232',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:05:21Z,user_data=None,user_id='a5bb5d788a3b4871ae41f57d06f785f2',uuid=e6e38d20-9aac-4037-b1b4-0c25005a9a67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe", "address": "fa:16:3e:f7:6e:24", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "vif_mac": "fa:16:3e:f7:6e:24"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c0cbd8f-1b", "ovs_interfaceid": "9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Converting VIF {"id": "9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe", "address": "fa:16:3e:f7:6e:24", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "vif_mac": "fa:16:3e:f7:6e:24"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c0cbd8f-1b", "ovs_interfaceid": "9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:6e:24,bridge_name='br-int',has_traffic_filtering=True,id=9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe,network=Network(6f8f66ca-e2e8-4565-a05c-df75a16699ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c0cbd8f-1b') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG nova.objects.instance [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lazy-loading 'pci_devices' on Instance uuid e6e38d20-9aac-4037-b1b4-0c25005a9a67 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG nova.objects.base [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Object Instance<e6e38d20-9aac-4037-b1b4-0c25005a9a67> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] End _get_guest_xml xml=<domain type="kvm">
Nov 14 01:06:59 user nova-compute[74850]:   <uuid>e6e38d20-9aac-4037-b1b4-0c25005a9a67</uuid>
Nov 14 01:06:59 user nova-compute[74850]:   <name>instance-00000028</name>
Nov 14 01:06:59 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 01:06:59 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 01:06:59 user nova-compute[74850]:   <metadata>
Nov 14 01:06:59 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 01:06:59 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 01:06:59 user nova-compute[74850]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-836607346</nova:name>
Nov 14 01:06:59 user nova-compute[74850]:       <nova:creationTime>2023-11-14 01:06:59</nova:creationTime>
Nov 14 01:06:59 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 01:06:59 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 01:06:59 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 01:06:59 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 01:06:59 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 01:06:59 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 01:06:59 user nova-compute[74850]:       </nova:flavor>
Nov 14 01:06:59 user nova-compute[74850]:       <nova:owner>
Nov 14 01:06:59 user nova-compute[74850]:         <nova:user uuid="a5bb5d788a3b4871ae41f57d06f785f2">tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member</nova:user>
Nov 14 01:06:59 user nova-compute[74850]:         <nova:project uuid="491aa2a4f38140788cb0de9762a8baf4">tempest-ServerBootFromVolumeStableRescueTest-726213232</nova:project>
Nov 14 01:06:59 user nova-compute[74850]:       </nova:owner>
Nov 14 01:06:59 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 01:06:59 user nova-compute[74850]:       <nova:ports>
Nov 14 01:06:59 user nova-compute[74850]:         <nova:port uuid="9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe">
Nov 14 01:06:59 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 01:06:59 user nova-compute[74850]:         </nova:port>
Nov 14 01:06:59 user nova-compute[74850]:       </nova:ports>
Nov 14 01:06:59 user nova-compute[74850]:     </nova:instance>
Nov 14 01:06:59 user nova-compute[74850]:   </metadata>
Nov 14 01:06:59 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 01:06:59 user nova-compute[74850]:     <system>
Nov 14 01:06:59 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 01:06:59 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 01:06:59 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 01:06:59 user nova-compute[74850]:       <entry name="serial">e6e38d20-9aac-4037-b1b4-0c25005a9a67</entry>
Nov 14 01:06:59 user nova-compute[74850]:       <entry name="uuid">e6e38d20-9aac-4037-b1b4-0c25005a9a67</entry>
Nov 14 01:06:59 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 01:06:59 user nova-compute[74850]:     </system>
Nov 14 01:06:59 user nova-compute[74850]:   </sysinfo>
Nov 14 01:06:59 user nova-compute[74850]:   <os>
Nov 14 01:06:59 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 01:06:59 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 01:06:59 user nova-compute[74850]:   </os>
Nov 14 01:06:59 user nova-compute[74850]:   <features>
Nov 14 01:06:59 user nova-compute[74850]:     <acpi/>
Nov 14 01:06:59 user nova-compute[74850]:     <apic/>
Nov 14 01:06:59 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 01:06:59 user nova-compute[74850]:   </features>
Nov 14 01:06:59 user nova-compute[74850]:   <clock offset="utc">
Nov 14 01:06:59 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 01:06:59 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 01:06:59 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 01:06:59 user nova-compute[74850]:   </clock>
Nov 14 01:06:59 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 01:06:59 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 01:06:59 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 01:06:59 user nova-compute[74850]:   </cpu>
Nov 14 01:06:59 user nova-compute[74850]:   <devices>
Nov 14 01:06:59 user nova-compute[74850]:     <disk type="block" device="disk">
Nov 14 01:06:59 user nova-compute[74850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:06:59 user nova-compute[74850]:       <source dev="/dev/sdd"/>
Nov 14 01:06:59 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 01:06:59 user nova-compute[74850]:       <serial>6e39afd2-04ef-410c-b7e3-d0eeceb59f5a</serial>
Nov 14 01:06:59 user nova-compute[74850]:     </disk>
Nov 14 01:06:59 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 01:06:59 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 01:06:59 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/e6e38d20-9aac-4037-b1b4-0c25005a9a67/disk.rescue"/>
Nov 14 01:06:59 user nova-compute[74850]:       <target dev="vdb" bus="virtio"/>
Nov 14 01:06:59 user nova-compute[74850]:       <boot order="1"/>
Nov 14 01:06:59 user nova-compute[74850]:     </disk>
Nov 14 01:06:59 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 01:06:59 user nova-compute[74850]:       <mac address="fa:16:3e:f7:6e:24"/>
Nov 14 01:06:59 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:06:59 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 01:06:59 user nova-compute[74850]:       <target dev="tap9c0cbd8f-1b"/>
Nov 14 01:06:59 user nova-compute[74850]:     </interface>
Nov 14 01:06:59 user nova-compute[74850]:     <serial type="pty">
Nov 14 01:06:59 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/e6e38d20-9aac-4037-b1b4-0c25005a9a67/console.log" append="off"/>
Nov 14 01:06:59 user nova-compute[74850]:     </serial>
Nov 14 01:06:59 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 01:06:59 user nova-compute[74850]:     <video>
Nov 14 01:06:59 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:06:59 user nova-compute[74850]:     </video>
Nov 14 01:06:59 user nova-compute[74850]:     <rng model="virtio">
Nov 14 01:06:59 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 01:06:59 user nova-compute[74850]:     </rng>
Nov 14 01:06:59 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 01:06:59 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 01:06:59 user nova-compute[74850]:       <stats period="10"/>
Nov 14 01:06:59 user nova-compute[74850]:     </memballoon>
Nov 14 01:06:59 user nova-compute[74850]:   </devices>
Nov 14 01:06:59 user nova-compute[74850]: </domain>
Nov 14 01:06:59 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 01:06:59 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Instance destroyed successfully.
Nov 14 01:06:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] No VIF found with MAC fa:16:3e:f7:6e:24, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1fa283c-79c2-4b52-9e91-70ec0e01115d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:06:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:07:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:01 user nova-compute[74850]: DEBUG nova.compute.manager [req-4261a2f6-9917-4953-b81f-4f98ac716b46 req-bf6c3669-2911-4894-8c64-69c53b1b148d service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Received event network-vif-plugged-9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:07:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-4261a2f6-9917-4953-b81f-4f98ac716b46 req-bf6c3669-2911-4894-8c64-69c53b1b148d service nova] Acquiring lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:07:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-4261a2f6-9917-4953-b81f-4f98ac716b46 req-bf6c3669-2911-4894-8c64-69c53b1b148d service nova] Lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:07:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-4261a2f6-9917-4953-b81f-4f98ac716b46 req-bf6c3669-2911-4894-8c64-69c53b1b148d service nova] Lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:07:01 user nova-compute[74850]: DEBUG nova.compute.manager [req-4261a2f6-9917-4953-b81f-4f98ac716b46 req-bf6c3669-2911-4894-8c64-69c53b1b148d service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] No waiting events found dispatching network-vif-plugged-9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:07:01 user nova-compute[74850]: WARNING nova.compute.manager [req-4261a2f6-9917-4953-b81f-4f98ac716b46 req-bf6c3669-2911-4894-8c64-69c53b1b148d service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Received unexpected event network-vif-plugged-9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe for instance with vm_state active and task_state rescuing.
Nov 14 01:07:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:01 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:07:01 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e38d20-9aac-4037-b1b4-0c25005a9a67/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:01 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e38d20-9aac-4037-b1b4-0c25005a9a67/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:01 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e38d20-9aac-4037-b1b4-0c25005a9a67/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:01 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e38d20-9aac-4037-b1b4-0c25005a9a67/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:01 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2294e4d8-7e62-4875-822f-bc9020721881/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:01 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2294e4d8-7e62-4875-822f-bc9020721881/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:01 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2294e4d8-7e62-4875-822f-bc9020721881/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:01 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2294e4d8-7e62-4875-822f-bc9020721881/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG nova.compute.manager [req-67f09cd0-fd7e-479f-8ccd-5d7fc3b902e8 req-ef418f0d-92b6-47e5-b3b3-187832515892 service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Received event network-vif-plugged-9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-67f09cd0-fd7e-479f-8ccd-5d7fc3b902e8 req-ef418f0d-92b6-47e5-b3b3-187832515892 service nova] Acquiring lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-67f09cd0-fd7e-479f-8ccd-5d7fc3b902e8 req-ef418f0d-92b6-47e5-b3b3-187832515892 service nova] Lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-67f09cd0-fd7e-479f-8ccd-5d7fc3b902e8 req-ef418f0d-92b6-47e5-b3b3-187832515892 service nova] Lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG nova.compute.manager [req-67f09cd0-fd7e-479f-8ccd-5d7fc3b902e8 req-ef418f0d-92b6-47e5-b3b3-187832515892 service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] No waiting events found dispatching network-vif-plugged-9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:07:03 user nova-compute[74850]: WARNING nova.compute.manager [req-67f09cd0-fd7e-479f-8ccd-5d7fc3b902e8 req-ef418f0d-92b6-47e5-b3b3-187832515892 service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Received unexpected event network-vif-plugged-9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe for instance with vm_state active and task_state rescuing.
Nov 14 01:07:03 user nova-compute[74850]: DEBUG nova.compute.manager [None req-eb0f1126-0a23-4cf3-9ea2-dc1126a1d95b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aXUZYunq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:07:03 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:07:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:07:03 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:07:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:07:03 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6e16f10a-6cfb-4222-9eb3-cab669c1d5f8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "782a85d0-b427-4ee2-8d6c-778602f00bcd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6e16f10a-6cfb-4222-9eb3-cab669c1d5f8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6e16f10a-6cfb-4222-9eb3-cab669c1d5f8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "782a85d0-b427-4ee2-8d6c-778602f00bcd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6e16f10a-6cfb-4222-9eb3-cab669c1d5f8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6e16f10a-6cfb-4222-9eb3-cab669c1d5f8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:03 user nova-compute[74850]: INFO nova.compute.manager [None req-6e16f10a-6cfb-4222-9eb3-cab669c1d5f8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Terminating instance
Nov 14 01:07:03 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6e16f10a-6cfb-4222-9eb3-cab669c1d5f8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 01:07:03 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:07:03 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:07:03 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=7741MB free_disk=24.94611358642578GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd76a009-c25f-4fbf-9a3e-573ebddf0d74]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 01:07:03 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0978f9c3-e5ae-4ce0-aee3-01e9ed9bf34f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a] added
Nov 14 01:07:03 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.048s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[71eb9944-f00c-45e1-b01a-1040e3ddedb6]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d0359d-9607-4509-9a5d-4138c6071ff7]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aXUZYunq {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aXUZYunq" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[330a6d31-d3cd-4026-885b-26c96b844497]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aXUZYunq'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5976d14c-5291-44f6-b86d-0aa95fb30ec5]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead1ec2c-5b75-4207-8f71-af469fed03b2]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:07:03 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:07:03 user nova-compute[74850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:07:03 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:07:03 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:07:03 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:07:03 user nova-compute[74850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:07:03 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:07:03 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 748d0da7-bbb9-4e86-aae3-e48b1fa04c14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance c7952bff-87d6-46c1-a6d4-7729dc4893ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 702746f7-305f-4eac-a71a-6c08b7cbccd8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 782a85d0-b427-4ee2-8d6c-778602f00bcd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 3504ddd3-bdd8-465e-aec5-190acdd563f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 998f2d6a-e3b6-4135-9485-b042a5e094c4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 6f0cb80d-dfec-4278-81ff-0e292bad880a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance e6e38d20-9aac-4037-b1b4-0c25005a9a67 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance a1fa283c-79c2-4b52-9e91-70ec0e01115d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance efa96c60-9902-4ca9-8f0e-d27bdb883829 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 2294e4d8-7e62-4875-822f-bc9020721881 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e80d43-3371-4afd-adb7-580f211a851b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a, portal: 172.16.0.220,3260]
Nov 14 01:07:03 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a, portal: 172.16.0.220,3260] successful.
Nov 14 01:07:03 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de18ab5-ab26-4884-94ef-53375f40c5af]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d6d6c6-fb45-4eaa-a7c5-5b55c0d28e9c]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:07:03 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:07:03 user nova-compute[74850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:07:03 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:07:03 user nova-compute[74850]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a (non-flash)
Nov 14 01:07:03 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:07:03 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:07:03 user nova-compute[74850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:07:03 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:07:03 user nova-compute[74850]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a (non-flash)
Nov 14 01:07:03 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG nova.compute.manager [req-827450fe-0458-4891-ac8c-6761db6a0693 req-e7a3403c-be34-4b96-b65c-04fbaa273bcb service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Received event network-vif-unplugged-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-827450fe-0458-4891-ac8c-6761db6a0693 req-e7a3403c-be34-4b96-b65c-04fbaa273bcb service nova] Acquiring lock "782a85d0-b427-4ee2-8d6c-778602f00bcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-827450fe-0458-4891-ac8c-6761db6a0693 req-e7a3403c-be34-4b96-b65c-04fbaa273bcb service nova] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-827450fe-0458-4891-ac8c-6761db6a0693 req-e7a3403c-be34-4b96-b65c-04fbaa273bcb service nova] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG nova.compute.manager [req-827450fe-0458-4891-ac8c-6761db6a0693 req-e7a3403c-be34-4b96-b65c-04fbaa273bcb service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] No waiting events found dispatching network-vif-unplugged-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG nova.compute.manager [req-827450fe-0458-4891-ac8c-6761db6a0693 req-e7a3403c-be34-4b96-b65c-04fbaa273bcb service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Received event network-vif-unplugged-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.030s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6ab5c9-a1a1-4761-8a7a-7717f23cff19]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:07:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aXUZYunq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 01:07:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:04 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:07:04 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:07:04 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 01:07:04 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.638s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:07:04 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Instance destroyed successfully.
Nov 14 01:07:04 user nova-compute[74850]: DEBUG nova.objects.instance [None req-6e16f10a-6cfb-4222-9eb3-cab669c1d5f8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lazy-loading 'resources' on Instance uuid 782a85d0-b427-4ee2-8d6c-778602f00bcd {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:07:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-6e16f10a-6cfb-4222-9eb3-cab669c1d5f8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:57:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-931477227',display_name='tempest-AttachVolumeTestJSON-server-931477227',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-931477227',id=30,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqGPtaAqtRvdnzrU67gWLSZdIWQoykWaBYabKPElkLS5sz5jLsrZV0zgILMNEA+Yd/7TrkBFbU+t9G+drRSGt2wGNzDluZHtIgMdrMvm4dKLEvsHluVt5xKssaIW0AwAg==',key_name='tempest-keypair-1840551366',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:57:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c3e629e632d444faf3898681aaafa79',ramdisk_id='',reservation_id='r-iuno8cu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1639440895',owner_user_name='tempest-AttachVolumeTestJSON-1639440895-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T01:05:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b677f8f7b06431cbeac4cbdfa2dcbf5',uuid=782a85d0-b427-4ee2-8d6c-778602f00bcd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "address": "fa:16:3e:70:96:bf", "network": {"id": "75650b3d-1169-46fa-a1cf-7ae51dd28e18", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227679489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3e629e632d444faf3898681aaafa79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744a9e-48", "ovs_interfaceid": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 01:07:04 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-6e16f10a-6cfb-4222-9eb3-cab669c1d5f8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Converting VIF {"id": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "address": "fa:16:3e:70:96:bf", "network": {"id": "75650b3d-1169-46fa-a1cf-7ae51dd28e18", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227679489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3e629e632d444faf3898681aaafa79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744a9e-48", "ovs_interfaceid": "b4744a9e-4848-49b9-9f58-7d29e0ecb9c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:07:04 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-6e16f10a-6cfb-4222-9eb3-cab669c1d5f8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:96:bf,bridge_name='br-int',has_traffic_filtering=True,id=b4744a9e-4848-49b9-9f58-7d29e0ecb9c7,network=Network(75650b3d-1169-46fa-a1cf-7ae51dd28e18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4744a9e-48') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:07:04 user nova-compute[74850]: DEBUG os_vif [None req-6e16f10a-6cfb-4222-9eb3-cab669c1d5f8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:96:bf,bridge_name='br-int',has_traffic_filtering=True,id=b4744a9e-4848-49b9-9f58-7d29e0ecb9c7,network=Network(75650b3d-1169-46fa-a1cf-7ae51dd28e18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4744a9e-48') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 01:07:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4744a9e-48, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:07:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=50db65f4-47e5-40d8-b9f9-31de2b80d369) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:07:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:04 user nova-compute[74850]: INFO os_vif [None req-6e16f10a-6cfb-4222-9eb3-cab669c1d5f8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:96:bf,bridge_name='br-int',has_traffic_filtering=True,id=b4744a9e-4848-49b9-9f58-7d29e0ecb9c7,network=Network(75650b3d-1169-46fa-a1cf-7ae51dd28e18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4744a9e-48')
Nov 14 01:07:04 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-6e16f10a-6cfb-4222-9eb3-cab669c1d5f8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Deleting instance files /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd_del
Nov 14 01:07:04 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-6e16f10a-6cfb-4222-9eb3-cab669c1d5f8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Deletion of /opt/stack/data/nova/instances/782a85d0-b427-4ee2-8d6c-778602f00bcd_del complete
Nov 14 01:07:04 user nova-compute[74850]: INFO nova.compute.manager [None req-6e16f10a-6cfb-4222-9eb3-cab669c1d5f8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 14 01:07:04 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-6e16f10a-6cfb-4222-9eb3-cab669c1d5f8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 01:07:04 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 01:07:04 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 01:07:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.430s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:07:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] <== connect_volume: return (1431ms) {'type': 'block', 'scsi_wwn': '26633633633613361', 'path': '/dev/sdb'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:07:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633633633613361', 'path': '/dev/sdb'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 01:07:04 user nova-compute[74850]: DEBUG nova.objects.instance [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lazy-loading 'flavor' on Instance uuid a1fa283c-79c2-4b52-9e91-70ec0e01115d {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:07:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 01:07:04 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:07:04 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 01:07:04 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:07:04 user nova-compute[74850]:   <serial>4d8dd99b-95e3-438d-92a0-1965e80b469a</serial>
Nov 14 01:07:04 user nova-compute[74850]: </disk>
Nov 14 01:07:04 user nova-compute[74850]:  {{(pid=74850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 01:07:05 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:07:05 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Took 0.87 seconds to deallocate network for instance.
Nov 14 01:07:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6e16f10a-6cfb-4222-9eb3-cab669c1d5f8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:07:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6e16f10a-6cfb-4222-9eb3-cab669c1d5f8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:07:05 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:07:05 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:07:05 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] No VIF found with MAC fa:16:3e:c6:1f:a9, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:07:05 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-6e16f10a-6cfb-4222-9eb3-cab669c1d5f8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:07:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-838f606c-1f7a-4fa2-ad53-78c7f4b1bff6 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "a1fa283c-79c2-4b52-9e91-70ec0e01115d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.827s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:07:05 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-6e16f10a-6cfb-4222-9eb3-cab669c1d5f8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:07:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6e16f10a-6cfb-4222-9eb3-cab669c1d5f8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:07:05 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-6e16f10a-6cfb-4222-9eb3-cab669c1d5f8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Deleted allocations for instance 782a85d0-b427-4ee2-8d6c-778602f00bcd
Nov 14 01:07:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6e16f10a-6cfb-4222-9eb3-cab669c1d5f8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.319s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:07:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:05 user nova-compute[74850]: DEBUG nova.compute.manager [req-beedb13a-7ec2-438b-bb62-0c018eacd910 req-49c5415c-e969-439b-b7c0-cbe45204b1f7 service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Received event network-vif-plugged-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:07:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-beedb13a-7ec2-438b-bb62-0c018eacd910 req-49c5415c-e969-439b-b7c0-cbe45204b1f7 service nova] Acquiring lock "782a85d0-b427-4ee2-8d6c-778602f00bcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:07:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-beedb13a-7ec2-438b-bb62-0c018eacd910 req-49c5415c-e969-439b-b7c0-cbe45204b1f7 service nova] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:07:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-beedb13a-7ec2-438b-bb62-0c018eacd910 req-49c5415c-e969-439b-b7c0-cbe45204b1f7 service nova] Lock "782a85d0-b427-4ee2-8d6c-778602f00bcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:07:05 user nova-compute[74850]: DEBUG nova.compute.manager [req-beedb13a-7ec2-438b-bb62-0c018eacd910 req-49c5415c-e969-439b-b7c0-cbe45204b1f7 service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] No waiting events found dispatching network-vif-plugged-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:07:05 user nova-compute[74850]: WARNING nova.compute.manager [req-beedb13a-7ec2-438b-bb62-0c018eacd910 req-49c5415c-e969-439b-b7c0-cbe45204b1f7 service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Received unexpected event network-vif-plugged-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 for instance with vm_state deleted and task_state None.
Nov 14 01:07:05 user nova-compute[74850]: DEBUG nova.compute.manager [req-beedb13a-7ec2-438b-bb62-0c018eacd910 req-49c5415c-e969-439b-b7c0-cbe45204b1f7 service nova] [instance: 782a85d0-b427-4ee2-8d6c-778602f00bcd] Received event network-vif-deleted-b4744a9e-4848-49b9-9f58-7d29e0ecb9c7 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:07:06 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:07:06 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:07:06 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:07:06 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:07:06 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:07:06 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:07:06 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:07:06 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:07:06 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 01:07:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-28eeda48-27c3-44a7-967b-83d7aa68765e tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "a1fa283c-79c2-4b52-9e91-70ec0e01115d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:07:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-28eeda48-27c3-44a7-967b-83d7aa68765e tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "a1fa283c-79c2-4b52-9e91-70ec0e01115d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:07:06 user nova-compute[74850]: INFO nova.compute.manager [None req-28eeda48-27c3-44a7-967b-83d7aa68765e tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Detaching volume 4d8dd99b-95e3-438d-92a0-1965e80b469a
Nov 14 01:07:06 user nova-compute[74850]: INFO nova.virt.block_device [None req-28eeda48-27c3-44a7-967b-83d7aa68765e tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Attempting to driver detach volume 4d8dd99b-95e3-438d-92a0-1965e80b469a from mountpoint /dev/vdb
Nov 14 01:07:06 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-28eeda48-27c3-44a7-967b-83d7aa68765e tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Attempting to detach device vdb from instance a1fa283c-79c2-4b52-9e91-70ec0e01115d from the persistent domain config. {{(pid=74850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 01:07:06 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-28eeda48-27c3-44a7-967b-83d7aa68765e tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:07:06 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:07:06 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 01:07:06 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:07:06 user nova-compute[74850]:   <serial>4d8dd99b-95e3-438d-92a0-1965e80b469a</serial>
Nov 14 01:07:06 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 01:07:06 user nova-compute[74850]: </disk>
Nov 14 01:07:06 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:07:06 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-28eeda48-27c3-44a7-967b-83d7aa68765e tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Successfully detached device vdb from instance a1fa283c-79c2-4b52-9e91-70ec0e01115d from the persistent domain config.
Nov 14 01:07:06 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-28eeda48-27c3-44a7-967b-83d7aa68765e tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a1fa283c-79c2-4b52-9e91-70ec0e01115d from the live domain config. {{(pid=74850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 01:07:06 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-28eeda48-27c3-44a7-967b-83d7aa68765e tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:07:06 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:07:06 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 01:07:06 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:07:06 user nova-compute[74850]:   <serial>4d8dd99b-95e3-438d-92a0-1965e80b469a</serial>
Nov 14 01:07:06 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 01:07:06 user nova-compute[74850]: </disk>
Nov 14 01:07:06 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:07:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-28eeda48-27c3-44a7-967b-83d7aa68765e tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a1fa283c-79c2-4b52-9e91-70ec0e01115d {{(pid=74850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 01:07:08 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:07:08 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 01:07:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "refresh_cache-702746f7-305f-4eac-a71a-6c08b7cbccd8" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:07:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquired lock "refresh_cache-702746f7-305f-4eac-a71a-6c08b7cbccd8" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:07:09 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Forcefully refreshing network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 01:07:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:09 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Updating instance_info_cache with network_info: [{"id": "39232b36-eca6-4dac-880c-43aafa9f1719", "address": "fa:16:3e:ac:57:e7", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39232b36-ec", "ovs_interfaceid": "39232b36-eca6-4dac-880c-43aafa9f1719", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:07:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Releasing lock "refresh_cache-702746f7-305f-4eac-a71a-6c08b7cbccd8" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:07:09 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Updated the network info_cache for instance {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 01:07:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:15 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "998f2d6a-e3b6-4135-9485-b042a5e094c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:07:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "998f2d6a-e3b6-4135-9485-b042a5e094c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:07:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "998f2d6a-e3b6-4135-9485-b042a5e094c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:07:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "998f2d6a-e3b6-4135-9485-b042a5e094c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:07:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "998f2d6a-e3b6-4135-9485-b042a5e094c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:07:20 user nova-compute[74850]: INFO nova.compute.manager [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Terminating instance
Nov 14 01:07:20 user nova-compute[74850]: DEBUG nova.compute.manager [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 01:07:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:20 user nova-compute[74850]: DEBUG nova.compute.manager [req-b21b38c0-7a3a-4522-b042-fe45afab79bc req-a69cab2b-4c02-40e1-ab7a-bd8b65b158ff service nova] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Received event network-vif-unplugged-080e37ec-a952-4eb5-bc53-578a3fe28094 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:07:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b21b38c0-7a3a-4522-b042-fe45afab79bc req-a69cab2b-4c02-40e1-ab7a-bd8b65b158ff service nova] Acquiring lock "998f2d6a-e3b6-4135-9485-b042a5e094c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:07:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b21b38c0-7a3a-4522-b042-fe45afab79bc req-a69cab2b-4c02-40e1-ab7a-bd8b65b158ff service nova] Lock "998f2d6a-e3b6-4135-9485-b042a5e094c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:07:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b21b38c0-7a3a-4522-b042-fe45afab79bc req-a69cab2b-4c02-40e1-ab7a-bd8b65b158ff service nova] Lock "998f2d6a-e3b6-4135-9485-b042a5e094c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:07:20 user nova-compute[74850]: DEBUG nova.compute.manager [req-b21b38c0-7a3a-4522-b042-fe45afab79bc req-a69cab2b-4c02-40e1-ab7a-bd8b65b158ff service nova] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] No waiting events found dispatching network-vif-unplugged-080e37ec-a952-4eb5-bc53-578a3fe28094 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:07:20 user nova-compute[74850]: DEBUG nova.compute.manager [req-b21b38c0-7a3a-4522-b042-fe45afab79bc req-a69cab2b-4c02-40e1-ab7a-bd8b65b158ff service nova] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Received event network-vif-unplugged-080e37ec-a952-4eb5-bc53-578a3fe28094 for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 01:07:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:21 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Instance destroyed successfully.
Nov 14 01:07:21 user nova-compute[74850]: DEBUG nova.objects.instance [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lazy-loading 'resources' on Instance uuid 998f2d6a-e3b6-4135-9485-b042a5e094c4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:02:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2140022489',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2140022489',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2140022489',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/7ek1jkNyLROtgJdX+fb8SGjy6uhUjyyI80poahEPiU9qAJNv9YbHHcodXq5nGZ9BM3kKWhHJGATQNnDp0vJzEhdF3TxJ2/ZXa7zvy1eyY0UZNBYqi/qotWdw3iB4Mlg==',key_name='tempest-keypair-8877152',keypairs=<?>,launch_index=0,launched_at=2023-11-14T01:02:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fdb1eb4b5fc841d1952b8db9ae05e446',ramdisk_id='',reservation_id='r-uoq2n9b6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1536334624',owner_user_name='tempest-TestVolumeBootPattern-1536334624-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T01:02:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c91ddcee4e54a769eb626c816596bed',uuid=998f2d6a-e3b6-4135-9485-b042a5e094c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "080e37ec-a952-4eb5-bc53-578a3fe28094", "address": "fa:16:3e:d6:bb:bd", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap080e37ec-a9", "ovs_interfaceid": "080e37ec-a952-4eb5-bc53-578a3fe28094", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Converting VIF {"id": "080e37ec-a952-4eb5-bc53-578a3fe28094", "address": "fa:16:3e:d6:bb:bd", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap080e37ec-a9", "ovs_interfaceid": "080e37ec-a952-4eb5-bc53-578a3fe28094", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:bb:bd,bridge_name='br-int',has_traffic_filtering=True,id=080e37ec-a952-4eb5-bc53-578a3fe28094,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap080e37ec-a9') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG os_vif [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:bb:bd,bridge_name='br-int',has_traffic_filtering=True,id=080e37ec-a952-4eb5-bc53-578a3fe28094,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap080e37ec-a9') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap080e37ec-a9, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8db284ea-a656-4b52-9583-2d18284a6f79) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:07:21 user nova-compute[74850]: INFO os_vif [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:bb:bd,bridge_name='br-int',has_traffic_filtering=True,id=080e37ec-a952-4eb5-bc53-578a3fe28094,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap080e37ec-a9')
Nov 14 01:07:21 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HaFxyisS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:07:21 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:07:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8dd624-b6c6-40a8-98c2-bd80b8216a66]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 01:07:21 user nova-compute[74850]: No targets found.
Nov 14 01:07:21 user nova-compute[74850]: iSNS:
Nov 14 01:07:21 user nova-compute[74850]: No targets found.
Nov 14 01:07:21 user nova-compute[74850]: STATIC:
Nov 14 01:07:21 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d
Nov 14 01:07:21 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:07:21 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:07:21 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d
Nov 14 01:07:21 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:07:21 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:07:21 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a
Nov 14 01:07:21 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:07:21 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:07:21 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d
Nov 14 01:07:21 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:07:21 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:07:21 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a
Nov 14 01:07:21 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:07:21 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:07:21 user nova-compute[74850]: FIRMWARE:
Nov 14 01:07:21 user nova-compute[74850]: No targets found.
Nov 14 01:07:21 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 01:07:21 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 01:07:21 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[df28777c-4584-4282-8baf-07896730a013]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[da203a7a-317e-4af9-a481-208a02bbbef2]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:07:21 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:07:21 user nova-compute[74850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:07:21 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:07:21 user nova-compute[74850]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a (non-flash)
Nov 14 01:07:21 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:07:21 user nova-compute[74850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d (non-flash)
Nov 14 01:07:21 user nova-compute[74850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:07:21 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:07:21 user nova-compute[74850]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a (non-flash)
Nov 14 01:07:21 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a689de680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d'): ({'sdc'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Removing single pathed devices sdc {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5232d11e-bca3-4da2-bfc8-20e440d0aea0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1825c950-8043-411c-a36a-ccc0b858ae18]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Flushing IO for device /dev/sdc {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc80742-cde3-4bfd-ac10-619d72bad844]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ae175c-583f-490c-add7-e58c4d46247e]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] SCSI volumes sdc have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO40d8a911-993ef469785120b1', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_40d8a911', '/dev/disk/by-id/scsi-23939336566343639') {{(pid=84948) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5846312a-3fa3-4be8-b6a0-b1671ed57ee3]: (4, None) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd00165d-1528-4178-9557-6822489e6f58]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0618f0a3-08de-48d2-9fd1-06c0d823b0f4]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d, portal: 172.16.0.220,3260]
Nov 14 01:07:21 user nova-compute[74850]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d, portal: 172.16.0.220,3260] successful.
Nov 14 01:07:21 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20a4b5a6-0e20-4a30-9464-8c89e563ef8d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3c0047-09c3-49f0-a43f-61722afd5198]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] <== disconnect_volume: return (355ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 01:07:21 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Deleting instance files /opt/stack/data/nova/instances/998f2d6a-e3b6-4135-9485-b042a5e094c4_del
Nov 14 01:07:21 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Deletion of /opt/stack/data/nova/instances/998f2d6a-e3b6-4135-9485-b042a5e094c4_del complete
Nov 14 01:07:21 user nova-compute[74850]: INFO nova.compute.manager [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 14 01:07:21 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 01:07:21 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 01:07:22 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:07:22 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Took 0.77 seconds to deallocate network for instance.
Nov 14 01:07:22 user nova-compute[74850]: DEBUG nova.compute.manager [req-cd2f0d1f-6ac7-4988-bd81-dbcbc811d6d7 req-6b6b1bbc-6c4b-4817-9ee1-fecf27f5807b service nova] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Received event network-vif-deleted-080e37ec-a952-4eb5-bc53-578a3fe28094 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:07:22 user nova-compute[74850]: INFO nova.compute.manager [req-cd2f0d1f-6ac7-4988-bd81-dbcbc811d6d7 req-6b6b1bbc-6c4b-4817-9ee1-fecf27f5807b service nova] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Neutron deleted interface 080e37ec-a952-4eb5-bc53-578a3fe28094; detaching it from the instance and deleting it from the info cache
Nov 14 01:07:22 user nova-compute[74850]: DEBUG nova.network.neutron [req-cd2f0d1f-6ac7-4988-bd81-dbcbc811d6d7 req-6b6b1bbc-6c4b-4817-9ee1-fecf27f5807b service nova] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:07:22 user nova-compute[74850]: DEBUG nova.compute.manager [req-cd2f0d1f-6ac7-4988-bd81-dbcbc811d6d7 req-6b6b1bbc-6c4b-4817-9ee1-fecf27f5807b service nova] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Detach interface failed, port_id=080e37ec-a952-4eb5-bc53-578a3fe28094, reason: Instance 998f2d6a-e3b6-4135-9485-b042a5e094c4 could not be found. {{(pid=74850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 01:07:22 user nova-compute[74850]: DEBUG nova.compute.manager [req-77a876e4-dac0-4433-9f0a-dc7f92a229c4 req-a10d68b5-365d-48ab-bcaf-d85082395327 service nova] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Received event network-vif-plugged-080e37ec-a952-4eb5-bc53-578a3fe28094 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:07:22 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-77a876e4-dac0-4433-9f0a-dc7f92a229c4 req-a10d68b5-365d-48ab-bcaf-d85082395327 service nova] Acquiring lock "998f2d6a-e3b6-4135-9485-b042a5e094c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:07:22 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-77a876e4-dac0-4433-9f0a-dc7f92a229c4 req-a10d68b5-365d-48ab-bcaf-d85082395327 service nova] Lock "998f2d6a-e3b6-4135-9485-b042a5e094c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:07:22 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-77a876e4-dac0-4433-9f0a-dc7f92a229c4 req-a10d68b5-365d-48ab-bcaf-d85082395327 service nova] Lock "998f2d6a-e3b6-4135-9485-b042a5e094c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:07:22 user nova-compute[74850]: DEBUG nova.compute.manager [req-77a876e4-dac0-4433-9f0a-dc7f92a229c4 req-a10d68b5-365d-48ab-bcaf-d85082395327 service nova] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] No waiting events found dispatching network-vif-plugged-080e37ec-a952-4eb5-bc53-578a3fe28094 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:07:22 user nova-compute[74850]: WARNING nova.compute.manager [req-77a876e4-dac0-4433-9f0a-dc7f92a229c4 req-a10d68b5-365d-48ab-bcaf-d85082395327 service nova] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Received unexpected event network-vif-plugged-080e37ec-a952-4eb5-bc53-578a3fe28094 for instance with vm_state active and task_state deleting.
Nov 14 01:07:22 user nova-compute[74850]: INFO nova.compute.manager [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Took 0.71 seconds to detach 1 volumes for instance.
Nov 14 01:07:22 user nova-compute[74850]: DEBUG nova.compute.manager [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 998f2d6a-e3b6-4135-9485-b042a5e094c4] Deleting volume: 20a4b5a6-0e20-4a30-9464-8c89e563ef8d {{(pid=74850) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 01:07:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:07:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:07:23 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Refreshing inventories for resource provider fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 01:07:23 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Updating ProviderTree inventory for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 01:07:23 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Updating inventory in ProviderTree for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 01:07:23 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Refreshing aggregate associations for resource provider fe703abb-f68c-420d-a7f0-bf5240e23c54, aggregates: None {{(pid=74850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 01:07:23 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Refreshing trait associations for resource provider fe703abb-f68c-420d-a7f0-bf5240e23c54, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 01:07:23 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:07:23 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:07:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:07:23 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Deleted allocations for instance 998f2d6a-e3b6-4135-9485-b042a5e094c4
Nov 14 01:07:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-bb997f3c-eb9f-4b00-b80c-daed8755ead7 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "998f2d6a-e3b6-4135-9485-b042a5e094c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.418s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:07:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:27 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-28eeda48-27c3-44a7-967b-83d7aa68765e tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a1fa283c-79c2-4b52-9e91-70ec0e01115d is timed out.
Nov 14 01:07:27 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-28eeda48-27c3-44a7-967b-83d7aa68765e tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Successfully detached device vdb from instance a1fa283c-79c2-4b52-9e91-70ec0e01115d from the live domain config.
Nov 14 01:07:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28eeda48-27c3-44a7-967b-83d7aa68765e tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-28eeda48-27c3-44a7-967b-83d7aa68765e tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aXUZYunq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:07:27 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-28eeda48-27c3-44a7-967b-83d7aa68765e tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:07:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-28eeda48-27c3-44a7-967b-83d7aa68765e tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-28eeda48-27c3-44a7-967b-83d7aa68765e tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ff4e3c-63c7-46ae-9f66-1c6278d6bd76]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-28eeda48-27c3-44a7-967b-83d7aa68765e tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 01:07:27 user nova-compute[74850]: No targets found.
Nov 14 01:07:27 user nova-compute[74850]: iSNS:
Nov 14 01:07:27 user nova-compute[74850]: No targets found.
Nov 14 01:07:27 user nova-compute[74850]: STATIC:
Nov 14 01:07:27 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d
Nov 14 01:07:27 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:07:27 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:07:27 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a
Nov 14 01:07:27 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:07:27 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:07:27 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d
Nov 14 01:07:27 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:07:27 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:07:27 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a
Nov 14 01:07:27 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:07:27 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:07:27 user nova-compute[74850]: FIRMWARE:
Nov 14 01:07:27 user nova-compute[74850]: No targets found.
Nov 14 01:07:27 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-28eeda48-27c3-44a7-967b-83d7aa68765e tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 01:07:27 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 01:07:27 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-28eeda48-27c3-44a7-967b-83d7aa68765e tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[39848216-b8c2-48ed-b518-174955c57bb0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc99345-0889-4b25-b224-516fe6a35c31]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-28eeda48-27c3-44a7-967b-83d7aa68765e tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:07:27 user nova-compute[74850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:07:27 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:07:27 user nova-compute[74850]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a (non-flash)
Nov 14 01:07:27 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-28eeda48-27c3-44a7-967b-83d7aa68765e tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:07:27 user nova-compute[74850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:07:27 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:07:27 user nova-compute[74850]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a (non-flash)
Nov 14 01:07:27 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-28eeda48-27c3-44a7-967b-83d7aa68765e tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a3c750700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a'): ({'sdb'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-28eeda48-27c3-44a7-967b-83d7aa68765e tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Removing single pathed devices sdb {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1302292c-badd-4c55-bd44-2ac3b622fba2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62ac735-26f4-4c6f-97ef-4a3783eb5f7d]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-28eeda48-27c3-44a7-967b-83d7aa68765e tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Flushing IO for device /dev/sdb {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7adc1c8-6449-47c9-93ab-690b5a1734ea]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-28eeda48-27c3-44a7-967b-83d7aa68765e tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2d3333-ce76-44be-8a5b-2349488709b3]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-28eeda48-27c3-44a7-967b-83d7aa68765e tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-28eeda48-27c3-44a7-967b-83d7aa68765e tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-28eeda48-27c3-44a7-967b-83d7aa68765e tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0dc6af-cab2-459f-8109-70544db1b6cd]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-28eeda48-27c3-44a7-967b-83d7aa68765e tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1297f28b-7807-4701-bacd-da070c552c00]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-28eeda48-27c3-44a7-967b-83d7aa68765e tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a, portal: 172.16.0.220,3260]
Nov 14 01:07:27 user nova-compute[74850]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a, portal: 172.16.0.220,3260] successful.
Nov 14 01:07:27 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d8dd99b-95e3-438d-92a0-1965e80b469a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[267c9847-13b4-40e5-a437-386b2c8c1f99]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-28eeda48-27c3-44a7-967b-83d7aa68765e tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-28eeda48-27c3-44a7-967b-83d7aa68765e tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-28eeda48-27c3-44a7-967b-83d7aa68765e tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] <== disconnect_volume: return (290ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:07:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28eeda48-27c3-44a7-967b-83d7aa68765e tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 01:07:28 user nova-compute[74850]: DEBUG nova.objects.instance [None req-28eeda48-27c3-44a7-967b-83d7aa68765e tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lazy-loading 'flavor' on Instance uuid a1fa283c-79c2-4b52-9e91-70ec0e01115d {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:07:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-28eeda48-27c3-44a7-967b-83d7aa68765e tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "a1fa283c-79c2-4b52-9e91-70ec0e01115d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.603s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:07:30 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "6f0cb80d-dfec-4278-81ff-0e292bad880a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:07:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "6f0cb80d-dfec-4278-81ff-0e292bad880a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:07:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "6f0cb80d-dfec-4278-81ff-0e292bad880a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:07:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "6f0cb80d-dfec-4278-81ff-0e292bad880a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:07:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "6f0cb80d-dfec-4278-81ff-0e292bad880a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:07:44 user nova-compute[74850]: INFO nova.compute.manager [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Terminating instance
Nov 14 01:07:44 user nova-compute[74850]: DEBUG nova.compute.manager [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 01:07:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:44 user nova-compute[74850]: DEBUG nova.compute.manager [req-eb8b0d23-5213-4a9a-b5d8-674fd58a0039 req-22488892-69ed-4399-82c7-32c3bf03e59a service nova] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Received event network-vif-unplugged-430fc00c-2c5c-4139-8344-47c701006287 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:07:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-eb8b0d23-5213-4a9a-b5d8-674fd58a0039 req-22488892-69ed-4399-82c7-32c3bf03e59a service nova] Acquiring lock "6f0cb80d-dfec-4278-81ff-0e292bad880a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:07:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-eb8b0d23-5213-4a9a-b5d8-674fd58a0039 req-22488892-69ed-4399-82c7-32c3bf03e59a service nova] Lock "6f0cb80d-dfec-4278-81ff-0e292bad880a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:07:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-eb8b0d23-5213-4a9a-b5d8-674fd58a0039 req-22488892-69ed-4399-82c7-32c3bf03e59a service nova] Lock "6f0cb80d-dfec-4278-81ff-0e292bad880a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:07:44 user nova-compute[74850]: DEBUG nova.compute.manager [req-eb8b0d23-5213-4a9a-b5d8-674fd58a0039 req-22488892-69ed-4399-82c7-32c3bf03e59a service nova] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] No waiting events found dispatching network-vif-unplugged-430fc00c-2c5c-4139-8344-47c701006287 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:07:44 user nova-compute[74850]: DEBUG nova.compute.manager [req-eb8b0d23-5213-4a9a-b5d8-674fd58a0039 req-22488892-69ed-4399-82c7-32c3bf03e59a service nova] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Received event network-vif-unplugged-430fc00c-2c5c-4139-8344-47c701006287 for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 01:07:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:45 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Instance destroyed successfully.
Nov 14 01:07:45 user nova-compute[74850]: DEBUG nova.objects.instance [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lazy-loading 'resources' on Instance uuid 6f0cb80d-dfec-4278-81ff-0e292bad880a {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:01:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-314685057',display_name='tempest-ServerActionsTestOtherA-server-314685057',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-314685057',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEDBs7Es/72p/FM9xIVe3NSPFzUvxLUb0JwmaT04oo+hgQgHwN4cwLNmRX2VhLFhce2UGzsRv1c1pV/ZeRW8oCrRJ/Tmr/k2YN/XTGeAv4iUUyvZpvQioCuIlgWRqA+LA==',key_name='tempest-keypair-638803187',keypairs=<?>,launch_index=0,launched_at=2023-11-14T01:03:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67d09cd8d15a4b058988fa348d7fdc2e',ramdisk_id='',reservation_id='r-n0nc986k',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1680693726',owner_user_name='tempest-ServerActionsTestOtherA-1680693726-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T01:04:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dab7bcadfc32457e8bfa6fa81cba2702',uuid=6f0cb80d-dfec-4278-81ff-0e292bad880a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "430fc00c-2c5c-4139-8344-47c701006287", "address": "fa:16:3e:ff:f2:a3", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap430fc00c-2c", "ovs_interfaceid": "430fc00c-2c5c-4139-8344-47c701006287", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Converting VIF {"id": "430fc00c-2c5c-4139-8344-47c701006287", "address": "fa:16:3e:ff:f2:a3", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap430fc00c-2c", "ovs_interfaceid": "430fc00c-2c5c-4139-8344-47c701006287", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:f2:a3,bridge_name='br-int',has_traffic_filtering=True,id=430fc00c-2c5c-4139-8344-47c701006287,network=Network(6e563565-dc0c-4f19-9030-742bf28811d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap430fc00c-2c') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG os_vif [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:f2:a3,bridge_name='br-int',has_traffic_filtering=True,id=430fc00c-2c5c-4139-8344-47c701006287,network=Network(6e563565-dc0c-4f19-9030-742bf28811d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap430fc00c-2c') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap430fc00c-2c, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9d65467f-8939-40cf-8969-6959df22814f) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:45 user nova-compute[74850]: INFO os_vif [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:f2:a3,bridge_name='br-int',has_traffic_filtering=True,id=430fc00c-2c5c-4139-8344-47c701006287,network=Network(6e563565-dc0c-4f19-9030-742bf28811d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap430fc00c-2c')
Nov 14 01:07:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IPjahxlF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:07:45 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:07:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c9d2b1-a67b-4507-96ec-25ae1c6a5a83]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 01:07:45 user nova-compute[74850]: No targets found.
Nov 14 01:07:45 user nova-compute[74850]: iSNS:
Nov 14 01:07:45 user nova-compute[74850]: No targets found.
Nov 14 01:07:45 user nova-compute[74850]: STATIC:
Nov 14 01:07:45 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d
Nov 14 01:07:45 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:07:45 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:07:45 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a
Nov 14 01:07:45 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:07:45 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:07:45 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d
Nov 14 01:07:45 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:07:45 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:07:45 user nova-compute[74850]: FIRMWARE:
Nov 14 01:07:45 user nova-compute[74850]: No targets found.
Nov 14 01:07:45 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 01:07:45 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 01:07:45 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ceaee40-daa0-4b13-83b4-971907d184e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[12eade1c-b524-431b-b9dd-e1cb77862c82]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:07:45 user nova-compute[74850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:07:45 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:07:45 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:07:45 user nova-compute[74850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d (non-flash)
Nov 14 01:07:45 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:07:45 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a3c71f250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d'): ({'sdg'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Removing single pathed devices sdg {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c2d76b-a98f-4a96-b669-fee100aaed81]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e76b86-c267-43a5-bb4f-be8e26ea5edf]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Flushing IO for device /dev/sdg {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b02bd67-5ee4-4a53-9bcf-9394d20a270e]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.050s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf65cd56-0f21-4efd-b50c-57c2466975b5]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] SCSI volumes sdg have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26635313330396361', '/dev/disk/by-id/scsi-1SCST_BIOeb819ec-f51309cac83b316c', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_eb819ec') {{(pid=84948) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f88711-bb0d-45f2-9cca-3a1e18ca9312]: (4, None) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[457c35fb-b671-4e4d-8731-23768978310e]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfe400c-1618-44e3-94ef-54db27c0dbc3]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d, portal: 172.16.0.220,3260]
Nov 14 01:07:45 user nova-compute[74850]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d, portal: 172.16.0.220,3260] successful.
Nov 14 01:07:45 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0061b40f-c802-454f-b38b-b74cc014fc2d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[646bebca-0564-4da9-82d7-be378bb6dba4]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] <== disconnect_volume: return (324ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 01:07:45 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Deleting instance files /opt/stack/data/nova/instances/6f0cb80d-dfec-4278-81ff-0e292bad880a_del
Nov 14 01:07:45 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Deletion of /opt/stack/data/nova/instances/6f0cb80d-dfec-4278-81ff-0e292bad880a_del complete
Nov 14 01:07:45 user nova-compute[74850]: INFO nova.compute.manager [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 14 01:07:45 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 01:07:45 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 01:07:46 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:07:46 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Took 0.73 seconds to deallocate network for instance.
Nov 14 01:07:46 user nova-compute[74850]: DEBUG nova.compute.manager [req-23dab558-6f1e-4af4-9b4c-6ff997d648c4 req-d34bfdb4-9529-42f9-892f-cf34f9240310 service nova] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Received event network-vif-plugged-430fc00c-2c5c-4139-8344-47c701006287 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:07:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-23dab558-6f1e-4af4-9b4c-6ff997d648c4 req-d34bfdb4-9529-42f9-892f-cf34f9240310 service nova] Acquiring lock "6f0cb80d-dfec-4278-81ff-0e292bad880a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:07:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-23dab558-6f1e-4af4-9b4c-6ff997d648c4 req-d34bfdb4-9529-42f9-892f-cf34f9240310 service nova] Lock "6f0cb80d-dfec-4278-81ff-0e292bad880a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:07:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-23dab558-6f1e-4af4-9b4c-6ff997d648c4 req-d34bfdb4-9529-42f9-892f-cf34f9240310 service nova] Lock "6f0cb80d-dfec-4278-81ff-0e292bad880a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:07:46 user nova-compute[74850]: DEBUG nova.compute.manager [req-23dab558-6f1e-4af4-9b4c-6ff997d648c4 req-d34bfdb4-9529-42f9-892f-cf34f9240310 service nova] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] No waiting events found dispatching network-vif-plugged-430fc00c-2c5c-4139-8344-47c701006287 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:07:46 user nova-compute[74850]: WARNING nova.compute.manager [req-23dab558-6f1e-4af4-9b4c-6ff997d648c4 req-d34bfdb4-9529-42f9-892f-cf34f9240310 service nova] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Received unexpected event network-vif-plugged-430fc00c-2c5c-4139-8344-47c701006287 for instance with vm_state active and task_state deleting.
Nov 14 01:07:46 user nova-compute[74850]: DEBUG nova.compute.manager [req-23dab558-6f1e-4af4-9b4c-6ff997d648c4 req-d34bfdb4-9529-42f9-892f-cf34f9240310 service nova] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Received event network-vif-deleted-430fc00c-2c5c-4139-8344-47c701006287 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:07:47 user nova-compute[74850]: INFO nova.compute.manager [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Took 0.71 seconds to detach 1 volumes for instance.
Nov 14 01:07:47 user nova-compute[74850]: DEBUG nova.compute.manager [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 6f0cb80d-dfec-4278-81ff-0e292bad880a] Deleting volume: 0061b40f-c802-454f-b38b-b74cc014fc2d {{(pid=74850) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 01:07:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:07:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:07:47 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:07:47 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:07:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.281s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:07:47 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Deleted allocations for instance 6f0cb80d-dfec-4278-81ff-0e292bad880a
Nov 14 01:07:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-86ce9d85-5265-4daf-aa50-af592cd2053c tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "6f0cb80d-dfec-4278-81ff-0e292bad880a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.145s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:07:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:55 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:07:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:07:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:07:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:07:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 01:07:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:07:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:07:56 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 01:07:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:07:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:07:56 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 01:07:56 user nova-compute[74850]: INFO nova.compute.claims [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Claim successful on node user
Nov 14 01:07:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-457758a4-9b79-4dd0-afad-4cb5f970ad1c tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "a1fa283c-79c2-4b52-9e91-70ec0e01115d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-457758a4-9b79-4dd0-afad-4cb5f970ad1c tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "a1fa283c-79c2-4b52-9e91-70ec0e01115d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-457758a4-9b79-4dd0-afad-4cb5f970ad1c tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "a1fa283c-79c2-4b52-9e91-70ec0e01115d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-457758a4-9b79-4dd0-afad-4cb5f970ad1c tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "a1fa283c-79c2-4b52-9e91-70ec0e01115d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-457758a4-9b79-4dd0-afad-4cb5f970ad1c tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "a1fa283c-79c2-4b52-9e91-70ec0e01115d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:07:57 user nova-compute[74850]: INFO nova.compute.manager [None req-457758a4-9b79-4dd0-afad-4cb5f970ad1c tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Terminating instance
Nov 14 01:07:57 user nova-compute[74850]: DEBUG nova.compute.manager [None req-457758a4-9b79-4dd0-afad-4cb5f970ad1c tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.593s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG nova.compute.manager [req-8eae2bda-42d9-44e1-8e6a-bfb14ad60760 req-9002d443-7448-4535-a1b0-3d936677bb88 service nova] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Received event network-vif-unplugged-0bd9a14c-20bb-49e2-9af2-d84aef11483b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-8eae2bda-42d9-44e1-8e6a-bfb14ad60760 req-9002d443-7448-4535-a1b0-3d936677bb88 service nova] Acquiring lock "a1fa283c-79c2-4b52-9e91-70ec0e01115d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-8eae2bda-42d9-44e1-8e6a-bfb14ad60760 req-9002d443-7448-4535-a1b0-3d936677bb88 service nova] Lock "a1fa283c-79c2-4b52-9e91-70ec0e01115d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-8eae2bda-42d9-44e1-8e6a-bfb14ad60760 req-9002d443-7448-4535-a1b0-3d936677bb88 service nova] Lock "a1fa283c-79c2-4b52-9e91-70ec0e01115d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG nova.compute.manager [req-8eae2bda-42d9-44e1-8e6a-bfb14ad60760 req-9002d443-7448-4535-a1b0-3d936677bb88 service nova] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] No waiting events found dispatching network-vif-unplugged-0bd9a14c-20bb-49e2-9af2-d84aef11483b {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG nova.compute.manager [req-8eae2bda-42d9-44e1-8e6a-bfb14ad60760 req-9002d443-7448-4535-a1b0-3d936677bb88 service nova] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Received event network-vif-unplugged-0bd9a14c-20bb-49e2-9af2-d84aef11483b for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG nova.network.neutron [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 01:07:57 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 01:07:57 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG nova.policy [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b677f8f7b06431cbeac4cbdfa2dcbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3e629e632d444faf3898681aaafa79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 01:07:57 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Creating image(s)
Nov 14 01:07:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "/opt/stack/data/nova/instances/2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "/opt/stack/data/nova/instances/2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "/opt/stack/data/nova/instances/2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.181s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1fa283c-79c2-4b52-9e91-70ec0e01115d/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:57 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Instance destroyed successfully.
Nov 14 01:07:57 user nova-compute[74850]: DEBUG nova.objects.instance [None req-457758a4-9b79-4dd0-afad-4cb5f970ad1c tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lazy-loading 'resources' on Instance uuid a1fa283c-79c2-4b52-9e91-70ec0e01115d {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:07:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-457758a4-9b79-4dd0-afad-4cb5f970ad1c tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:05:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-354361353',display_name='tempest-AttachVolumeNegativeTest-server-354361353',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-354361353',id=41,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9T86AxQUjfy8aU/sp+Pjw+2BVeZTWrZsbX3mMir4RSNygZMeB9pv7Whrz7fC4we5tT3bVzqcGY53GRuYp7HwcU/zgIT1TLdbJPknvX7uFcLk6isOy/0bKIKTwR3T4fcw==',key_name='tempest-keypair-858077389',keypairs=<?>,launch_index=0,launched_at=2023-11-14T01:05:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35f609057d1e44679838d565d80cade3',ramdisk_id='',reservation_id='r-w2zz9r1m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1995397455',owner_user_name='tempest-AttachVolumeNegativeTest-1995397455-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T01:05:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb027592ab214b57b389227a97576a43',uuid=a1fa283c-79c2-4b52-9e91-70ec0e01115d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0bd9a14c-20bb-49e2-9af2-d84aef11483b", "address": "fa:16:3e:c6:1f:a9", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9a14c-20", "ovs_interfaceid": "0bd9a14c-20bb-49e2-9af2-d84aef11483b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-457758a4-9b79-4dd0-afad-4cb5f970ad1c tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Converting VIF {"id": "0bd9a14c-20bb-49e2-9af2-d84aef11483b", "address": "fa:16:3e:c6:1f:a9", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9a14c-20", "ovs_interfaceid": "0bd9a14c-20bb-49e2-9af2-d84aef11483b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-457758a4-9b79-4dd0-afad-4cb5f970ad1c tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:1f:a9,bridge_name='br-int',has_traffic_filtering=True,id=0bd9a14c-20bb-49e2-9af2-d84aef11483b,network=Network(11208f55-0e63-4c33-a12c-e061c8061eec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bd9a14c-20') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG os_vif [None req-457758a4-9b79-4dd0-afad-4cb5f970ad1c tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:1f:a9,bridge_name='br-int',has_traffic_filtering=True,id=0bd9a14c-20bb-49e2-9af2-d84aef11483b,network=Network(11208f55-0e63-4c33-a12c-e061c8061eec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bd9a14c-20') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0bd9a14c-20, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=32c43e3c-bbc0-4ea5-b88c-97621579ffa3) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:07:58 user nova-compute[74850]: INFO os_vif [None req-457758a4-9b79-4dd0-afad-4cb5f970ad1c tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:1f:a9,bridge_name='br-int',has_traffic_filtering=True,id=0bd9a14c-20bb-49e2-9af2-d84aef11483b,network=Network(11208f55-0e63-4c33-a12c-e061c8061eec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bd9a14c-20')
Nov 14 01:07:58 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-457758a4-9b79-4dd0-afad-4cb5f970ad1c tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Deleting instance files /opt/stack/data/nova/instances/a1fa283c-79c2-4b52-9e91-70ec0e01115d_del
Nov 14 01:07:58 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-457758a4-9b79-4dd0-afad-4cb5f970ad1c tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Deletion of /opt/stack/data/nova/instances/a1fa283c-79c2-4b52-9e91-70ec0e01115d_del complete
Nov 14 01:07:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.188s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1fa283c-79c2-4b52-9e91-70ec0e01115d/disk --force-share --output=json" returned: 1 in 0.191s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1fa283c-79c2-4b52-9e91-70ec0e01115d/disk --force-share --output=json' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe/disk 1073741824" returned: 0 in 0.049s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:58 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000029, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/a1fa283c-79c2-4b52-9e91-70ec0e01115d/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/a1fa283c-79c2-4b52-9e91-70ec0e01115d/disk
Nov 14 01:07:58 user nova-compute[74850]: INFO nova.compute.manager [None req-457758a4-9b79-4dd0-afad-4cb5f970ad1c tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 14 01:07:58 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-457758a4-9b79-4dd0-afad-4cb5f970ad1c tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e38d20-9aac-4037-b1b4-0c25005a9a67/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG nova.network.neutron [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Successfully created port: 5316b921-a92e-4c0f-93df-873d035c4ed0 {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.175s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e38d20-9aac-4037-b1b4-0c25005a9a67/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e38d20-9aac-4037-b1b4-0c25005a9a67/disk.rescue --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Cannot resize image /opt/stack/data/nova/instances/2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Ensure instance console log exists: /opt/stack/data/nova/instances/2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e38d20-9aac-4037-b1b4-0c25005a9a67/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2294e4d8-7e62-4875-822f-bc9020721881/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2294e4d8-7e62-4875-822f-bc9020721881/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2294e4d8-7e62-4875-822f-bc9020721881/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG nova.network.neutron [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Successfully updated port: 5316b921-a92e-4c0f-93df-873d035c4ed0 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "refresh_cache-2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquired lock "refresh_cache-2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG nova.network.neutron [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 01:07:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2294e4d8-7e62-4875-822f-bc9020721881/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.network.neutron [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 01:07:59 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Took 1.15 seconds to deallocate network for instance.
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.compute.manager [req-aa9c6665-eb5c-4b78-a845-bfdf23bf8bdd req-fcded7f3-9502-4012-b97a-e8f766347933 service nova] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Received event network-vif-deleted-0bd9a14c-20bb-49e2-9af2-d84aef11483b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:07:59 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:07:59 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=8017MB free_disk=24.872806549072266GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-457758a4-9b79-4dd0-afad-4cb5f970ad1c tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 748d0da7-bbb9-4e86-aae3-e48b1fa04c14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance c7952bff-87d6-46c1-a6d4-7729dc4893ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 702746f7-305f-4eac-a71a-6c08b7cbccd8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 3504ddd3-bdd8-465e-aec5-190acdd563f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance e6e38d20-9aac-4037-b1b4-0c25005a9a67 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance a1fa283c-79c2-4b52-9e91-70ec0e01115d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance efa96c60-9902-4ca9-8f0e-d27bdb883829 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 2294e4d8-7e62-4875-822f-bc9020721881 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.compute.manager [req-f0629f35-254b-4a8e-aa3f-d2f7fed7cf2c req-980cc304-0bc9-4330-a693-bb022c016b81 service nova] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Received event network-vif-plugged-0bd9a14c-20bb-49e2-9af2-d84aef11483b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f0629f35-254b-4a8e-aa3f-d2f7fed7cf2c req-980cc304-0bc9-4330-a693-bb022c016b81 service nova] Acquiring lock "a1fa283c-79c2-4b52-9e91-70ec0e01115d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f0629f35-254b-4a8e-aa3f-d2f7fed7cf2c req-980cc304-0bc9-4330-a693-bb022c016b81 service nova] Lock "a1fa283c-79c2-4b52-9e91-70ec0e01115d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f0629f35-254b-4a8e-aa3f-d2f7fed7cf2c req-980cc304-0bc9-4330-a693-bb022c016b81 service nova] Lock "a1fa283c-79c2-4b52-9e91-70ec0e01115d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.compute.manager [req-f0629f35-254b-4a8e-aa3f-d2f7fed7cf2c req-980cc304-0bc9-4330-a693-bb022c016b81 service nova] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] No waiting events found dispatching network-vif-plugged-0bd9a14c-20bb-49e2-9af2-d84aef11483b {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:07:59 user nova-compute[74850]: WARNING nova.compute.manager [req-f0629f35-254b-4a8e-aa3f-d2f7fed7cf2c req-980cc304-0bc9-4330-a693-bb022c016b81 service nova] [instance: a1fa283c-79c2-4b52-9e91-70ec0e01115d] Received unexpected event network-vif-plugged-0bd9a14c-20bb-49e2-9af2-d84aef11483b for instance with vm_state deleted and task_state None.
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.compute.manager [req-f0629f35-254b-4a8e-aa3f-d2f7fed7cf2c req-980cc304-0bc9-4330-a693-bb022c016b81 service nova] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Received event network-changed-5316b921-a92e-4c0f-93df-873d035c4ed0 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.compute.manager [req-f0629f35-254b-4a8e-aa3f-d2f7fed7cf2c req-980cc304-0bc9-4330-a693-bb022c016b81 service nova] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Refreshing instance network info cache due to event network-changed-5316b921-a92e-4c0f-93df-873d035c4ed0. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f0629f35-254b-4a8e-aa3f-d2f7fed7cf2c req-980cc304-0bc9-4330-a693-bb022c016b81 service nova] Acquiring lock "refresh_cache-2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.network.neutron [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Updating instance_info_cache with network_info: [{"id": "5316b921-a92e-4c0f-93df-873d035c4ed0", "address": "fa:16:3e:da:b9:ee", "network": {"id": "75650b3d-1169-46fa-a1cf-7ae51dd28e18", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227679489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3e629e632d444faf3898681aaafa79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5316b921-a9", "ovs_interfaceid": "5316b921-a92e-4c0f-93df-873d035c4ed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Releasing lock "refresh_cache-2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Instance network_info: |[{"id": "5316b921-a92e-4c0f-93df-873d035c4ed0", "address": "fa:16:3e:da:b9:ee", "network": {"id": "75650b3d-1169-46fa-a1cf-7ae51dd28e18", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227679489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3e629e632d444faf3898681aaafa79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5316b921-a9", "ovs_interfaceid": "5316b921-a92e-4c0f-93df-873d035c4ed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f0629f35-254b-4a8e-aa3f-d2f7fed7cf2c req-980cc304-0bc9-4330-a693-bb022c016b81 service nova] Acquired lock "refresh_cache-2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.network.neutron [req-f0629f35-254b-4a8e-aa3f-d2f7fed7cf2c req-980cc304-0bc9-4330-a693-bb022c016b81 service nova] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Refreshing network info cache for port 5316b921-a92e-4c0f-93df-873d035c4ed0 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Start _get_guest_xml network_info=[{"id": "5316b921-a92e-4c0f-93df-873d035c4ed0", "address": "fa:16:3e:da:b9:ee", "network": {"id": "75650b3d-1169-46fa-a1cf-7ae51dd28e18", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227679489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3e629e632d444faf3898681aaafa79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5316b921-a9", "ovs_interfaceid": "5316b921-a92e-4c0f-93df-873d035c4ed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 01:07:59 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:07:59 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:07:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1709452662',display_name='tempest-AttachVolumeTestJSON-server-1709452662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1709452662',id=44,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFo2BL467Q/ec5NXXDWSRlq9MRMJMFuJLxWL0v53vzjEipJurbM7lzz1endbDpx+UwEjZQJIcYEIGibZcbnsXxFRCixjgH46YVKIeyZzfDi5OAX5th8BvR8PF5nAaXv5jQ==',key_name='tempest-keypair-1771496660',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c3e629e632d444faf3898681aaafa79',ramdisk_id='',reservation_id='r-q00d5w3n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1639440895',owner_user_name='tempest-AttachVolumeTestJSON-1639440895-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:07:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b677f8f7b06431cbeac4cbdfa2dcbf5',uuid=2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5316b921-a92e-4c0f-93df-873d035c4ed0", "address": "fa:16:3e:da:b9:ee", "network": {"id": "75650b3d-1169-46fa-a1cf-7ae51dd28e18", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227679489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3e629e632d444faf3898681aaafa79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5316b921-a9", "ovs_interfaceid": "5316b921-a92e-4c0f-93df-873d035c4ed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Converting VIF {"id": "5316b921-a92e-4c0f-93df-873d035c4ed0", "address": "fa:16:3e:da:b9:ee", "network": {"id": "75650b3d-1169-46fa-a1cf-7ae51dd28e18", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227679489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3e629e632d444faf3898681aaafa79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5316b921-a9", "ovs_interfaceid": "5316b921-a92e-4c0f-93df-873d035c4ed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:b9:ee,bridge_name='br-int',has_traffic_filtering=True,id=5316b921-a92e-4c0f-93df-873d035c4ed0,network=Network(75650b3d-1169-46fa-a1cf-7ae51dd28e18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5316b921-a9') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.objects.instance [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] End _get_guest_xml xml=<domain type="kvm">
Nov 14 01:07:59 user nova-compute[74850]:   <uuid>2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe</uuid>
Nov 14 01:07:59 user nova-compute[74850]:   <name>instance-0000002c</name>
Nov 14 01:07:59 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 01:07:59 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 01:07:59 user nova-compute[74850]:   <metadata>
Nov 14 01:07:59 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 01:07:59 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 01:07:59 user nova-compute[74850]:       <nova:name>tempest-AttachVolumeTestJSON-server-1709452662</nova:name>
Nov 14 01:07:59 user nova-compute[74850]:       <nova:creationTime>2023-11-14 01:07:59</nova:creationTime>
Nov 14 01:07:59 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 01:07:59 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 01:07:59 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 01:07:59 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 01:07:59 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 01:07:59 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 01:07:59 user nova-compute[74850]:       </nova:flavor>
Nov 14 01:07:59 user nova-compute[74850]:       <nova:owner>
Nov 14 01:07:59 user nova-compute[74850]:         <nova:user uuid="4b677f8f7b06431cbeac4cbdfa2dcbf5">tempest-AttachVolumeTestJSON-1639440895-project-member</nova:user>
Nov 14 01:07:59 user nova-compute[74850]:         <nova:project uuid="0c3e629e632d444faf3898681aaafa79">tempest-AttachVolumeTestJSON-1639440895</nova:project>
Nov 14 01:07:59 user nova-compute[74850]:       </nova:owner>
Nov 14 01:07:59 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 01:07:59 user nova-compute[74850]:       <nova:ports>
Nov 14 01:07:59 user nova-compute[74850]:         <nova:port uuid="5316b921-a92e-4c0f-93df-873d035c4ed0">
Nov 14 01:07:59 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 01:07:59 user nova-compute[74850]:         </nova:port>
Nov 14 01:07:59 user nova-compute[74850]:       </nova:ports>
Nov 14 01:07:59 user nova-compute[74850]:     </nova:instance>
Nov 14 01:07:59 user nova-compute[74850]:   </metadata>
Nov 14 01:07:59 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 01:07:59 user nova-compute[74850]:     <system>
Nov 14 01:07:59 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 01:07:59 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 01:07:59 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 01:07:59 user nova-compute[74850]:       <entry name="serial">2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe</entry>
Nov 14 01:07:59 user nova-compute[74850]:       <entry name="uuid">2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe</entry>
Nov 14 01:07:59 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 01:07:59 user nova-compute[74850]:     </system>
Nov 14 01:07:59 user nova-compute[74850]:   </sysinfo>
Nov 14 01:07:59 user nova-compute[74850]:   <os>
Nov 14 01:07:59 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 01:07:59 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 01:07:59 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 01:07:59 user nova-compute[74850]:   </os>
Nov 14 01:07:59 user nova-compute[74850]:   <features>
Nov 14 01:07:59 user nova-compute[74850]:     <acpi/>
Nov 14 01:07:59 user nova-compute[74850]:     <apic/>
Nov 14 01:07:59 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 01:07:59 user nova-compute[74850]:   </features>
Nov 14 01:07:59 user nova-compute[74850]:   <clock offset="utc">
Nov 14 01:07:59 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 01:07:59 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 01:07:59 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 01:07:59 user nova-compute[74850]:   </clock>
Nov 14 01:07:59 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 01:07:59 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 01:07:59 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 01:07:59 user nova-compute[74850]:   </cpu>
Nov 14 01:07:59 user nova-compute[74850]:   <devices>
Nov 14 01:07:59 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 01:07:59 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 01:07:59 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe/disk"/>
Nov 14 01:07:59 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 01:07:59 user nova-compute[74850]:     </disk>
Nov 14 01:07:59 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 01:07:59 user nova-compute[74850]:       <mac address="fa:16:3e:da:b9:ee"/>
Nov 14 01:07:59 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:07:59 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 01:07:59 user nova-compute[74850]:       <target dev="tap5316b921-a9"/>
Nov 14 01:07:59 user nova-compute[74850]:     </interface>
Nov 14 01:07:59 user nova-compute[74850]:     <serial type="pty">
Nov 14 01:07:59 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe/console.log" append="off"/>
Nov 14 01:07:59 user nova-compute[74850]:     </serial>
Nov 14 01:07:59 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 01:07:59 user nova-compute[74850]:     <video>
Nov 14 01:07:59 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:07:59 user nova-compute[74850]:     </video>
Nov 14 01:07:59 user nova-compute[74850]:     <rng model="virtio">
Nov 14 01:07:59 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 01:07:59 user nova-compute[74850]:     </rng>
Nov 14 01:07:59 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 01:07:59 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 01:07:59 user nova-compute[74850]:       <stats period="10"/>
Nov 14 01:07:59 user nova-compute[74850]:     </memballoon>
Nov 14 01:07:59 user nova-compute[74850]:   </devices>
Nov 14 01:07:59 user nova-compute[74850]: </domain>
Nov 14 01:07:59 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:07:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1709452662',display_name='tempest-AttachVolumeTestJSON-server-1709452662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1709452662',id=44,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFo2BL467Q/ec5NXXDWSRlq9MRMJMFuJLxWL0v53vzjEipJurbM7lzz1endbDpx+UwEjZQJIcYEIGibZcbnsXxFRCixjgH46YVKIeyZzfDi5OAX5th8BvR8PF5nAaXv5jQ==',key_name='tempest-keypair-1771496660',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c3e629e632d444faf3898681aaafa79',ramdisk_id='',reservation_id='r-q00d5w3n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1639440895',owner_user_name='tempest-AttachVolumeTestJSON-1639440895-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:07:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b677f8f7b06431cbeac4cbdfa2dcbf5',uuid=2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5316b921-a92e-4c0f-93df-873d035c4ed0", "address": "fa:16:3e:da:b9:ee", "network": {"id": "75650b3d-1169-46fa-a1cf-7ae51dd28e18", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227679489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3e629e632d444faf3898681aaafa79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5316b921-a9", "ovs_interfaceid": "5316b921-a92e-4c0f-93df-873d035c4ed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Converting VIF {"id": "5316b921-a92e-4c0f-93df-873d035c4ed0", "address": "fa:16:3e:da:b9:ee", "network": {"id": "75650b3d-1169-46fa-a1cf-7ae51dd28e18", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227679489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3e629e632d444faf3898681aaafa79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5316b921-a9", "ovs_interfaceid": "5316b921-a92e-4c0f-93df-873d035c4ed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:b9:ee,bridge_name='br-int',has_traffic_filtering=True,id=5316b921-a92e-4c0f-93df-873d035c4ed0,network=Network(75650b3d-1169-46fa-a1cf-7ae51dd28e18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5316b921-a9') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG os_vif [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:b9:ee,bridge_name='br-int',has_traffic_filtering=True,id=5316b921-a92e-4c0f-93df-873d035c4ed0,network=Network(75650b3d-1169-46fa-a1cf-7ae51dd28e18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5316b921-a9') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f02e8d38-9361-5c9f-860b-8e941e426a37', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5316b921-a9, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5316b921-a9, col_values=(('qos', UUID('1ec56674-2f9e-4873-8695-c34e99641035')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5316b921-a9, col_values=(('external_ids', {'iface-id': '5316b921-a92e-4c0f-93df-873d035c4ed0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:b9:ee', 'vm-uuid': '2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:07:59 user nova-compute[74850]: INFO os_vif [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:b9:ee,bridge_name='br-int',has_traffic_filtering=True,id=5316b921-a92e-4c0f-93df-873d035c4ed0,network=Network(75650b3d-1169-46fa-a1cf-7ae51dd28e18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5316b921-a9')
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] No VIF found with MAC fa:16:3e:da:b9:ee, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.514s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:07:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-457758a4-9b79-4dd0-afad-4cb5f970ad1c tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.470s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:08:00 user nova-compute[74850]: DEBUG nova.network.neutron [req-f0629f35-254b-4a8e-aa3f-d2f7fed7cf2c req-980cc304-0bc9-4330-a693-bb022c016b81 service nova] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Updated VIF entry in instance network info cache for port 5316b921-a92e-4c0f-93df-873d035c4ed0. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:08:00 user nova-compute[74850]: DEBUG nova.network.neutron [req-f0629f35-254b-4a8e-aa3f-d2f7fed7cf2c req-980cc304-0bc9-4330-a693-bb022c016b81 service nova] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Updating instance_info_cache with network_info: [{"id": "5316b921-a92e-4c0f-93df-873d035c4ed0", "address": "fa:16:3e:da:b9:ee", "network": {"id": "75650b3d-1169-46fa-a1cf-7ae51dd28e18", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227679489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3e629e632d444faf3898681aaafa79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5316b921-a9", "ovs_interfaceid": "5316b921-a92e-4c0f-93df-873d035c4ed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:08:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f0629f35-254b-4a8e-aa3f-d2f7fed7cf2c req-980cc304-0bc9-4330-a693-bb022c016b81 service nova] Releasing lock "refresh_cache-2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:08:00 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-457758a4-9b79-4dd0-afad-4cb5f970ad1c tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:08:00 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-457758a4-9b79-4dd0-afad-4cb5f970ad1c tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:08:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-457758a4-9b79-4dd0-afad-4cb5f970ad1c tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.317s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:08:00 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-457758a4-9b79-4dd0-afad-4cb5f970ad1c tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Deleted allocations for instance a1fa283c-79c2-4b52-9e91-70ec0e01115d
Nov 14 01:08:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-457758a4-9b79-4dd0-afad-4cb5f970ad1c tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "a1fa283c-79c2-4b52-9e91-70ec0e01115d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.156s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:08:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:01 user nova-compute[74850]: DEBUG nova.compute.manager [req-362f6aed-5b91-4c92-820d-11e0c949c611 req-b5133f59-d35e-40c0-849a-e3b1fcfcabb6 service nova] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Received event network-vif-plugged-5316b921-a92e-4c0f-93df-873d035c4ed0 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:08:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-362f6aed-5b91-4c92-820d-11e0c949c611 req-b5133f59-d35e-40c0-849a-e3b1fcfcabb6 service nova] Acquiring lock "2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:08:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-362f6aed-5b91-4c92-820d-11e0c949c611 req-b5133f59-d35e-40c0-849a-e3b1fcfcabb6 service nova] Lock "2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:08:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-362f6aed-5b91-4c92-820d-11e0c949c611 req-b5133f59-d35e-40c0-849a-e3b1fcfcabb6 service nova] Lock "2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:08:01 user nova-compute[74850]: DEBUG nova.compute.manager [req-362f6aed-5b91-4c92-820d-11e0c949c611 req-b5133f59-d35e-40c0-849a-e3b1fcfcabb6 service nova] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] No waiting events found dispatching network-vif-plugged-5316b921-a92e-4c0f-93df-873d035c4ed0 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:08:01 user nova-compute[74850]: WARNING nova.compute.manager [req-362f6aed-5b91-4c92-820d-11e0c949c611 req-b5133f59-d35e-40c0-849a-e3b1fcfcabb6 service nova] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Received unexpected event network-vif-plugged-5316b921-a92e-4c0f-93df-873d035c4ed0 for instance with vm_state building and task_state spawning.
Nov 14 01:08:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:03 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 01:08:03 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 01:08:03 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Instance spawned successfully.
Nov 14 01:08:03 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 01:08:03 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:08:03 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:08:03 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:08:03 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:08:03 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:08:03 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:08:03 user nova-compute[74850]: INFO nova.compute.manager [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Took 5.62 seconds to spawn the instance on the hypervisor.
Nov 14 01:08:03 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 01:08:03 user nova-compute[74850]: DEBUG nova.compute.manager [req-b2b2532a-29a5-4daf-b669-9e480cc227de req-300b7e3a-2c4d-4f8e-b97a-78940a7c4d8f service nova] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Received event network-vif-plugged-5316b921-a92e-4c0f-93df-873d035c4ed0 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:08:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b2b2532a-29a5-4daf-b669-9e480cc227de req-300b7e3a-2c4d-4f8e-b97a-78940a7c4d8f service nova] Acquiring lock "2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:08:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b2b2532a-29a5-4daf-b669-9e480cc227de req-300b7e3a-2c4d-4f8e-b97a-78940a7c4d8f service nova] Lock "2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:08:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b2b2532a-29a5-4daf-b669-9e480cc227de req-300b7e3a-2c4d-4f8e-b97a-78940a7c4d8f service nova] Lock "2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:08:03 user nova-compute[74850]: DEBUG nova.compute.manager [req-b2b2532a-29a5-4daf-b669-9e480cc227de req-300b7e3a-2c4d-4f8e-b97a-78940a7c4d8f service nova] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] No waiting events found dispatching network-vif-plugged-5316b921-a92e-4c0f-93df-873d035c4ed0 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:08:03 user nova-compute[74850]: WARNING nova.compute.manager [req-b2b2532a-29a5-4daf-b669-9e480cc227de req-300b7e3a-2c4d-4f8e-b97a-78940a7c4d8f service nova] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Received unexpected event network-vif-plugged-5316b921-a92e-4c0f-93df-873d035c4ed0 for instance with vm_state building and task_state spawning.
Nov 14 01:08:03 user nova-compute[74850]: INFO nova.compute.manager [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Took 6.59 seconds to build instance.
Nov 14 01:08:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6bc1cccc-34ef-4da1-99f4-5a108fc2e405 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.694s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:08:03 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:08:03 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:08:03 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:08:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:04 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:08:04 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 01:08:05 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:08:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:06 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:08:06 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:08:08 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:08:08 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 01:08:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "refresh_cache-3504ddd3-bdd8-465e-aec5-190acdd563f6" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:08:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquired lock "refresh_cache-3504ddd3-bdd8-465e-aec5-190acdd563f6" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:08:09 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Forcefully refreshing network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 01:08:09 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Updating instance_info_cache with network_info: [{"id": "8ac01677-8e6a-417b-b7a8-2fc5026404f9", "address": "fa:16:3e:2a:e3:16", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac01677-8e", "ovs_interfaceid": "8ac01677-8e6a-417b-b7a8-2fc5026404f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:08:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Releasing lock "refresh_cache-3504ddd3-bdd8-465e-aec5-190acdd563f6" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:08:09 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Updated the network info_cache for instance {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 01:08:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "ffaf0225-770f-4c7c-8fde-7aa258e5fc7c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:08:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "ffaf0225-770f-4c7c-8fde-7aa258e5fc7c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:08:16 user nova-compute[74850]: DEBUG nova.compute.manager [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 01:08:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:08:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:08:17 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 01:08:17 user nova-compute[74850]: INFO nova.compute.claims [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Claim successful on node user
Nov 14 01:08:17 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:08:17 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:08:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.377s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:08:17 user nova-compute[74850]: DEBUG nova.compute.manager [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 01:08:17 user nova-compute[74850]: DEBUG nova.compute.manager [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 01:08:17 user nova-compute[74850]: DEBUG nova.network.neutron [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 01:08:17 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 01:08:17 user nova-compute[74850]: DEBUG nova.compute.manager [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 01:08:17 user nova-compute[74850]: DEBUG nova.policy [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c91ddcee4e54a769eb626c816596bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb1eb4b5fc841d1952b8db9ae05e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 01:08:17 user nova-compute[74850]: INFO nova.virt.block_device [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Booting with volume 32e7343b-b42b-4d04-9c90-8a06c1cf98b8 at /dev/vda
Nov 14 01:08:17 user nova-compute[74850]: DEBUG os_brick.utils [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:08:17 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:17 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:17 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9daf3118-a6d5-4761-8c5b-5263b80457b6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:08:17 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:17 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:17 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c1c566-7db4-4fcf-8caa-78795584f174]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:08:17 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:17 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:17 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[412a0bd4-91bb-412a-892e-b7af7c85e205]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:08:17 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0787f4-27ff-4098-ae29-4448d8c93426]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:08:17 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:17 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:08:17 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 01:08:17 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:17 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:08:17 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 01:08:17 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3197c9d0-40cd-4e3b-84d1-619bfb809dd6]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:08:17 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 01:08:17 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 01:08:17 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 01:08:17 user nova-compute[74850]: DEBUG os_brick.utils [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:08:17 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Updating existing volume attachment record: 981189dd-ec31-47b7-8f03-7f510c0e99b5 {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 01:08:18 user nova-compute[74850]: DEBUG nova.network.neutron [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Successfully created port: 85fc032b-0133-484f-a7ae-35602c304d7c {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 01:08:18 user nova-compute[74850]: DEBUG nova.network.neutron [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Successfully updated port: 85fc032b-0133-484f-a7ae-35602c304d7c {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 01:08:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "refresh_cache-ffaf0225-770f-4c7c-8fde-7aa258e5fc7c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:08:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquired lock "refresh_cache-ffaf0225-770f-4c7c-8fde-7aa258e5fc7c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:08:18 user nova-compute[74850]: DEBUG nova.network.neutron [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 01:08:18 user nova-compute[74850]: DEBUG nova.compute.manager [req-0b5fd646-3d5f-4eb8-8538-f6720685ce7e req-6ca0a0b2-53f4-4608-9faf-11d68e4eaab0 service nova] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Received event network-changed-85fc032b-0133-484f-a7ae-35602c304d7c {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:08:18 user nova-compute[74850]: DEBUG nova.compute.manager [req-0b5fd646-3d5f-4eb8-8538-f6720685ce7e req-6ca0a0b2-53f4-4608-9faf-11d68e4eaab0 service nova] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Refreshing instance network info cache due to event network-changed-85fc032b-0133-484f-a7ae-35602c304d7c. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:08:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-0b5fd646-3d5f-4eb8-8538-f6720685ce7e req-6ca0a0b2-53f4-4608-9faf-11d68e4eaab0 service nova] Acquiring lock "refresh_cache-ffaf0225-770f-4c7c-8fde-7aa258e5fc7c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:08:18 user nova-compute[74850]: DEBUG nova.network.neutron [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 01:08:19 user nova-compute[74850]: DEBUG nova.network.neutron [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Updating instance_info_cache with network_info: [{"id": "85fc032b-0133-484f-a7ae-35602c304d7c", "address": "fa:16:3e:7f:c7:b6", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fc032b-01", "ovs_interfaceid": "85fc032b-0133-484f-a7ae-35602c304d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:08:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Releasing lock "refresh_cache-ffaf0225-770f-4c7c-8fde-7aa258e5fc7c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:08:19 user nova-compute[74850]: DEBUG nova.compute.manager [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Instance network_info: |[{"id": "85fc032b-0133-484f-a7ae-35602c304d7c", "address": "fa:16:3e:7f:c7:b6", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fc032b-01", "ovs_interfaceid": "85fc032b-0133-484f-a7ae-35602c304d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 01:08:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-0b5fd646-3d5f-4eb8-8538-f6720685ce7e req-6ca0a0b2-53f4-4608-9faf-11d68e4eaab0 service nova] Acquired lock "refresh_cache-ffaf0225-770f-4c7c-8fde-7aa258e5fc7c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:08:19 user nova-compute[74850]: DEBUG nova.network.neutron [req-0b5fd646-3d5f-4eb8-8538-f6720685ce7e req-6ca0a0b2-53f4-4608-9faf-11d68e4eaab0 service nova] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Refreshing network info cache for port 85fc032b-0133-484f-a7ae-35602c304d7c {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:08:19 user nova-compute[74850]: DEBUG nova.network.neutron [req-0b5fd646-3d5f-4eb8-8538-f6720685ce7e req-6ca0a0b2-53f4-4608-9faf-11d68e4eaab0 service nova] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Updated VIF entry in instance network info cache for port 85fc032b-0133-484f-a7ae-35602c304d7c. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:08:19 user nova-compute[74850]: DEBUG nova.network.neutron [req-0b5fd646-3d5f-4eb8-8538-f6720685ce7e req-6ca0a0b2-53f4-4608-9faf-11d68e4eaab0 service nova] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Updating instance_info_cache with network_info: [{"id": "85fc032b-0133-484f-a7ae-35602c304d7c", "address": "fa:16:3e:7f:c7:b6", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fc032b-01", "ovs_interfaceid": "85fc032b-0133-484f-a7ae-35602c304d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:08:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-0b5fd646-3d5f-4eb8-8538-f6720685ce7e req-6ca0a0b2-53f4-4608-9faf-11d68e4eaab0 service nova] Releasing lock "refresh_cache-ffaf0225-770f-4c7c-8fde-7aa258e5fc7c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:08:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:08:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:21 user nova-compute[74850]: DEBUG nova.compute.manager [req-409e3f1d-e2f4-4eb7-b1f9-02895de1762f req-8c2cca83-3fdb-46cf-8137-51911c231d4d service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Received event network-changed-5e053f78-6ef6-4f30-aedb-30306f10975b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:08:21 user nova-compute[74850]: DEBUG nova.compute.manager [req-409e3f1d-e2f4-4eb7-b1f9-02895de1762f req-8c2cca83-3fdb-46cf-8137-51911c231d4d service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Refreshing instance network info cache due to event network-changed-5e053f78-6ef6-4f30-aedb-30306f10975b. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:08:21 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-409e3f1d-e2f4-4eb7-b1f9-02895de1762f req-8c2cca83-3fdb-46cf-8137-51911c231d4d service nova] Acquiring lock "refresh_cache-efa96c60-9902-4ca9-8f0e-d27bdb883829" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:08:21 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-409e3f1d-e2f4-4eb7-b1f9-02895de1762f req-8c2cca83-3fdb-46cf-8137-51911c231d4d service nova] Acquired lock "refresh_cache-efa96c60-9902-4ca9-8f0e-d27bdb883829" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:08:21 user nova-compute[74850]: DEBUG nova.network.neutron [req-409e3f1d-e2f4-4eb7-b1f9-02895de1762f req-8c2cca83-3fdb-46cf-8137-51911c231d4d service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Refreshing network info cache for port 5e053f78-6ef6-4f30-aedb-30306f10975b {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:08:21 user nova-compute[74850]: DEBUG nova.network.neutron [req-409e3f1d-e2f4-4eb7-b1f9-02895de1762f req-8c2cca83-3fdb-46cf-8137-51911c231d4d service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Updated VIF entry in instance network info cache for port 5e053f78-6ef6-4f30-aedb-30306f10975b. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:08:21 user nova-compute[74850]: DEBUG nova.network.neutron [req-409e3f1d-e2f4-4eb7-b1f9-02895de1762f req-8c2cca83-3fdb-46cf-8137-51911c231d4d service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Updating instance_info_cache with network_info: [{"id": "5e053f78-6ef6-4f30-aedb-30306f10975b", "address": "fa:16:3e:fc:2e:f2", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e053f78-6e", "ovs_interfaceid": "5e053f78-6ef6-4f30-aedb-30306f10975b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:08:21 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-409e3f1d-e2f4-4eb7-b1f9-02895de1762f req-8c2cca83-3fdb-46cf-8137-51911c231d4d service nova] Releasing lock "refresh_cache-efa96c60-9902-4ca9-8f0e-d27bdb883829" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG nova.compute.manager [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 01:08:22 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Creating image(s)
Nov 14 01:08:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Did not create local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Ensure instance console log exists: /opt/stack/data/nova/instances/ffaf0225-770f-4c7c-8fde-7aa258e5fc7c/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Start _get_guest_xml network_info=[{"id": "85fc032b-0133-484f-a7ae-35602c304d7c", "address": "fa:16:3e:7f:c7:b6", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fc032b-01", "ovs_interfaceid": "85fc032b-0133-484f-a7ae-35602c304d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '981189dd-ec31-47b7-8f03-7f510c0e99b5', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'empAbWLq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ffaf0225-770f-4c7c-8fde-7aa258e5fc7c', 'attached_at': '', 'detached_at': '', 'volume_id': '32e7343b-b42b-4d04-9c90-8a06c1cf98b8', 'serial': '32e7343b-b42b-4d04-9c90-8a06c1cf98b8'}, 'volume_type': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 01:08:22 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:08:22 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:08:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'empAbWLq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:08:22 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:08:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:08:22 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:08:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:08:22 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 01:08:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ded8013-18ec-4bfb-b34d-e56d6818b1de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 01:08:22 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1d9ba5-8baf-481e-ac4c-c7b6689bde06]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8] added
Nov 14 01:08:22 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4ebfe5-f9f1-44a0-b0cd-f8d6aaa453ba]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b7afca-dc69-4b54-a150-612f0f0f96a5]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v empAbWLq {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v empAbWLq" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c4e404-8de3-4319-bb02-63076dbb9aea]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'empAbWLq'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6773a65e-a70f-4226-9a10-bcc913eb65e5]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5cefae-41a1-4f1f-a254-dccc02486ef6]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:08:22 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:08:22 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:08:22 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:08:22 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[886480b3-787c-4673-8b9e-12b34c8d73d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8, portal: 172.16.0.220,3260]
Nov 14 01:08:22 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8, portal: 172.16.0.220,3260] successful.
Nov 14 01:08:22 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c84294-efc4-457b-a3d9-760a8f1cf641]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20ad267-a5b0-460d-9ac7-a7c590efcca8]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:08:22 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:08:22 user nova-compute[74850]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:08:22 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:08:22 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:08:22 user nova-compute[74850]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:08:22 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda3b658-5fd8-4042-9980-0939edc5184a]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:08:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'empAbWLq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 01:08:23 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:08:23 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23939376431393364', 'path': '/dev/sdb'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:08:23 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939376431393364', 'path': '/dev/sdb'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 01:08:23 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:08:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-487679215',display_name='tempest-TestVolumeBootPattern-server-487679215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-487679215',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA94n5zD/7RpobhW+jYq5sAS9UK4izFU1jEjxsSgfhAiBUC2oNIUdSW107BwtkqMZ7Uku+sA2LquAPtuZM0gk2nZsUp6hWLP86Pz4tdmgGXQVoyyrGsrxeP25l2IFQWByQ==',key_name='tempest-TestVolumeBootPattern-543311029',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdb1eb4b5fc841d1952b8db9ae05e446',ramdisk_id='',reservation_id='r-25turqwd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1536334624',owner_user_name='tempest-TestVolumeBootPattern-1536334624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:08:18Z,user_data=None,user_id='6c91ddcee4e54a769eb626c816596bed',uuid=ffaf0225-770f-4c7c-8fde-7aa258e5fc7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85fc032b-0133-484f-a7ae-35602c304d7c", "address": "fa:16:3e:7f:c7:b6", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fc032b-01", "ovs_interfaceid": "85fc032b-0133-484f-a7ae-35602c304d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 01:08:23 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Converting VIF {"id": "85fc032b-0133-484f-a7ae-35602c304d7c", "address": "fa:16:3e:7f:c7:b6", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fc032b-01", "ovs_interfaceid": "85fc032b-0133-484f-a7ae-35602c304d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:08:23 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:c7:b6,bridge_name='br-int',has_traffic_filtering=True,id=85fc032b-0133-484f-a7ae-35602c304d7c,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85fc032b-01') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:08:23 user nova-compute[74850]: DEBUG nova.objects.instance [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lazy-loading 'pci_devices' on Instance uuid ffaf0225-770f-4c7c-8fde-7aa258e5fc7c {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:08:23 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 01:08:23 user nova-compute[74850]:   <uuid>ffaf0225-770f-4c7c-8fde-7aa258e5fc7c</uuid>
Nov 14 01:08:23 user nova-compute[74850]:   <name>instance-0000002d</name>
Nov 14 01:08:23 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 01:08:23 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 01:08:23 user nova-compute[74850]:   <metadata>
Nov 14 01:08:23 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 01:08:23 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 01:08:23 user nova-compute[74850]:       <nova:name>tempest-TestVolumeBootPattern-server-487679215</nova:name>
Nov 14 01:08:23 user nova-compute[74850]:       <nova:creationTime>2023-11-14 01:08:22</nova:creationTime>
Nov 14 01:08:23 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 01:08:23 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 01:08:23 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 01:08:23 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 01:08:23 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 01:08:23 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 01:08:23 user nova-compute[74850]:       </nova:flavor>
Nov 14 01:08:23 user nova-compute[74850]:       <nova:owner>
Nov 14 01:08:23 user nova-compute[74850]:         <nova:user uuid="6c91ddcee4e54a769eb626c816596bed">tempest-TestVolumeBootPattern-1536334624-project-member</nova:user>
Nov 14 01:08:23 user nova-compute[74850]:         <nova:project uuid="fdb1eb4b5fc841d1952b8db9ae05e446">tempest-TestVolumeBootPattern-1536334624</nova:project>
Nov 14 01:08:23 user nova-compute[74850]:       </nova:owner>
Nov 14 01:08:23 user nova-compute[74850]:       <nova:ports>
Nov 14 01:08:23 user nova-compute[74850]:         <nova:port uuid="85fc032b-0133-484f-a7ae-35602c304d7c">
Nov 14 01:08:23 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 01:08:23 user nova-compute[74850]:         </nova:port>
Nov 14 01:08:23 user nova-compute[74850]:       </nova:ports>
Nov 14 01:08:23 user nova-compute[74850]:     </nova:instance>
Nov 14 01:08:23 user nova-compute[74850]:   </metadata>
Nov 14 01:08:23 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 01:08:23 user nova-compute[74850]:     <system>
Nov 14 01:08:23 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 01:08:23 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 01:08:23 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 01:08:23 user nova-compute[74850]:       <entry name="serial">ffaf0225-770f-4c7c-8fde-7aa258e5fc7c</entry>
Nov 14 01:08:23 user nova-compute[74850]:       <entry name="uuid">ffaf0225-770f-4c7c-8fde-7aa258e5fc7c</entry>
Nov 14 01:08:23 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 01:08:23 user nova-compute[74850]:     </system>
Nov 14 01:08:23 user nova-compute[74850]:   </sysinfo>
Nov 14 01:08:23 user nova-compute[74850]:   <os>
Nov 14 01:08:23 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 01:08:23 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 01:08:23 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 01:08:23 user nova-compute[74850]:   </os>
Nov 14 01:08:23 user nova-compute[74850]:   <features>
Nov 14 01:08:23 user nova-compute[74850]:     <acpi/>
Nov 14 01:08:23 user nova-compute[74850]:     <apic/>
Nov 14 01:08:23 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 01:08:23 user nova-compute[74850]:   </features>
Nov 14 01:08:23 user nova-compute[74850]:   <clock offset="utc">
Nov 14 01:08:23 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 01:08:23 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 01:08:23 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 01:08:23 user nova-compute[74850]:   </clock>
Nov 14 01:08:23 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 01:08:23 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 01:08:23 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 01:08:23 user nova-compute[74850]:   </cpu>
Nov 14 01:08:23 user nova-compute[74850]:   <devices>
Nov 14 01:08:23 user nova-compute[74850]:     <disk type="block" device="disk">
Nov 14 01:08:23 user nova-compute[74850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:08:23 user nova-compute[74850]:       <source dev="/dev/sdb"/>
Nov 14 01:08:23 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 01:08:23 user nova-compute[74850]:       <serial>32e7343b-b42b-4d04-9c90-8a06c1cf98b8</serial>
Nov 14 01:08:23 user nova-compute[74850]:     </disk>
Nov 14 01:08:23 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 01:08:23 user nova-compute[74850]:       <mac address="fa:16:3e:7f:c7:b6"/>
Nov 14 01:08:23 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:08:23 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 01:08:23 user nova-compute[74850]:       <target dev="tap85fc032b-01"/>
Nov 14 01:08:23 user nova-compute[74850]:     </interface>
Nov 14 01:08:23 user nova-compute[74850]:     <serial type="pty">
Nov 14 01:08:23 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/ffaf0225-770f-4c7c-8fde-7aa258e5fc7c/console.log" append="off"/>
Nov 14 01:08:23 user nova-compute[74850]:     </serial>
Nov 14 01:08:23 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 01:08:23 user nova-compute[74850]:     <video>
Nov 14 01:08:23 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:08:23 user nova-compute[74850]:     </video>
Nov 14 01:08:23 user nova-compute[74850]:     <rng model="virtio">
Nov 14 01:08:23 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 01:08:23 user nova-compute[74850]:     </rng>
Nov 14 01:08:23 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 01:08:23 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 01:08:23 user nova-compute[74850]:       <stats period="10"/>
Nov 14 01:08:23 user nova-compute[74850]:     </memballoon>
Nov 14 01:08:23 user nova-compute[74850]:   </devices>
Nov 14 01:08:23 user nova-compute[74850]: </domain>
Nov 14 01:08:23 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 01:08:23 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:08:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-487679215',display_name='tempest-TestVolumeBootPattern-server-487679215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-487679215',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA94n5zD/7RpobhW+jYq5sAS9UK4izFU1jEjxsSgfhAiBUC2oNIUdSW107BwtkqMZ7Uku+sA2LquAPtuZM0gk2nZsUp6hWLP86Pz4tdmgGXQVoyyrGsrxeP25l2IFQWByQ==',key_name='tempest-TestVolumeBootPattern-543311029',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdb1eb4b5fc841d1952b8db9ae05e446',ramdisk_id='',reservation_id='r-25turqwd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1536334624',owner_user_name='tempest-TestVolumeBootPattern-1536334624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:08:18Z,user_data=None,user_id='6c91ddcee4e54a769eb626c816596bed',uuid=ffaf0225-770f-4c7c-8fde-7aa258e5fc7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85fc032b-0133-484f-a7ae-35602c304d7c", "address": "fa:16:3e:7f:c7:b6", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fc032b-01", "ovs_interfaceid": "85fc032b-0133-484f-a7ae-35602c304d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 01:08:23 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Converting VIF {"id": "85fc032b-0133-484f-a7ae-35602c304d7c", "address": "fa:16:3e:7f:c7:b6", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fc032b-01", "ovs_interfaceid": "85fc032b-0133-484f-a7ae-35602c304d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:08:23 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:c7:b6,bridge_name='br-int',has_traffic_filtering=True,id=85fc032b-0133-484f-a7ae-35602c304d7c,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85fc032b-01') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:08:23 user nova-compute[74850]: DEBUG os_vif [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:c7:b6,bridge_name='br-int',has_traffic_filtering=True,id=85fc032b-0133-484f-a7ae-35602c304d7c,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85fc032b-01') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 01:08:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:08:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 01:08:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0118dc5d-2e3e-5cb9-8d73-c1f5464928a5', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:08:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85fc032b-01, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:08:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85fc032b-01, col_values=(('qos', UUID('0703443a-8427-4c1b-9b0a-936b23d51eb4')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:08:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85fc032b-01, col_values=(('external_ids', {'iface-id': '85fc032b-0133-484f-a7ae-35602c304d7c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:c7:b6', 'vm-uuid': 'ffaf0225-770f-4c7c-8fde-7aa258e5fc7c'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:08:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:08:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:23 user nova-compute[74850]: INFO os_vif [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:c7:b6,bridge_name='br-int',has_traffic_filtering=True,id=85fc032b-0133-484f-a7ae-35602c304d7c,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85fc032b-01')
Nov 14 01:08:23 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:08:23 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] No VIF found with MAC fa:16:3e:7f:c7:b6, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:08:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-782fd315-3500-40df-9d7d-a932ee8c00ff tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "efa96c60-9902-4ca9-8f0e-d27bdb883829" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:08:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-782fd315-3500-40df-9d7d-a932ee8c00ff tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "efa96c60-9902-4ca9-8f0e-d27bdb883829" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:08:23 user nova-compute[74850]: INFO nova.compute.manager [None req-782fd315-3500-40df-9d7d-a932ee8c00ff tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Shelving
Nov 14 01:08:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:24 user nova-compute[74850]: DEBUG nova.compute.manager [req-c31dbae8-47a4-457f-b869-5e2a0a0595c8 req-d8bc5405-d059-4a36-8993-6efe01855240 service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Received event network-vif-unplugged-5e053f78-6ef6-4f30-aedb-30306f10975b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:08:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c31dbae8-47a4-457f-b869-5e2a0a0595c8 req-d8bc5405-d059-4a36-8993-6efe01855240 service nova] Acquiring lock "efa96c60-9902-4ca9-8f0e-d27bdb883829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:08:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c31dbae8-47a4-457f-b869-5e2a0a0595c8 req-d8bc5405-d059-4a36-8993-6efe01855240 service nova] Lock "efa96c60-9902-4ca9-8f0e-d27bdb883829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:08:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c31dbae8-47a4-457f-b869-5e2a0a0595c8 req-d8bc5405-d059-4a36-8993-6efe01855240 service nova] Lock "efa96c60-9902-4ca9-8f0e-d27bdb883829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:08:24 user nova-compute[74850]: DEBUG nova.compute.manager [req-c31dbae8-47a4-457f-b869-5e2a0a0595c8 req-d8bc5405-d059-4a36-8993-6efe01855240 service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] No waiting events found dispatching network-vif-unplugged-5e053f78-6ef6-4f30-aedb-30306f10975b {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:08:24 user nova-compute[74850]: WARNING nova.compute.manager [req-c31dbae8-47a4-457f-b869-5e2a0a0595c8 req-d8bc5405-d059-4a36-8993-6efe01855240 service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Received unexpected event network-vif-unplugged-5e053f78-6ef6-4f30-aedb-30306f10975b for instance with vm_state active and task_state shelving.
Nov 14 01:08:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:25 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Instance destroyed successfully.
Nov 14 01:08:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:25 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-782fd315-3500-40df-9d7d-a932ee8c00ff tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Beginning cold snapshot process
Nov 14 01:08:25 user nova-compute[74850]: DEBUG nova.privsep.utils [None req-782fd315-3500-40df-9d7d-a932ee8c00ff tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74850) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 01:08:25 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-782fd315-3500-40df-9d7d-a932ee8c00ff tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/disk /opt/stack/data/nova/instances/snapshots/tmpcifrx6rl/a0a0d48698b946029e85bcc4f51de98a {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:25 user nova-compute[74850]: DEBUG nova.compute.manager [req-9e42cad6-7ca7-4a9a-bf49-bee09dafa5c9 req-84c1dc4a-0986-46c5-ae34-66063f2764e2 service nova] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Received event network-vif-plugged-85fc032b-0133-484f-a7ae-35602c304d7c {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:08:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9e42cad6-7ca7-4a9a-bf49-bee09dafa5c9 req-84c1dc4a-0986-46c5-ae34-66063f2764e2 service nova] Acquiring lock "ffaf0225-770f-4c7c-8fde-7aa258e5fc7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:08:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9e42cad6-7ca7-4a9a-bf49-bee09dafa5c9 req-84c1dc4a-0986-46c5-ae34-66063f2764e2 service nova] Lock "ffaf0225-770f-4c7c-8fde-7aa258e5fc7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:08:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9e42cad6-7ca7-4a9a-bf49-bee09dafa5c9 req-84c1dc4a-0986-46c5-ae34-66063f2764e2 service nova] Lock "ffaf0225-770f-4c7c-8fde-7aa258e5fc7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:08:25 user nova-compute[74850]: DEBUG nova.compute.manager [req-9e42cad6-7ca7-4a9a-bf49-bee09dafa5c9 req-84c1dc4a-0986-46c5-ae34-66063f2764e2 service nova] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] No waiting events found dispatching network-vif-plugged-85fc032b-0133-484f-a7ae-35602c304d7c {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:08:25 user nova-compute[74850]: WARNING nova.compute.manager [req-9e42cad6-7ca7-4a9a-bf49-bee09dafa5c9 req-84c1dc4a-0986-46c5-ae34-66063f2764e2 service nova] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Received unexpected event network-vif-plugged-85fc032b-0133-484f-a7ae-35602c304d7c for instance with vm_state building and task_state spawning.
Nov 14 01:08:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Acquiring lock "2294e4d8-7e62-4875-822f-bc9020721881" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:08:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "2294e4d8-7e62-4875-822f-bc9020721881" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:08:25 user nova-compute[74850]: DEBUG nova.objects.instance [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lazy-loading 'flavor' on Instance uuid 2294e4d8-7e62-4875-822f-bc9020721881 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:08:25 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Ignoring supplied device name: /dev/vdb
Nov 14 01:08:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "2294e4d8-7e62-4875-822f-bc9020721881" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:08:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:26 user nova-compute[74850]: DEBUG nova.compute.manager [req-3a57591a-d7c8-455f-a33e-716e2808aa56 req-55b5c946-75a2-4f49-8576-893555d113ec service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Received event network-vif-plugged-5e053f78-6ef6-4f30-aedb-30306f10975b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:08:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3a57591a-d7c8-455f-a33e-716e2808aa56 req-55b5c946-75a2-4f49-8576-893555d113ec service nova] Acquiring lock "efa96c60-9902-4ca9-8f0e-d27bdb883829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:08:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3a57591a-d7c8-455f-a33e-716e2808aa56 req-55b5c946-75a2-4f49-8576-893555d113ec service nova] Lock "efa96c60-9902-4ca9-8f0e-d27bdb883829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:08:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3a57591a-d7c8-455f-a33e-716e2808aa56 req-55b5c946-75a2-4f49-8576-893555d113ec service nova] Lock "efa96c60-9902-4ca9-8f0e-d27bdb883829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:08:26 user nova-compute[74850]: DEBUG nova.compute.manager [req-3a57591a-d7c8-455f-a33e-716e2808aa56 req-55b5c946-75a2-4f49-8576-893555d113ec service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] No waiting events found dispatching network-vif-plugged-5e053f78-6ef6-4f30-aedb-30306f10975b {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:08:26 user nova-compute[74850]: WARNING nova.compute.manager [req-3a57591a-d7c8-455f-a33e-716e2808aa56 req-55b5c946-75a2-4f49-8576-893555d113ec service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Received unexpected event network-vif-plugged-5e053f78-6ef6-4f30-aedb-30306f10975b for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 14 01:08:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-782fd315-3500-40df-9d7d-a932ee8c00ff tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/disk /opt/stack/data/nova/instances/snapshots/tmpcifrx6rl/a0a0d48698b946029e85bcc4f51de98a" returned: 0 in 0.817s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:26 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-782fd315-3500-40df-9d7d-a932ee8c00ff tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Snapshot extracted, beginning image upload
Nov 14 01:08:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Acquiring lock "2294e4d8-7e62-4875-822f-bc9020721881" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:08:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "2294e4d8-7e62-4875-822f-bc9020721881" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:08:26 user nova-compute[74850]: INFO nova.compute.manager [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Attaching volume e46c234a-e963-4708-a493-79b0b4a8534d to /dev/vdb
Nov 14 01:08:26 user nova-compute[74850]: DEBUG os_brick.utils [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:08:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:26 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c50d16-93eb-401e-abec-1703328ce07e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:08:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:26 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60c07c0-72a0-4438-bd3f-e1c67abcda85]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:08:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:26 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4327ac-2ede-4220-b310-a39eafd5cdcf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:08:26 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d82256f-d42c-4a46-b800-95478f126d6d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:08:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:08:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 01:08:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:26 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:08:26 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 01:08:26 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fba84df-2e13-480a-8665-e4f345dfedf3]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:08:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 01:08:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 01:08:26 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 01:08:26 user nova-compute[74850]: DEBUG os_brick.utils [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:08:26 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Updating existing volume attachment record: a1d2abe0-1f66-4d58-bf00-c6eb68909caf {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 01:08:27 user nova-compute[74850]: DEBUG nova.compute.manager [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 01:08:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 01:08:27 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Instance spawned successfully.
Nov 14 01:08:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 01:08:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:08:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:08:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:08:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:08:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:08:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:08:27 user nova-compute[74850]: DEBUG nova.compute.manager [req-2fa10661-3de1-40a7-9eb2-0b169e90dcae req-bdcd3cdf-462e-4bea-98b9-e5e8b30905cf service nova] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Received event network-changed-2822a7a1-9ee8-4cf0-8019-d6910111297a {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:08:27 user nova-compute[74850]: DEBUG nova.compute.manager [req-2fa10661-3de1-40a7-9eb2-0b169e90dcae req-bdcd3cdf-462e-4bea-98b9-e5e8b30905cf service nova] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Refreshing instance network info cache due to event network-changed-2822a7a1-9ee8-4cf0-8019-d6910111297a. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:08:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-2fa10661-3de1-40a7-9eb2-0b169e90dcae req-bdcd3cdf-462e-4bea-98b9-e5e8b30905cf service nova] Acquiring lock "refresh_cache-2294e4d8-7e62-4875-822f-bc9020721881" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:08:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-2fa10661-3de1-40a7-9eb2-0b169e90dcae req-bdcd3cdf-462e-4bea-98b9-e5e8b30905cf service nova] Acquired lock "refresh_cache-2294e4d8-7e62-4875-822f-bc9020721881" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:08:27 user nova-compute[74850]: DEBUG nova.network.neutron [req-2fa10661-3de1-40a7-9eb2-0b169e90dcae req-bdcd3cdf-462e-4bea-98b9-e5e8b30905cf service nova] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Refreshing network info cache for port 2822a7a1-9ee8-4cf0-8019-d6910111297a {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:08:27 user nova-compute[74850]: INFO nova.compute.manager [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Took 5.39 seconds to spawn the instance on the hypervisor.
Nov 14 01:08:27 user nova-compute[74850]: DEBUG nova.compute.manager [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 01:08:27 user nova-compute[74850]: INFO nova.compute.manager [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Took 10.61 seconds to build instance.
Nov 14 01:08:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2740f14a-41fb-42b3-8703-d172d9d60c68 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "ffaf0225-770f-4c7c-8fde-7aa258e5fc7c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.709s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:08:27 user nova-compute[74850]: DEBUG nova.network.neutron [req-2fa10661-3de1-40a7-9eb2-0b169e90dcae req-bdcd3cdf-462e-4bea-98b9-e5e8b30905cf service nova] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Updated VIF entry in instance network info cache for port 2822a7a1-9ee8-4cf0-8019-d6910111297a. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:08:27 user nova-compute[74850]: DEBUG nova.network.neutron [req-2fa10661-3de1-40a7-9eb2-0b169e90dcae req-bdcd3cdf-462e-4bea-98b9-e5e8b30905cf service nova] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Updating instance_info_cache with network_info: [{"id": "2822a7a1-9ee8-4cf0-8019-d6910111297a", "address": "fa:16:3e:8f:6d:ed", "network": {"id": "e822a969-afbd-4415-a246-324f9b0c98ce", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1543025211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84022f7a63234abba05ae4e88035fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2822a7a1-9e", "ovs_interfaceid": "2822a7a1-9ee8-4cf0-8019-d6910111297a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:08:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-2fa10661-3de1-40a7-9eb2-0b169e90dcae req-bdcd3cdf-462e-4bea-98b9-e5e8b30905cf service nova] Releasing lock "refresh_cache-2294e4d8-7e62-4875-822f-bc9020721881" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:08:27 user nova-compute[74850]: DEBUG nova.compute.manager [req-2fa10661-3de1-40a7-9eb2-0b169e90dcae req-bdcd3cdf-462e-4bea-98b9-e5e8b30905cf service nova] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Received event network-vif-plugged-85fc032b-0133-484f-a7ae-35602c304d7c {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:08:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-2fa10661-3de1-40a7-9eb2-0b169e90dcae req-bdcd3cdf-462e-4bea-98b9-e5e8b30905cf service nova] Acquiring lock "ffaf0225-770f-4c7c-8fde-7aa258e5fc7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:08:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-2fa10661-3de1-40a7-9eb2-0b169e90dcae req-bdcd3cdf-462e-4bea-98b9-e5e8b30905cf service nova] Lock "ffaf0225-770f-4c7c-8fde-7aa258e5fc7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:08:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-2fa10661-3de1-40a7-9eb2-0b169e90dcae req-bdcd3cdf-462e-4bea-98b9-e5e8b30905cf service nova] Lock "ffaf0225-770f-4c7c-8fde-7aa258e5fc7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:08:27 user nova-compute[74850]: DEBUG nova.compute.manager [req-2fa10661-3de1-40a7-9eb2-0b169e90dcae req-bdcd3cdf-462e-4bea-98b9-e5e8b30905cf service nova] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] No waiting events found dispatching network-vif-plugged-85fc032b-0133-484f-a7ae-35602c304d7c {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:08:27 user nova-compute[74850]: WARNING nova.compute.manager [req-2fa10661-3de1-40a7-9eb2-0b169e90dcae req-bdcd3cdf-462e-4bea-98b9-e5e8b30905cf service nova] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Received unexpected event network-vif-plugged-85fc032b-0133-484f-a7ae-35602c304d7c for instance with vm_state building and task_state spawning.
Nov 14 01:08:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:28 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-782fd315-3500-40df-9d7d-a932ee8c00ff tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Snapshot image upload complete
Nov 14 01:08:28 user nova-compute[74850]: DEBUG nova.compute.manager [None req-782fd315-3500-40df-9d7d-a932ee8c00ff tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 01:08:28 user nova-compute[74850]: INFO nova.compute.manager [None req-782fd315-3500-40df-9d7d-a932ee8c00ff tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Shelve offloading
Nov 14 01:08:28 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Instance destroyed successfully.
Nov 14 01:08:28 user nova-compute[74850]: DEBUG nova.compute.manager [None req-782fd315-3500-40df-9d7d-a932ee8c00ff tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 01:08:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-782fd315-3500-40df-9d7d-a932ee8c00ff tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "refresh_cache-efa96c60-9902-4ca9-8f0e-d27bdb883829" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:08:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-782fd315-3500-40df-9d7d-a932ee8c00ff tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquired lock "refresh_cache-efa96c60-9902-4ca9-8f0e-d27bdb883829" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:08:28 user nova-compute[74850]: DEBUG nova.network.neutron [None req-782fd315-3500-40df-9d7d-a932ee8c00ff tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 01:08:29 user nova-compute[74850]: DEBUG nova.network.neutron [None req-782fd315-3500-40df-9d7d-a932ee8c00ff tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Updating instance_info_cache with network_info: [{"id": "5e053f78-6ef6-4f30-aedb-30306f10975b", "address": "fa:16:3e:fc:2e:f2", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e053f78-6e", "ovs_interfaceid": "5e053f78-6ef6-4f30-aedb-30306f10975b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:08:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-782fd315-3500-40df-9d7d-a932ee8c00ff tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Releasing lock "refresh_cache-efa96c60-9902-4ca9-8f0e-d27bdb883829" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:08:29 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Instance destroyed successfully.
Nov 14 01:08:29 user nova-compute[74850]: DEBUG nova.objects.instance [None req-782fd315-3500-40df-9d7d-a932ee8c00ff tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lazy-loading 'resources' on Instance uuid efa96c60-9902-4ca9-8f0e-d27bdb883829 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:08:29 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-782fd315-3500-40df-9d7d-a932ee8c00ff tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:06:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-133275307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-133275307',id=42,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg2H30iyGq6swB2GrSqVRe5DtzdlWmt0jQC0U9I+/EN3haXyWHelTuvYsSUnUJrIukK4ZeGdNI+eYhTEQ/ZgDVAkbq+5RP8TRJqgY4+Kj2EGhPN8Eb7+ExDQLVf3Qgg+g==',key_name='tempest-keypair-1001532645',keypairs=<?>,launch_index=0,launched_at=2023-11-14T01:06:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e396f5de82e54abfa812bf8a7e89b0c4',ramdisk_id='',reservation_id='r-gpaxa90f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-270753956',owner_user_name='tempest-AttachVolumeShelveTestJSON-270753956-project-member',shelved_at='2023-11-14T01:08:28.655972',shelved_host='user',shelved_image_id='3affc2ae-0eb0-415e-ae25-970cfd84dca7'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T01:08:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe8332d8221a49db86a402c5851b4882',uuid=efa96c60-9902-4ca9-8f0e-d27bdb883829,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "5e053f78-6ef6-4f30-aedb-30306f10975b", "address": "fa:16:3e:fc:2e:f2", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e053f78-6e", "ovs_interfaceid": "5e053f78-6ef6-4f30-aedb-30306f10975b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 01:08:29 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-782fd315-3500-40df-9d7d-a932ee8c00ff tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Converting VIF {"id": "5e053f78-6ef6-4f30-aedb-30306f10975b", "address": "fa:16:3e:fc:2e:f2", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e053f78-6e", "ovs_interfaceid": "5e053f78-6ef6-4f30-aedb-30306f10975b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:08:29 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-782fd315-3500-40df-9d7d-a932ee8c00ff tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:2e:f2,bridge_name='br-int',has_traffic_filtering=True,id=5e053f78-6ef6-4f30-aedb-30306f10975b,network=Network(dfd22096-9f0c-4e0f-aac4-06c224b5b9f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e053f78-6e') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:08:29 user nova-compute[74850]: DEBUG os_vif [None req-782fd315-3500-40df-9d7d-a932ee8c00ff tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:2e:f2,bridge_name='br-int',has_traffic_filtering=True,id=5e053f78-6ef6-4f30-aedb-30306f10975b,network=Network(dfd22096-9f0c-4e0f-aac4-06c224b5b9f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e053f78-6e') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 01:08:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e053f78-6e, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:08:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:29 user nova-compute[74850]: DEBUG nova.compute.manager [req-9d0630b6-bfb4-4219-b3e0-7563ed0d919c req-145aa17c-c1e8-4efe-bba2-bf487f318a6f service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Received event network-changed-5e053f78-6ef6-4f30-aedb-30306f10975b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:08:29 user nova-compute[74850]: DEBUG nova.compute.manager [req-9d0630b6-bfb4-4219-b3e0-7563ed0d919c req-145aa17c-c1e8-4efe-bba2-bf487f318a6f service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Refreshing instance network info cache due to event network-changed-5e053f78-6ef6-4f30-aedb-30306f10975b. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:08:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9d0630b6-bfb4-4219-b3e0-7563ed0d919c req-145aa17c-c1e8-4efe-bba2-bf487f318a6f service nova] Acquiring lock "refresh_cache-efa96c60-9902-4ca9-8f0e-d27bdb883829" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:08:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9d0630b6-bfb4-4219-b3e0-7563ed0d919c req-145aa17c-c1e8-4efe-bba2-bf487f318a6f service nova] Acquired lock "refresh_cache-efa96c60-9902-4ca9-8f0e-d27bdb883829" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:08:29 user nova-compute[74850]: DEBUG nova.network.neutron [req-9d0630b6-bfb4-4219-b3e0-7563ed0d919c req-145aa17c-c1e8-4efe-bba2-bf487f318a6f service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Refreshing network info cache for port 5e053f78-6ef6-4f30-aedb-30306f10975b {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:08:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:08:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aac2ce21-fa64-48ac-a809-ead36e5b75ed) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:08:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:08:29 user nova-compute[74850]: INFO os_vif [None req-782fd315-3500-40df-9d7d-a932ee8c00ff tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:2e:f2,bridge_name='br-int',has_traffic_filtering=True,id=5e053f78-6ef6-4f30-aedb-30306f10975b,network=Network(dfd22096-9f0c-4e0f-aac4-06c224b5b9f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e053f78-6e')
Nov 14 01:08:29 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-782fd315-3500-40df-9d7d-a932ee8c00ff tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Deleting instance files /opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829_del
Nov 14 01:08:29 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-782fd315-3500-40df-9d7d-a932ee8c00ff tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Deletion of /opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829_del complete
Nov 14 01:08:29 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-782fd315-3500-40df-9d7d-a932ee8c00ff tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Deleted allocations for instance efa96c60-9902-4ca9-8f0e-d27bdb883829
Nov 14 01:08:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-782fd315-3500-40df-9d7d-a932ee8c00ff tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:08:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-782fd315-3500-40df-9d7d-a932ee8c00ff tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:08:29 user nova-compute[74850]: DEBUG nova.objects.instance [None req-782fd315-3500-40df-9d7d-a932ee8c00ff tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lazy-loading 'numa_topology' on Instance uuid efa96c60-9902-4ca9-8f0e-d27bdb883829 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:08:29 user nova-compute[74850]: DEBUG nova.objects.base [None req-782fd315-3500-40df-9d7d-a932ee8c00ff tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Object Instance<efa96c60-9902-4ca9-8f0e-d27bdb883829> lazy-loaded attributes: resources,numa_topology {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 01:08:30 user nova-compute[74850]: DEBUG nova.network.neutron [req-9d0630b6-bfb4-4219-b3e0-7563ed0d919c req-145aa17c-c1e8-4efe-bba2-bf487f318a6f service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Updated VIF entry in instance network info cache for port 5e053f78-6ef6-4f30-aedb-30306f10975b. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:08:30 user nova-compute[74850]: DEBUG nova.network.neutron [req-9d0630b6-bfb4-4219-b3e0-7563ed0d919c req-145aa17c-c1e8-4efe-bba2-bf487f318a6f service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Updating instance_info_cache with network_info: [{"id": "5e053f78-6ef6-4f30-aedb-30306f10975b", "address": "fa:16:3e:fc:2e:f2", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap5e053f78-6e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:08:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9d0630b6-bfb4-4219-b3e0-7563ed0d919c req-145aa17c-c1e8-4efe-bba2-bf487f318a6f service nova] Releasing lock "refresh_cache-efa96c60-9902-4ca9-8f0e-d27bdb883829" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:08:30 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-782fd315-3500-40df-9d7d-a932ee8c00ff tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:08:30 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-782fd315-3500-40df-9d7d-a932ee8c00ff tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:08:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-782fd315-3500-40df-9d7d-a932ee8c00ff tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:08:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-782fd315-3500-40df-9d7d-a932ee8c00ff tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "efa96c60-9902-4ca9-8f0e-d27bdb883829" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.534s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:08:30 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 01:08:30 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PzJyvIpW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:08:30 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:08:30 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:08:30 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:08:30 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:08:30 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:08:30 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:08:30 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 01:08:30 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:30 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:30 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d12e9c-2dea-4ffb-ad75-03d6d4c07d6d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:08:30 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 01:08:30 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:08:30 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:30 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:30 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1872bb91-d7d2-413a-a8af-a34192b33f19]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:08:30 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d] added
Nov 14 01:08:30 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:08:30 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:30 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:30 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b49f321-1539-41f4-b1b4-37bc5f6ab3c3]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:08:30 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:08:30 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:30 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:30 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08e6ad1-62b2-4e93-801d-f5c53f574447]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:08:30 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:08:30 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PzJyvIpW {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:30 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PzJyvIpW" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:30 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[236794fb-5a35-4a9f-a8b7-a7cdba3fb03b]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:08:30 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PzJyvIpW'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:08:30 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:30 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:30 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27e2501-4bd5-4d3c-8607-d195de381d4f]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:08:30 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:08:30 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:31 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcf68e9-ba79-47a1-9f9d-933c934aa3d3]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:08:31 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:08:31 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:08:31 user nova-compute[74850]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:08:31 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:08:31 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:08:31 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:08:31 user nova-compute[74850]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:08:31 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:08:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:31 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bee3dfb-970b-4e8c-abde-9b22e13498b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:08:31 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d, portal: 172.16.0.220,3260]
Nov 14 01:08:31 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d, portal: 172.16.0.220,3260] successful.
Nov 14 01:08:31 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:08:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:31 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[348089b8-cb54-49fd-9409-5fce643d1670]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:08:31 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:08:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:31 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b89c49f-b10c-4c19-aa2f-b808275d887a]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:08:31 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:08:31 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:08:31 user nova-compute[74850]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:08:31 user nova-compute[74850]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d (non-flash)
Nov 14 01:08:31 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:08:31 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:08:31 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:08:31 user nova-compute[74850]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:08:31 user nova-compute[74850]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d (non-flash)
Nov 14 01:08:31 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:08:31 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:08:31 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 01:08:31 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 01:08:31 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 01:08:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:31 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b269a14-0ef2-43b3-8e52-bc6804dfe6f5]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:08:31 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: None {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:08:32 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:08:32 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PzJyvIpW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 01:08:32 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:08:32 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23431356439653832', 'path': '/dev/sdc'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:08:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431356439653832', 'path': '/dev/sdc'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 01:08:32 user nova-compute[74850]: DEBUG nova.objects.instance [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lazy-loading 'flavor' on Instance uuid 2294e4d8-7e62-4875-822f-bc9020721881 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:08:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 01:08:32 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:08:32 user nova-compute[74850]:   <source dev="/dev/sdc"/>
Nov 14 01:08:32 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:08:32 user nova-compute[74850]:   <serial>e46c234a-e963-4708-a493-79b0b4a8534d</serial>
Nov 14 01:08:32 user nova-compute[74850]: </disk>
Nov 14 01:08:32 user nova-compute[74850]:  {{(pid=74850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 01:08:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:08:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:08:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] No VIF found with MAC fa:16:3e:8f:6d:ed, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:08:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c502daa2-9fff-43ac-8778-beffe81840b2 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "2294e4d8-7e62-4875-822f-bc9020721881" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.554s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:08:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-457c52b2-e484-44cd-8f95-c21b39ada3d7 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "748d0da7-bbb9-4e86-aae3-e48b1fa04c14" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:08:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-457c52b2-e484-44cd-8f95-c21b39ada3d7 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "748d0da7-bbb9-4e86-aae3-e48b1fa04c14" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:08:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-457c52b2-e484-44cd-8f95-c21b39ada3d7 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "748d0da7-bbb9-4e86-aae3-e48b1fa04c14-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:08:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-457c52b2-e484-44cd-8f95-c21b39ada3d7 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "748d0da7-bbb9-4e86-aae3-e48b1fa04c14-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:08:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-457c52b2-e484-44cd-8f95-c21b39ada3d7 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "748d0da7-bbb9-4e86-aae3-e48b1fa04c14-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:08:37 user nova-compute[74850]: INFO nova.compute.manager [None req-457c52b2-e484-44cd-8f95-c21b39ada3d7 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Terminating instance
Nov 14 01:08:37 user nova-compute[74850]: DEBUG nova.compute.manager [None req-457c52b2-e484-44cd-8f95-c21b39ada3d7 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 01:08:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:37 user nova-compute[74850]: DEBUG nova.compute.manager [req-fe961d3d-3b12-4869-9d78-5d5a09c171fc req-d37297b5-c2ac-499f-968a-215d220e31ba service nova] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Received event network-vif-unplugged-11d8d21f-e53e-4277-a1d1-36e99c3bcd62 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:08:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fe961d3d-3b12-4869-9d78-5d5a09c171fc req-d37297b5-c2ac-499f-968a-215d220e31ba service nova] Acquiring lock "748d0da7-bbb9-4e86-aae3-e48b1fa04c14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:08:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fe961d3d-3b12-4869-9d78-5d5a09c171fc req-d37297b5-c2ac-499f-968a-215d220e31ba service nova] Lock "748d0da7-bbb9-4e86-aae3-e48b1fa04c14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:08:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fe961d3d-3b12-4869-9d78-5d5a09c171fc req-d37297b5-c2ac-499f-968a-215d220e31ba service nova] Lock "748d0da7-bbb9-4e86-aae3-e48b1fa04c14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:08:37 user nova-compute[74850]: DEBUG nova.compute.manager [req-fe961d3d-3b12-4869-9d78-5d5a09c171fc req-d37297b5-c2ac-499f-968a-215d220e31ba service nova] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] No waiting events found dispatching network-vif-unplugged-11d8d21f-e53e-4277-a1d1-36e99c3bcd62 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:08:37 user nova-compute[74850]: DEBUG nova.compute.manager [req-fe961d3d-3b12-4869-9d78-5d5a09c171fc req-d37297b5-c2ac-499f-968a-215d220e31ba service nova] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Received event network-vif-unplugged-11d8d21f-e53e-4277-a1d1-36e99c3bcd62 for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 01:08:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:37 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Instance destroyed successfully.
Nov 14 01:08:37 user nova-compute[74850]: DEBUG nova.objects.instance [None req-457c52b2-e484-44cd-8f95-c21b39ada3d7 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lazy-loading 'resources' on Instance uuid 748d0da7-bbb9-4e86-aae3-e48b1fa04c14 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:08:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-457c52b2-e484-44cd-8f95-c21b39ada3d7 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:49:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-38839616',display_name='tempest-ServerActionsTestOtherA-server-38839616',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-38839616',id=20,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEDBs7Es/72p/FM9xIVe3NSPFzUvxLUb0JwmaT04oo+hgQgHwN4cwLNmRX2VhLFhce2UGzsRv1c1pV/ZeRW8oCrRJ/Tmr/k2YN/XTGeAv4iUUyvZpvQioCuIlgWRqA+LA==',key_name='tempest-keypair-638803187',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:49:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67d09cd8d15a4b058988fa348d7fdc2e',ramdisk_id='',reservation_id='r-4lmh5v1t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1680693726',owner_user_name='tempest-ServerActionsTestOtherA-1680693726-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:49:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dab7bcadfc32457e8bfa6fa81cba2702',uuid=748d0da7-bbb9-4e86-aae3-e48b1fa04c14,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11d8d21f-e53e-4277-a1d1-36e99c3bcd62", "address": "fa:16:3e:f2:d6:a0", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d8d21f-e5", "ovs_interfaceid": "11d8d21f-e53e-4277-a1d1-36e99c3bcd62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 01:08:37 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-457c52b2-e484-44cd-8f95-c21b39ada3d7 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Converting VIF {"id": "11d8d21f-e53e-4277-a1d1-36e99c3bcd62", "address": "fa:16:3e:f2:d6:a0", "network": {"id": "6e563565-dc0c-4f19-9030-742bf28811d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-423241520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67d09cd8d15a4b058988fa348d7fdc2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d8d21f-e5", "ovs_interfaceid": "11d8d21f-e53e-4277-a1d1-36e99c3bcd62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:08:37 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-457c52b2-e484-44cd-8f95-c21b39ada3d7 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:d6:a0,bridge_name='br-int',has_traffic_filtering=True,id=11d8d21f-e53e-4277-a1d1-36e99c3bcd62,network=Network(6e563565-dc0c-4f19-9030-742bf28811d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11d8d21f-e5') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:08:37 user nova-compute[74850]: DEBUG os_vif [None req-457c52b2-e484-44cd-8f95-c21b39ada3d7 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:d6:a0,bridge_name='br-int',has_traffic_filtering=True,id=11d8d21f-e53e-4277-a1d1-36e99c3bcd62,network=Network(6e563565-dc0c-4f19-9030-742bf28811d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11d8d21f-e5') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 01:08:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11d8d21f-e5, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:08:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:08:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=62aa55c1-ff27-4d98-844e-9ddc6732d459) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:08:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:37 user nova-compute[74850]: INFO os_vif [None req-457c52b2-e484-44cd-8f95-c21b39ada3d7 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:d6:a0,bridge_name='br-int',has_traffic_filtering=True,id=11d8d21f-e53e-4277-a1d1-36e99c3bcd62,network=Network(6e563565-dc0c-4f19-9030-742bf28811d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11d8d21f-e5')
Nov 14 01:08:37 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-457c52b2-e484-44cd-8f95-c21b39ada3d7 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Deleting instance files /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14_del
Nov 14 01:08:37 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-457c52b2-e484-44cd-8f95-c21b39ada3d7 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Deletion of /opt/stack/data/nova/instances/748d0da7-bbb9-4e86-aae3-e48b1fa04c14_del complete
Nov 14 01:08:37 user nova-compute[74850]: INFO nova.compute.manager [None req-457c52b2-e484-44cd-8f95-c21b39ada3d7 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Took 0.72 seconds to destroy the instance on the hypervisor.
Nov 14 01:08:37 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-457c52b2-e484-44cd-8f95-c21b39ada3d7 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 01:08:37 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 01:08:37 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 01:08:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:38 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:08:38 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Took 0.66 seconds to deallocate network for instance.
Nov 14 01:08:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-457c52b2-e484-44cd-8f95-c21b39ada3d7 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:08:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-457c52b2-e484-44cd-8f95-c21b39ada3d7 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:08:38 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-457c52b2-e484-44cd-8f95-c21b39ada3d7 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:08:38 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-457c52b2-e484-44cd-8f95-c21b39ada3d7 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:08:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-457c52b2-e484-44cd-8f95-c21b39ada3d7 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.301s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:08:38 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-457c52b2-e484-44cd-8f95-c21b39ada3d7 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Deleted allocations for instance 748d0da7-bbb9-4e86-aae3-e48b1fa04c14
Nov 14 01:08:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-457c52b2-e484-44cd-8f95-c21b39ada3d7 tempest-ServerActionsTestOtherA-1680693726 tempest-ServerActionsTestOtherA-1680693726-project-member] Lock "748d0da7-bbb9-4e86-aae3-e48b1fa04c14" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.966s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:08:39 user nova-compute[74850]: DEBUG nova.compute.manager [req-a632d552-3fd6-42a7-9384-95c4abace59c req-d467a067-52d6-4143-bb6d-3fedeaf7b3c4 service nova] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Received event network-vif-plugged-11d8d21f-e53e-4277-a1d1-36e99c3bcd62 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:08:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a632d552-3fd6-42a7-9384-95c4abace59c req-d467a067-52d6-4143-bb6d-3fedeaf7b3c4 service nova] Acquiring lock "748d0da7-bbb9-4e86-aae3-e48b1fa04c14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:08:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a632d552-3fd6-42a7-9384-95c4abace59c req-d467a067-52d6-4143-bb6d-3fedeaf7b3c4 service nova] Lock "748d0da7-bbb9-4e86-aae3-e48b1fa04c14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:08:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a632d552-3fd6-42a7-9384-95c4abace59c req-d467a067-52d6-4143-bb6d-3fedeaf7b3c4 service nova] Lock "748d0da7-bbb9-4e86-aae3-e48b1fa04c14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:08:39 user nova-compute[74850]: DEBUG nova.compute.manager [req-a632d552-3fd6-42a7-9384-95c4abace59c req-d467a067-52d6-4143-bb6d-3fedeaf7b3c4 service nova] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] No waiting events found dispatching network-vif-plugged-11d8d21f-e53e-4277-a1d1-36e99c3bcd62 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:08:39 user nova-compute[74850]: WARNING nova.compute.manager [req-a632d552-3fd6-42a7-9384-95c4abace59c req-d467a067-52d6-4143-bb6d-3fedeaf7b3c4 service nova] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Received unexpected event network-vif-plugged-11d8d21f-e53e-4277-a1d1-36e99c3bcd62 for instance with vm_state deleted and task_state None.
Nov 14 01:08:39 user nova-compute[74850]: DEBUG nova.compute.manager [req-a632d552-3fd6-42a7-9384-95c4abace59c req-d467a067-52d6-4143-bb6d-3fedeaf7b3c4 service nova] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Received event network-vif-plugged-11d8d21f-e53e-4277-a1d1-36e99c3bcd62 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:08:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a632d552-3fd6-42a7-9384-95c4abace59c req-d467a067-52d6-4143-bb6d-3fedeaf7b3c4 service nova] Acquiring lock "748d0da7-bbb9-4e86-aae3-e48b1fa04c14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:08:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a632d552-3fd6-42a7-9384-95c4abace59c req-d467a067-52d6-4143-bb6d-3fedeaf7b3c4 service nova] Lock "748d0da7-bbb9-4e86-aae3-e48b1fa04c14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:08:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a632d552-3fd6-42a7-9384-95c4abace59c req-d467a067-52d6-4143-bb6d-3fedeaf7b3c4 service nova] Lock "748d0da7-bbb9-4e86-aae3-e48b1fa04c14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:08:39 user nova-compute[74850]: DEBUG nova.compute.manager [req-a632d552-3fd6-42a7-9384-95c4abace59c req-d467a067-52d6-4143-bb6d-3fedeaf7b3c4 service nova] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] No waiting events found dispatching network-vif-plugged-11d8d21f-e53e-4277-a1d1-36e99c3bcd62 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:08:39 user nova-compute[74850]: WARNING nova.compute.manager [req-a632d552-3fd6-42a7-9384-95c4abace59c req-d467a067-52d6-4143-bb6d-3fedeaf7b3c4 service nova] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Received unexpected event network-vif-plugged-11d8d21f-e53e-4277-a1d1-36e99c3bcd62 for instance with vm_state deleted and task_state None.
Nov 14 01:08:39 user nova-compute[74850]: DEBUG nova.compute.manager [req-a632d552-3fd6-42a7-9384-95c4abace59c req-d467a067-52d6-4143-bb6d-3fedeaf7b3c4 service nova] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Received event network-vif-plugged-11d8d21f-e53e-4277-a1d1-36e99c3bcd62 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:08:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a632d552-3fd6-42a7-9384-95c4abace59c req-d467a067-52d6-4143-bb6d-3fedeaf7b3c4 service nova] Acquiring lock "748d0da7-bbb9-4e86-aae3-e48b1fa04c14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:08:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a632d552-3fd6-42a7-9384-95c4abace59c req-d467a067-52d6-4143-bb6d-3fedeaf7b3c4 service nova] Lock "748d0da7-bbb9-4e86-aae3-e48b1fa04c14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:08:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a632d552-3fd6-42a7-9384-95c4abace59c req-d467a067-52d6-4143-bb6d-3fedeaf7b3c4 service nova] Lock "748d0da7-bbb9-4e86-aae3-e48b1fa04c14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:08:39 user nova-compute[74850]: DEBUG nova.compute.manager [req-a632d552-3fd6-42a7-9384-95c4abace59c req-d467a067-52d6-4143-bb6d-3fedeaf7b3c4 service nova] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] No waiting events found dispatching network-vif-plugged-11d8d21f-e53e-4277-a1d1-36e99c3bcd62 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:08:39 user nova-compute[74850]: WARNING nova.compute.manager [req-a632d552-3fd6-42a7-9384-95c4abace59c req-d467a067-52d6-4143-bb6d-3fedeaf7b3c4 service nova] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Received unexpected event network-vif-plugged-11d8d21f-e53e-4277-a1d1-36e99c3bcd62 for instance with vm_state deleted and task_state None.
Nov 14 01:08:39 user nova-compute[74850]: DEBUG nova.compute.manager [req-a632d552-3fd6-42a7-9384-95c4abace59c req-d467a067-52d6-4143-bb6d-3fedeaf7b3c4 service nova] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Received event network-vif-plugged-11d8d21f-e53e-4277-a1d1-36e99c3bcd62 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:08:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a632d552-3fd6-42a7-9384-95c4abace59c req-d467a067-52d6-4143-bb6d-3fedeaf7b3c4 service nova] Acquiring lock "748d0da7-bbb9-4e86-aae3-e48b1fa04c14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:08:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a632d552-3fd6-42a7-9384-95c4abace59c req-d467a067-52d6-4143-bb6d-3fedeaf7b3c4 service nova] Lock "748d0da7-bbb9-4e86-aae3-e48b1fa04c14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:08:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a632d552-3fd6-42a7-9384-95c4abace59c req-d467a067-52d6-4143-bb6d-3fedeaf7b3c4 service nova] Lock "748d0da7-bbb9-4e86-aae3-e48b1fa04c14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:08:39 user nova-compute[74850]: DEBUG nova.compute.manager [req-a632d552-3fd6-42a7-9384-95c4abace59c req-d467a067-52d6-4143-bb6d-3fedeaf7b3c4 service nova] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] No waiting events found dispatching network-vif-plugged-11d8d21f-e53e-4277-a1d1-36e99c3bcd62 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:08:39 user nova-compute[74850]: WARNING nova.compute.manager [req-a632d552-3fd6-42a7-9384-95c4abace59c req-d467a067-52d6-4143-bb6d-3fedeaf7b3c4 service nova] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Received unexpected event network-vif-plugged-11d8d21f-e53e-4277-a1d1-36e99c3bcd62 for instance with vm_state deleted and task_state None.
Nov 14 01:08:39 user nova-compute[74850]: DEBUG nova.compute.manager [req-a632d552-3fd6-42a7-9384-95c4abace59c req-d467a067-52d6-4143-bb6d-3fedeaf7b3c4 service nova] [instance: 748d0da7-bbb9-4e86-aae3-e48b1fa04c14] Received event network-vif-deleted-11d8d21f-e53e-4277-a1d1-36e99c3bcd62 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:08:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-98f6ef09-3bc2-46ae-ab72-931a5a46fc9c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Acquiring lock "2294e4d8-7e62-4875-822f-bc9020721881" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:08:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-98f6ef09-3bc2-46ae-ab72-931a5a46fc9c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "2294e4d8-7e62-4875-822f-bc9020721881" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:08:39 user nova-compute[74850]: INFO nova.compute.manager [None req-98f6ef09-3bc2-46ae-ab72-931a5a46fc9c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Detaching volume e46c234a-e963-4708-a493-79b0b4a8534d
Nov 14 01:08:39 user nova-compute[74850]: INFO nova.virt.block_device [None req-98f6ef09-3bc2-46ae-ab72-931a5a46fc9c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Attempting to driver detach volume e46c234a-e963-4708-a493-79b0b4a8534d from mountpoint /dev/vdb
Nov 14 01:08:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-98f6ef09-3bc2-46ae-ab72-931a5a46fc9c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Attempting to detach device vdb from instance 2294e4d8-7e62-4875-822f-bc9020721881 from the persistent domain config. {{(pid=74850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 01:08:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-98f6ef09-3bc2-46ae-ab72-931a5a46fc9c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:08:39 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:08:39 user nova-compute[74850]:   <source dev="/dev/sdc"/>
Nov 14 01:08:39 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:08:39 user nova-compute[74850]:   <serial>e46c234a-e963-4708-a493-79b0b4a8534d</serial>
Nov 14 01:08:39 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 01:08:39 user nova-compute[74850]: </disk>
Nov 14 01:08:39 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:08:39 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-98f6ef09-3bc2-46ae-ab72-931a5a46fc9c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Successfully detached device vdb from instance 2294e4d8-7e62-4875-822f-bc9020721881 from the persistent domain config.
Nov 14 01:08:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-98f6ef09-3bc2-46ae-ab72-931a5a46fc9c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2294e4d8-7e62-4875-822f-bc9020721881 from the live domain config. {{(pid=74850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 01:08:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-98f6ef09-3bc2-46ae-ab72-931a5a46fc9c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:08:39 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:08:39 user nova-compute[74850]:   <source dev="/dev/sdc"/>
Nov 14 01:08:39 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:08:39 user nova-compute[74850]:   <serial>e46c234a-e963-4708-a493-79b0b4a8534d</serial>
Nov 14 01:08:39 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 01:08:39 user nova-compute[74850]: </disk>
Nov 14 01:08:39 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:08:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Acquiring lock "2294e4d8-7e62-4875-822f-bc9020721881" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:08:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-98f6ef09-3bc2-46ae-ab72-931a5a46fc9c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2294e4d8-7e62-4875-822f-bc9020721881 {{(pid=74850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 01:08:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:46 user nova-compute[74850]: INFO nova.compute.manager [None req-1c5ddeac-953b-43bf-a7fe-67645171cf82 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Unrescuing
Nov 14 01:08:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1c5ddeac-953b-43bf-a7fe-67645171cf82 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "refresh_cache-e6e38d20-9aac-4037-b1b4-0c25005a9a67" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:08:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1c5ddeac-953b-43bf-a7fe-67645171cf82 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquired lock "refresh_cache-e6e38d20-9aac-4037-b1b4-0c25005a9a67" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:08:46 user nova-compute[74850]: DEBUG nova.network.neutron [None req-1c5ddeac-953b-43bf-a7fe-67645171cf82 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 01:08:46 user nova-compute[74850]: DEBUG nova.network.neutron [None req-1c5ddeac-953b-43bf-a7fe-67645171cf82 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Updating instance_info_cache with network_info: [{"id": "9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe", "address": "fa:16:3e:f7:6e:24", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c0cbd8f-1b", "ovs_interfaceid": "9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:08:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-1c5ddeac-953b-43bf-a7fe-67645171cf82 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Releasing lock "refresh_cache-e6e38d20-9aac-4037-b1b4-0c25005a9a67" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:08:46 user nova-compute[74850]: DEBUG nova.objects.instance [None req-1c5ddeac-953b-43bf-a7fe-67645171cf82 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lazy-loading 'flavor' on Instance uuid e6e38d20-9aac-4037-b1b4-0c25005a9a67 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:08:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:46 user nova-compute[74850]: DEBUG nova.compute.manager [req-aab0c4dc-2fc0-468b-8381-bc671233d567 req-f1e7d7cd-72e1-4614-9de3-2b05f51cd04d service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Received event network-vif-unplugged-9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:08:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-aab0c4dc-2fc0-468b-8381-bc671233d567 req-f1e7d7cd-72e1-4614-9de3-2b05f51cd04d service nova] Acquiring lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:08:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-aab0c4dc-2fc0-468b-8381-bc671233d567 req-f1e7d7cd-72e1-4614-9de3-2b05f51cd04d service nova] Lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:08:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-aab0c4dc-2fc0-468b-8381-bc671233d567 req-f1e7d7cd-72e1-4614-9de3-2b05f51cd04d service nova] Lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:08:46 user nova-compute[74850]: DEBUG nova.compute.manager [req-aab0c4dc-2fc0-468b-8381-bc671233d567 req-f1e7d7cd-72e1-4614-9de3-2b05f51cd04d service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] No waiting events found dispatching network-vif-unplugged-9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:08:46 user nova-compute[74850]: WARNING nova.compute.manager [req-aab0c4dc-2fc0-468b-8381-bc671233d567 req-f1e7d7cd-72e1-4614-9de3-2b05f51cd04d service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Received unexpected event network-vif-unplugged-9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe for instance with vm_state rescued and task_state unrescuing.
Nov 14 01:08:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:47 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Instance destroyed successfully.
Nov 14 01:08:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:49 user nova-compute[74850]: DEBUG nova.compute.manager [req-faf567e8-57b5-4061-999a-e88fbec0f6c8 req-017eceb7-29ab-4f6c-93aa-1cb821b2c7c9 service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Received event network-vif-plugged-9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:08:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-faf567e8-57b5-4061-999a-e88fbec0f6c8 req-017eceb7-29ab-4f6c-93aa-1cb821b2c7c9 service nova] Acquiring lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:08:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-faf567e8-57b5-4061-999a-e88fbec0f6c8 req-017eceb7-29ab-4f6c-93aa-1cb821b2c7c9 service nova] Lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:08:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-faf567e8-57b5-4061-999a-e88fbec0f6c8 req-017eceb7-29ab-4f6c-93aa-1cb821b2c7c9 service nova] Lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:08:49 user nova-compute[74850]: DEBUG nova.compute.manager [req-faf567e8-57b5-4061-999a-e88fbec0f6c8 req-017eceb7-29ab-4f6c-93aa-1cb821b2c7c9 service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] No waiting events found dispatching network-vif-plugged-9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:08:49 user nova-compute[74850]: WARNING nova.compute.manager [req-faf567e8-57b5-4061-999a-e88fbec0f6c8 req-017eceb7-29ab-4f6c-93aa-1cb821b2c7c9 service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Received unexpected event network-vif-plugged-9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe for instance with vm_state rescued and task_state unrescuing.
Nov 14 01:08:49 user nova-compute[74850]: DEBUG nova.compute.manager [req-faf567e8-57b5-4061-999a-e88fbec0f6c8 req-017eceb7-29ab-4f6c-93aa-1cb821b2c7c9 service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Received event network-vif-plugged-9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:08:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-faf567e8-57b5-4061-999a-e88fbec0f6c8 req-017eceb7-29ab-4f6c-93aa-1cb821b2c7c9 service nova] Acquiring lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:08:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-faf567e8-57b5-4061-999a-e88fbec0f6c8 req-017eceb7-29ab-4f6c-93aa-1cb821b2c7c9 service nova] Lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:08:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-faf567e8-57b5-4061-999a-e88fbec0f6c8 req-017eceb7-29ab-4f6c-93aa-1cb821b2c7c9 service nova] Lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:08:49 user nova-compute[74850]: DEBUG nova.compute.manager [req-faf567e8-57b5-4061-999a-e88fbec0f6c8 req-017eceb7-29ab-4f6c-93aa-1cb821b2c7c9 service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] No waiting events found dispatching network-vif-plugged-9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:08:49 user nova-compute[74850]: WARNING nova.compute.manager [req-faf567e8-57b5-4061-999a-e88fbec0f6c8 req-017eceb7-29ab-4f6c-93aa-1cb821b2c7c9 service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Received unexpected event network-vif-plugged-9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe for instance with vm_state rescued and task_state unrescuing.
Nov 14 01:08:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "709f145b-a471-4a1d-86dc-327e1c3fabb9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:08:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "709f145b-a471-4a1d-86dc-327e1c3fabb9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:08:50 user nova-compute[74850]: DEBUG nova.compute.manager [None req-1c5ddeac-953b-43bf-a7fe-67645171cf82 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 01:08:50 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 01:08:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:08:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:08:51 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 01:08:51 user nova-compute[74850]: INFO nova.compute.claims [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Claim successful on node user
Nov 14 01:08:51 user nova-compute[74850]: DEBUG nova.compute.manager [req-7f2c6052-3900-49e7-a679-60d4466ab69d req-673d864c-418c-4413-90f9-802ae8728e5e service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Received event network-vif-plugged-9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:08:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7f2c6052-3900-49e7-a679-60d4466ab69d req-673d864c-418c-4413-90f9-802ae8728e5e service nova] Acquiring lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:08:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7f2c6052-3900-49e7-a679-60d4466ab69d req-673d864c-418c-4413-90f9-802ae8728e5e service nova] Lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:08:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7f2c6052-3900-49e7-a679-60d4466ab69d req-673d864c-418c-4413-90f9-802ae8728e5e service nova] Lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:08:51 user nova-compute[74850]: DEBUG nova.compute.manager [req-7f2c6052-3900-49e7-a679-60d4466ab69d req-673d864c-418c-4413-90f9-802ae8728e5e service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] No waiting events found dispatching network-vif-plugged-9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:08:51 user nova-compute[74850]: WARNING nova.compute.manager [req-7f2c6052-3900-49e7-a679-60d4466ab69d req-673d864c-418c-4413-90f9-802ae8728e5e service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Received unexpected event network-vif-plugged-9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe for instance with vm_state active and task_state None.
Nov 14 01:08:51 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:08:51 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:08:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.335s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:08:51 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 01:08:51 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 01:08:51 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 01:08:51 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 01:08:51 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 01:08:51 user nova-compute[74850]: DEBUG nova.policy [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb027592ab214b57b389227a97576a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f609057d1e44679838d565d80cade3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 01:08:51 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 01:08:51 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 01:08:51 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Creating image(s)
Nov 14 01:08:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "/opt/stack/data/nova/instances/709f145b-a471-4a1d-86dc-327e1c3fabb9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:08:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "/opt/stack/data/nova/instances/709f145b-a471-4a1d-86dc-327e1c3fabb9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:08:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "/opt/stack/data/nova/instances/709f145b-a471-4a1d-86dc-327e1c3fabb9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:08:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.192s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:08:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:08:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.201s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/709f145b-a471-4a1d-86dc-327e1c3fabb9/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/709f145b-a471-4a1d-86dc-327e1c3fabb9/disk 1073741824" returned: 0 in 0.051s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:08:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:52 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Successfully created port: 2cdb56a9-9d40-470c-8640-cd9ce3308893 {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 01:08:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.189s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:52 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Checking if we can resize image /opt/stack/data/nova/instances/709f145b-a471-4a1d-86dc-327e1c3fabb9/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 01:08:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/709f145b-a471-4a1d-86dc-327e1c3fabb9/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/709f145b-a471-4a1d-86dc-327e1c3fabb9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:52 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Cannot resize image /opt/stack/data/nova/instances/709f145b-a471-4a1d-86dc-327e1c3fabb9/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 01:08:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 01:08:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Ensure instance console log exists: /opt/stack/data/nova/instances/709f145b-a471-4a1d-86dc-327e1c3fabb9/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 01:08:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:08:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:08:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:08:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:52 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Successfully updated port: 2cdb56a9-9d40-470c-8640-cd9ce3308893 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 01:08:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "refresh_cache-709f145b-a471-4a1d-86dc-327e1c3fabb9" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:08:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquired lock "refresh_cache-709f145b-a471-4a1d-86dc-327e1c3fabb9" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:08:52 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 01:08:52 user nova-compute[74850]: DEBUG nova.compute.manager [req-d20afcd5-7201-4677-adb1-5577b507db8c req-d52da2c1-63be-42e6-a6d9-b3ae056ecc14 service nova] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Received event network-changed-2cdb56a9-9d40-470c-8640-cd9ce3308893 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:08:52 user nova-compute[74850]: DEBUG nova.compute.manager [req-d20afcd5-7201-4677-adb1-5577b507db8c req-d52da2c1-63be-42e6-a6d9-b3ae056ecc14 service nova] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Refreshing instance network info cache due to event network-changed-2cdb56a9-9d40-470c-8640-cd9ce3308893. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:08:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d20afcd5-7201-4677-adb1-5577b507db8c req-d52da2c1-63be-42e6-a6d9-b3ae056ecc14 service nova] Acquiring lock "refresh_cache-709f145b-a471-4a1d-86dc-327e1c3fabb9" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:08:52 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Updating instance_info_cache with network_info: [{"id": "2cdb56a9-9d40-470c-8640-cd9ce3308893", "address": "fa:16:3e:85:8d:80", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cdb56a9-9d", "ovs_interfaceid": "2cdb56a9-9d40-470c-8640-cd9ce3308893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Releasing lock "refresh_cache-709f145b-a471-4a1d-86dc-327e1c3fabb9" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Instance network_info: |[{"id": "2cdb56a9-9d40-470c-8640-cd9ce3308893", "address": "fa:16:3e:85:8d:80", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cdb56a9-9d", "ovs_interfaceid": "2cdb56a9-9d40-470c-8640-cd9ce3308893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d20afcd5-7201-4677-adb1-5577b507db8c req-d52da2c1-63be-42e6-a6d9-b3ae056ecc14 service nova] Acquired lock "refresh_cache-709f145b-a471-4a1d-86dc-327e1c3fabb9" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG nova.network.neutron [req-d20afcd5-7201-4677-adb1-5577b507db8c req-d52da2c1-63be-42e6-a6d9-b3ae056ecc14 service nova] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Refreshing network info cache for port 2cdb56a9-9d40-470c-8640-cd9ce3308893 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Start _get_guest_xml network_info=[{"id": "2cdb56a9-9d40-470c-8640-cd9ce3308893", "address": "fa:16:3e:85:8d:80", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cdb56a9-9d", "ovs_interfaceid": "2cdb56a9-9d40-470c-8640-cd9ce3308893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 01:08:53 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:08:53 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:08:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:08:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2112312360',display_name='tempest-AttachVolumeNegativeTest-server-2112312360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2112312360',id=46,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0U/UT+aEjcUQ6Vd+cHQjHwFaX3CmTatHNXaTQqBKHsm7Q3bwOVV9YbnpTgRKLqMIxW7LlekOgXWlXyDWq8y2NlA56CNUn0e/YRNYCKerhwNV4ok9LMDE3nniToFyeHGQ==',key_name='tempest-keypair-893979353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35f609057d1e44679838d565d80cade3',ramdisk_id='',reservation_id='r-sctdhzt6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1995397455',owner_user_name='tempest-AttachVolumeNegativeTest-1995397455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:08:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb027592ab214b57b389227a97576a43',uuid=709f145b-a471-4a1d-86dc-327e1c3fabb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cdb56a9-9d40-470c-8640-cd9ce3308893", "address": "fa:16:3e:85:8d:80", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cdb56a9-9d", "ovs_interfaceid": "2cdb56a9-9d40-470c-8640-cd9ce3308893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Converting VIF {"id": "2cdb56a9-9d40-470c-8640-cd9ce3308893", "address": "fa:16:3e:85:8d:80", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cdb56a9-9d", "ovs_interfaceid": "2cdb56a9-9d40-470c-8640-cd9ce3308893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:8d:80,bridge_name='br-int',has_traffic_filtering=True,id=2cdb56a9-9d40-470c-8640-cd9ce3308893,network=Network(11208f55-0e63-4c33-a12c-e061c8061eec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cdb56a9-9d') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG nova.objects.instance [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lazy-loading 'pci_devices' on Instance uuid 709f145b-a471-4a1d-86dc-327e1c3fabb9 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] End _get_guest_xml xml=<domain type="kvm">
Nov 14 01:08:53 user nova-compute[74850]:   <uuid>709f145b-a471-4a1d-86dc-327e1c3fabb9</uuid>
Nov 14 01:08:53 user nova-compute[74850]:   <name>instance-0000002e</name>
Nov 14 01:08:53 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 01:08:53 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 01:08:53 user nova-compute[74850]:   <metadata>
Nov 14 01:08:53 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 01:08:53 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 01:08:53 user nova-compute[74850]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2112312360</nova:name>
Nov 14 01:08:53 user nova-compute[74850]:       <nova:creationTime>2023-11-14 01:08:53</nova:creationTime>
Nov 14 01:08:53 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 01:08:53 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 01:08:53 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 01:08:53 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 01:08:53 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 01:08:53 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 01:08:53 user nova-compute[74850]:       </nova:flavor>
Nov 14 01:08:53 user nova-compute[74850]:       <nova:owner>
Nov 14 01:08:53 user nova-compute[74850]:         <nova:user uuid="fb027592ab214b57b389227a97576a43">tempest-AttachVolumeNegativeTest-1995397455-project-member</nova:user>
Nov 14 01:08:53 user nova-compute[74850]:         <nova:project uuid="35f609057d1e44679838d565d80cade3">tempest-AttachVolumeNegativeTest-1995397455</nova:project>
Nov 14 01:08:53 user nova-compute[74850]:       </nova:owner>
Nov 14 01:08:53 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 01:08:53 user nova-compute[74850]:       <nova:ports>
Nov 14 01:08:53 user nova-compute[74850]:         <nova:port uuid="2cdb56a9-9d40-470c-8640-cd9ce3308893">
Nov 14 01:08:53 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 01:08:53 user nova-compute[74850]:         </nova:port>
Nov 14 01:08:53 user nova-compute[74850]:       </nova:ports>
Nov 14 01:08:53 user nova-compute[74850]:     </nova:instance>
Nov 14 01:08:53 user nova-compute[74850]:   </metadata>
Nov 14 01:08:53 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 01:08:53 user nova-compute[74850]:     <system>
Nov 14 01:08:53 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 01:08:53 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 01:08:53 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 01:08:53 user nova-compute[74850]:       <entry name="serial">709f145b-a471-4a1d-86dc-327e1c3fabb9</entry>
Nov 14 01:08:53 user nova-compute[74850]:       <entry name="uuid">709f145b-a471-4a1d-86dc-327e1c3fabb9</entry>
Nov 14 01:08:53 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 01:08:53 user nova-compute[74850]:     </system>
Nov 14 01:08:53 user nova-compute[74850]:   </sysinfo>
Nov 14 01:08:53 user nova-compute[74850]:   <os>
Nov 14 01:08:53 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 01:08:53 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 01:08:53 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 01:08:53 user nova-compute[74850]:   </os>
Nov 14 01:08:53 user nova-compute[74850]:   <features>
Nov 14 01:08:53 user nova-compute[74850]:     <acpi/>
Nov 14 01:08:53 user nova-compute[74850]:     <apic/>
Nov 14 01:08:53 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 01:08:53 user nova-compute[74850]:   </features>
Nov 14 01:08:53 user nova-compute[74850]:   <clock offset="utc">
Nov 14 01:08:53 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 01:08:53 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 01:08:53 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 01:08:53 user nova-compute[74850]:   </clock>
Nov 14 01:08:53 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 01:08:53 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 01:08:53 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 01:08:53 user nova-compute[74850]:   </cpu>
Nov 14 01:08:53 user nova-compute[74850]:   <devices>
Nov 14 01:08:53 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 01:08:53 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 01:08:53 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/709f145b-a471-4a1d-86dc-327e1c3fabb9/disk"/>
Nov 14 01:08:53 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 01:08:53 user nova-compute[74850]:     </disk>
Nov 14 01:08:53 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 01:08:53 user nova-compute[74850]:       <mac address="fa:16:3e:85:8d:80"/>
Nov 14 01:08:53 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:08:53 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 01:08:53 user nova-compute[74850]:       <target dev="tap2cdb56a9-9d"/>
Nov 14 01:08:53 user nova-compute[74850]:     </interface>
Nov 14 01:08:53 user nova-compute[74850]:     <serial type="pty">
Nov 14 01:08:53 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/709f145b-a471-4a1d-86dc-327e1c3fabb9/console.log" append="off"/>
Nov 14 01:08:53 user nova-compute[74850]:     </serial>
Nov 14 01:08:53 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 01:08:53 user nova-compute[74850]:     <video>
Nov 14 01:08:53 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:08:53 user nova-compute[74850]:     </video>
Nov 14 01:08:53 user nova-compute[74850]:     <rng model="virtio">
Nov 14 01:08:53 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 01:08:53 user nova-compute[74850]:     </rng>
Nov 14 01:08:53 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 01:08:53 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 01:08:53 user nova-compute[74850]:       <stats period="10"/>
Nov 14 01:08:53 user nova-compute[74850]:     </memballoon>
Nov 14 01:08:53 user nova-compute[74850]:   </devices>
Nov 14 01:08:53 user nova-compute[74850]: </domain>
Nov 14 01:08:53 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:08:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2112312360',display_name='tempest-AttachVolumeNegativeTest-server-2112312360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2112312360',id=46,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0U/UT+aEjcUQ6Vd+cHQjHwFaX3CmTatHNXaTQqBKHsm7Q3bwOVV9YbnpTgRKLqMIxW7LlekOgXWlXyDWq8y2NlA56CNUn0e/YRNYCKerhwNV4ok9LMDE3nniToFyeHGQ==',key_name='tempest-keypair-893979353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35f609057d1e44679838d565d80cade3',ramdisk_id='',reservation_id='r-sctdhzt6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1995397455',owner_user_name='tempest-AttachVolumeNegativeTest-1995397455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:08:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb027592ab214b57b389227a97576a43',uuid=709f145b-a471-4a1d-86dc-327e1c3fabb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cdb56a9-9d40-470c-8640-cd9ce3308893", "address": "fa:16:3e:85:8d:80", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cdb56a9-9d", "ovs_interfaceid": "2cdb56a9-9d40-470c-8640-cd9ce3308893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Converting VIF {"id": "2cdb56a9-9d40-470c-8640-cd9ce3308893", "address": "fa:16:3e:85:8d:80", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cdb56a9-9d", "ovs_interfaceid": "2cdb56a9-9d40-470c-8640-cd9ce3308893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:8d:80,bridge_name='br-int',has_traffic_filtering=True,id=2cdb56a9-9d40-470c-8640-cd9ce3308893,network=Network(11208f55-0e63-4c33-a12c-e061c8061eec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cdb56a9-9d') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG os_vif [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:8d:80,bridge_name='br-int',has_traffic_filtering=True,id=2cdb56a9-9d40-470c-8640-cd9ce3308893,network=Network(11208f55-0e63-4c33-a12c-e061c8061eec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cdb56a9-9d') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '227d68cd-f3db-5695-bd31-b60b789fc0ee', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2cdb56a9-9d, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2cdb56a9-9d, col_values=(('qos', UUID('38c1bc18-ea61-4b4a-83eb-26c55b480f69')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2cdb56a9-9d, col_values=(('external_ids', {'iface-id': '2cdb56a9-9d40-470c-8640-cd9ce3308893', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:8d:80', 'vm-uuid': '709f145b-a471-4a1d-86dc-327e1c3fabb9'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:53 user nova-compute[74850]: INFO os_vif [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:8d:80,bridge_name='br-int',has_traffic_filtering=True,id=2cdb56a9-9d40-470c-8640-cd9ce3308893,network=Network(11208f55-0e63-4c33-a12c-e061c8061eec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cdb56a9-9d')
Nov 14 01:08:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] No VIF found with MAC fa:16:3e:85:8d:80, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG nova.network.neutron [req-d20afcd5-7201-4677-adb1-5577b507db8c req-d52da2c1-63be-42e6-a6d9-b3ae056ecc14 service nova] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Updated VIF entry in instance network info cache for port 2cdb56a9-9d40-470c-8640-cd9ce3308893. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG nova.network.neutron [req-d20afcd5-7201-4677-adb1-5577b507db8c req-d52da2c1-63be-42e6-a6d9-b3ae056ecc14 service nova] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Updating instance_info_cache with network_info: [{"id": "2cdb56a9-9d40-470c-8640-cd9ce3308893", "address": "fa:16:3e:85:8d:80", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cdb56a9-9d", "ovs_interfaceid": "2cdb56a9-9d40-470c-8640-cd9ce3308893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:08:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d20afcd5-7201-4677-adb1-5577b507db8c req-d52da2c1-63be-42e6-a6d9-b3ae056ecc14 service nova] Releasing lock "refresh_cache-709f145b-a471-4a1d-86dc-327e1c3fabb9" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:08:54 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:54 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:54 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:54 user nova-compute[74850]: DEBUG nova.compute.manager [req-8f904265-b14f-4520-8e40-5a9fd281c447 req-dd911ae9-b0b0-42c9-8b84-3919385074d9 service nova] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Received event network-vif-plugged-2cdb56a9-9d40-470c-8640-cd9ce3308893 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:08:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-8f904265-b14f-4520-8e40-5a9fd281c447 req-dd911ae9-b0b0-42c9-8b84-3919385074d9 service nova] Acquiring lock "709f145b-a471-4a1d-86dc-327e1c3fabb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:08:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-8f904265-b14f-4520-8e40-5a9fd281c447 req-dd911ae9-b0b0-42c9-8b84-3919385074d9 service nova] Lock "709f145b-a471-4a1d-86dc-327e1c3fabb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:08:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-8f904265-b14f-4520-8e40-5a9fd281c447 req-dd911ae9-b0b0-42c9-8b84-3919385074d9 service nova] Lock "709f145b-a471-4a1d-86dc-327e1c3fabb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:08:54 user nova-compute[74850]: DEBUG nova.compute.manager [req-8f904265-b14f-4520-8e40-5a9fd281c447 req-dd911ae9-b0b0-42c9-8b84-3919385074d9 service nova] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] No waiting events found dispatching network-vif-plugged-2cdb56a9-9d40-470c-8640-cd9ce3308893 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:08:54 user nova-compute[74850]: WARNING nova.compute.manager [req-8f904265-b14f-4520-8e40-5a9fd281c447 req-dd911ae9-b0b0-42c9-8b84-3919385074d9 service nova] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Received unexpected event network-vif-plugged-2cdb56a9-9d40-470c-8640-cd9ce3308893 for instance with vm_state building and task_state spawning.
Nov 14 01:08:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:55 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:08:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:08:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:08:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:08:55 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 01:08:56 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:56 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 01:08:56 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 01:08:56 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/709f145b-a471-4a1d-86dc-327e1c3fabb9/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:56 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Instance spawned successfully.
Nov 14 01:08:56 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 01:08:57 user nova-compute[74850]: DEBUG nova.compute.manager [req-77be0eb3-4f78-4091-bf65-34f91baa5c59 req-c42adc6a-acbd-4601-b5de-242f67f20f67 service nova] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Received event network-vif-plugged-2cdb56a9-9d40-470c-8640-cd9ce3308893 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:08:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-77be0eb3-4f78-4091-bf65-34f91baa5c59 req-c42adc6a-acbd-4601-b5de-242f67f20f67 service nova] Acquiring lock "709f145b-a471-4a1d-86dc-327e1c3fabb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:08:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-77be0eb3-4f78-4091-bf65-34f91baa5c59 req-c42adc6a-acbd-4601-b5de-242f67f20f67 service nova] Lock "709f145b-a471-4a1d-86dc-327e1c3fabb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:08:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-77be0eb3-4f78-4091-bf65-34f91baa5c59 req-c42adc6a-acbd-4601-b5de-242f67f20f67 service nova] Lock "709f145b-a471-4a1d-86dc-327e1c3fabb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:08:57 user nova-compute[74850]: DEBUG nova.compute.manager [req-77be0eb3-4f78-4091-bf65-34f91baa5c59 req-c42adc6a-acbd-4601-b5de-242f67f20f67 service nova] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] No waiting events found dispatching network-vif-plugged-2cdb56a9-9d40-470c-8640-cd9ce3308893 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:08:57 user nova-compute[74850]: WARNING nova.compute.manager [req-77be0eb3-4f78-4091-bf65-34f91baa5c59 req-c42adc6a-acbd-4601-b5de-242f67f20f67 service nova] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Received unexpected event network-vif-plugged-2cdb56a9-9d40-470c-8640-cd9ce3308893 for instance with vm_state building and task_state spawning.
Nov 14 01:08:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:08:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:08:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:08:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:08:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:08:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:08:57 user nova-compute[74850]: INFO nova.compute.manager [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Took 5.50 seconds to spawn the instance on the hypervisor.
Nov 14 01:08:57 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 01:08:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/709f145b-a471-4a1d-86dc-327e1c3fabb9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/709f145b-a471-4a1d-86dc-327e1c3fabb9/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:57 user nova-compute[74850]: INFO nova.compute.manager [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Took 6.22 seconds to build instance.
Nov 14 01:08:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4fa03f98-2e9c-4910-89ef-fbab73c1eb89 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "709f145b-a471-4a1d-86dc-327e1c3fabb9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.325s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:08:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/709f145b-a471-4a1d-86dc-327e1c3fabb9/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:08:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:08:57 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:08:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2294e4d8-7e62-4875-822f-bc9020721881/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2294e4d8-7e62-4875-822f-bc9020721881/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2294e4d8-7e62-4875-822f-bc9020721881/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:08:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2294e4d8-7e62-4875-822f-bc9020721881/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:08:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:08:58 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:08:58 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:08:58 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=8198MB free_disk=24.867164611816406GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 01:08:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:08:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:08:58 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance c7952bff-87d6-46c1-a6d4-7729dc4893ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:08:58 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 702746f7-305f-4eac-a71a-6c08b7cbccd8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:08:58 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 3504ddd3-bdd8-465e-aec5-190acdd563f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:08:58 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance e6e38d20-9aac-4037-b1b4-0c25005a9a67 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:08:58 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 2294e4d8-7e62-4875-822f-bc9020721881 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:08:58 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:08:58 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance ffaf0225-770f-4c7c-8fde-7aa258e5fc7c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:08:58 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 709f145b-a471-4a1d-86dc-327e1c3fabb9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:08:58 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 01:08:58 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 01:08:59 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:08:59 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:08:59 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 01:08:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.495s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:09:00 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-98f6ef09-3bc2-46ae-ab72-931a5a46fc9c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2294e4d8-7e62-4875-822f-bc9020721881 is timed out.
Nov 14 01:09:00 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-98f6ef09-3bc2-46ae-ab72-931a5a46fc9c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Successfully detached device vdb from instance 2294e4d8-7e62-4875-822f-bc9020721881 from the live domain config.
Nov 14 01:09:00 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98f6ef09-3bc2-46ae-ab72-931a5a46fc9c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f6ef09-3bc2-46ae-ab72-931a5a46fc9c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PzJyvIpW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:09:00 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-98f6ef09-3bc2-46ae-ab72-931a5a46fc9c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:09:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-98f6ef09-3bc2-46ae-ab72-931a5a46fc9c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-98f6ef09-3bc2-46ae-ab72-931a5a46fc9c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae71732-a86c-40a3-8f42-4540792ea46c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f6ef09-3bc2-46ae-ab72-931a5a46fc9c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 01:09:00 user nova-compute[74850]: No targets found.
Nov 14 01:09:00 user nova-compute[74850]: iSNS:
Nov 14 01:09:00 user nova-compute[74850]: No targets found.
Nov 14 01:09:00 user nova-compute[74850]: STATIC:
Nov 14 01:09:00 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d
Nov 14 01:09:00 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:09:00 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:09:00 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a
Nov 14 01:09:00 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:09:00 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:09:00 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8
Nov 14 01:09:00 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:09:00 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:09:00 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d
Nov 14 01:09:00 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:09:00 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:09:00 user nova-compute[74850]: FIRMWARE:
Nov 14 01:09:00 user nova-compute[74850]: No targets found.
Nov 14 01:09:00 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f6ef09-3bc2-46ae-ab72-931a5a46fc9c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 01:09:00 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 01:09:00 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f6ef09-3bc2-46ae-ab72-931a5a46fc9c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24019ab-0c16-4ea6-9e3d-e3f54b66e284]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[45809d94-e024-4b71-bbec-8a6a90f02e6d]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f6ef09-3bc2-46ae-ab72-931a5a46fc9c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:09:00 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:09:00 user nova-compute[74850]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:09:00 user nova-compute[74850]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d (non-flash)
Nov 14 01:09:00 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f6ef09-3bc2-46ae-ab72-931a5a46fc9c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:09:00 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:09:00 user nova-compute[74850]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:09:00 user nova-compute[74850]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d (non-flash)
Nov 14 01:09:00 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f6ef09-3bc2-46ae-ab72-931a5a46fc9c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a3c337910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d'): ({'sdc'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-98f6ef09-3bc2-46ae-ab72-931a5a46fc9c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Removing single pathed devices sdc {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e418a261-4033-4405-b6f5-ef9d25f5519e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[123eaab9-626b-4523-bdd6-02458f9239b5]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-98f6ef09-3bc2-46ae-ab72-931a5a46fc9c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Flushing IO for device /dev/sdc {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[997e89f8-3e53-412e-8475-d0225afaa4be]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-98f6ef09-3bc2-46ae-ab72-931a5a46fc9c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d0e490-16a3-4114-8783-28c1d2bef10b]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-98f6ef09-3bc2-46ae-ab72-931a5a46fc9c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-98f6ef09-3bc2-46ae-ab72-931a5a46fc9c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] SCSI volumes sdc have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f6ef09-3bc2-46ae-ab72-931a5a46fc9c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a75da0-8da8-4626-85b9-854cc721caac]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f6ef09-3bc2-46ae-ab72-931a5a46fc9c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[710694ee-558e-4d57-82cd-7c26e91cb894]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f6ef09-3bc2-46ae-ab72-931a5a46fc9c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d, portal: 172.16.0.220,3260]
Nov 14 01:09:00 user nova-compute[74850]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d, portal: 172.16.0.220,3260] successful.
Nov 14 01:09:00 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ffe2e9-10bb-494f-8cbb-eb6342e53b4e]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f6ef09-3bc2-46ae-ab72-931a5a46fc9c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-98f6ef09-3bc2-46ae-ab72-931a5a46fc9c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f6ef09-3bc2-46ae-ab72-931a5a46fc9c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] <== disconnect_volume: return (328ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:09:00 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98f6ef09-3bc2-46ae-ab72-931a5a46fc9c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 01:09:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:09:01 user nova-compute[74850]: DEBUG nova.objects.instance [None req-98f6ef09-3bc2-46ae-ab72-931a5a46fc9c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lazy-loading 'flavor' on Instance uuid 2294e4d8-7e62-4875-822f-bc9020721881 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:09:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-98f6ef09-3bc2-46ae-ab72-931a5a46fc9c tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "2294e4d8-7e62-4875-822f-bc9020721881" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.700s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:09:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "2294e4d8-7e62-4875-822f-bc9020721881" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.590s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:09:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Acquiring lock "2294e4d8-7e62-4875-822f-bc9020721881-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:09:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "2294e4d8-7e62-4875-822f-bc9020721881-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:09:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "2294e4d8-7e62-4875-822f-bc9020721881-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:09:01 user nova-compute[74850]: INFO nova.compute.manager [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Terminating instance
Nov 14 01:09:01 user nova-compute[74850]: DEBUG nova.compute.manager [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 01:09:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:09:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:09:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:09:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:09:01 user nova-compute[74850]: DEBUG nova.compute.manager [req-beba1915-d983-4065-bd28-7b2ca24c02fd req-86c3da76-b6b3-4220-8974-64cbb483e454 service nova] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Received event network-vif-unplugged-2822a7a1-9ee8-4cf0-8019-d6910111297a {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:09:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-beba1915-d983-4065-bd28-7b2ca24c02fd req-86c3da76-b6b3-4220-8974-64cbb483e454 service nova] Acquiring lock "2294e4d8-7e62-4875-822f-bc9020721881-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:09:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-beba1915-d983-4065-bd28-7b2ca24c02fd req-86c3da76-b6b3-4220-8974-64cbb483e454 service nova] Lock "2294e4d8-7e62-4875-822f-bc9020721881-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:09:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-beba1915-d983-4065-bd28-7b2ca24c02fd req-86c3da76-b6b3-4220-8974-64cbb483e454 service nova] Lock "2294e4d8-7e62-4875-822f-bc9020721881-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:09:01 user nova-compute[74850]: DEBUG nova.compute.manager [req-beba1915-d983-4065-bd28-7b2ca24c02fd req-86c3da76-b6b3-4220-8974-64cbb483e454 service nova] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] No waiting events found dispatching network-vif-unplugged-2822a7a1-9ee8-4cf0-8019-d6910111297a {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:09:01 user nova-compute[74850]: DEBUG nova.compute.manager [req-beba1915-d983-4065-bd28-7b2ca24c02fd req-86c3da76-b6b3-4220-8974-64cbb483e454 service nova] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Received event network-vif-unplugged-2822a7a1-9ee8-4cf0-8019-d6910111297a for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 01:09:02 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Instance destroyed successfully.
Nov 14 01:09:02 user nova-compute[74850]: DEBUG nova.objects.instance [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lazy-loading 'resources' on Instance uuid 2294e4d8-7e62-4875-822f-bc9020721881 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:09:02 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:06:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-821876197',display_name='tempest-VolumesSnapshotTestJSON-instance-821876197',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-821876197',id=43,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaTjcArpdQs3aIoEAmtnHXCY79HzOL5GCGOWaCP4CxYbO1Ymf+RMBx2oF5vYKKCsZNRCiKP5IUWLc5moMXp1AKZy4tICMZ3aBmamtPrDe6bqzU280rm1yAgNa6kRP9IAw==',key_name='tempest-keypair-857764945',keypairs=<?>,launch_index=0,launched_at=2023-11-14T01:06:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84022f7a63234abba05ae4e88035fd34',ramdisk_id='',reservation_id='r-ot223e0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1878797663',owner_user_name='tempest-VolumesSnapshotTestJSON-1878797663-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T01:06:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7ab31389a2f415eb08ca3ddaae08ddd',uuid=2294e4d8-7e62-4875-822f-bc9020721881,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2822a7a1-9ee8-4cf0-8019-d6910111297a", "address": "fa:16:3e:8f:6d:ed", "network": {"id": "e822a969-afbd-4415-a246-324f9b0c98ce", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1543025211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84022f7a63234abba05ae4e88035fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2822a7a1-9e", "ovs_interfaceid": "2822a7a1-9ee8-4cf0-8019-d6910111297a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 01:09:02 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Converting VIF {"id": "2822a7a1-9ee8-4cf0-8019-d6910111297a", "address": "fa:16:3e:8f:6d:ed", "network": {"id": "e822a969-afbd-4415-a246-324f9b0c98ce", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1543025211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84022f7a63234abba05ae4e88035fd34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2822a7a1-9e", "ovs_interfaceid": "2822a7a1-9ee8-4cf0-8019-d6910111297a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:09:02 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:6d:ed,bridge_name='br-int',has_traffic_filtering=True,id=2822a7a1-9ee8-4cf0-8019-d6910111297a,network=Network(e822a969-afbd-4415-a246-324f9b0c98ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2822a7a1-9e') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:09:02 user nova-compute[74850]: DEBUG os_vif [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:6d:ed,bridge_name='br-int',has_traffic_filtering=True,id=2822a7a1-9ee8-4cf0-8019-d6910111297a,network=Network(e822a969-afbd-4415-a246-324f9b0c98ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2822a7a1-9e') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 01:09:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:09:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2822a7a1-9e, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:09:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:09:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:09:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:09:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e4257a3-5c4a-45dd-a3f7-39678b8e9be6) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:09:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:09:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:09:02 user nova-compute[74850]: INFO os_vif [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:6d:ed,bridge_name='br-int',has_traffic_filtering=True,id=2822a7a1-9ee8-4cf0-8019-d6910111297a,network=Network(e822a969-afbd-4415-a246-324f9b0c98ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2822a7a1-9e')
Nov 14 01:09:02 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 01:09:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PzJyvIpW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:09:02 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:09:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:09:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:09:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:09:02 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[42236aa8-6e52-43ed-b3f7-65a06f689931]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:09:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 01:09:02 user nova-compute[74850]: No targets found.
Nov 14 01:09:02 user nova-compute[74850]: iSNS:
Nov 14 01:09:02 user nova-compute[74850]: No targets found.
Nov 14 01:09:02 user nova-compute[74850]: STATIC:
Nov 14 01:09:02 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d
Nov 14 01:09:02 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:09:02 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:09:02 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a
Nov 14 01:09:02 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:09:02 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:09:02 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8
Nov 14 01:09:02 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:09:02 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:09:02 user nova-compute[74850]: FIRMWARE:
Nov 14 01:09:02 user nova-compute[74850]: No targets found.
Nov 14 01:09:02 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:09:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 01:09:02 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 01:09:02 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 01:09:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e46c234a-e963-4708-a493-79b0b4a8534d', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 01:09:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:09:02 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81d9c5b-2c88-4021-8e8a-ac28485b6acf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:09:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:09:02 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d5003a-046b-4e9e-83ad-c508c1fd796c]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:09:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:09:02 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:09:02 user nova-compute[74850]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:09:02 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:09:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:09:02 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:09:02 user nova-compute[74850]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:09:02 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:09:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a1c782e60>, {}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 01:09:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Disconnecting from: [] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 01:09:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.078s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:09:02 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] <== disconnect_volume: return (80ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:09:02 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 01:09:02 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Deleting instance files /opt/stack/data/nova/instances/2294e4d8-7e62-4875-822f-bc9020721881_del
Nov 14 01:09:02 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Deletion of /opt/stack/data/nova/instances/2294e4d8-7e62-4875-822f-bc9020721881_del complete
Nov 14 01:09:02 user nova-compute[74850]: INFO nova.compute.manager [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 14 01:09:02 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 01:09:02 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 01:09:02 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 01:09:03 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:09:03 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:09:03 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:09:03 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Took 0.77 seconds to deallocate network for instance.
Nov 14 01:09:03 user nova-compute[74850]: DEBUG nova.compute.manager [req-bf7cbdf4-0b37-4b1b-be5c-1caa83544c85 req-ef57ffb7-d05b-4981-aa71-af914dbefd5c service nova] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Received event network-vif-deleted-2822a7a1-9ee8-4cf0-8019-d6910111297a {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:09:03 user nova-compute[74850]: WARNING nova.volume.cinder [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Attachment a1d2abe0-1f66-4d58-bf00-c6eb68909caf does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = a1d2abe0-1f66-4d58-bf00-c6eb68909caf. (HTTP 404) (Request-ID: req-c17c81e7-8414-4d9b-90dd-68d733294145)
Nov 14 01:09:03 user nova-compute[74850]: INFO nova.compute.manager [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Took 0.02 seconds to detach 1 volumes for instance.
Nov 14 01:09:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:09:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:09:03 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:09:03 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:09:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.248s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:09:03 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Deleted allocations for instance 2294e4d8-7e62-4875-822f-bc9020721881
Nov 14 01:09:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a9cd805b-baf6-49a5-89bf-e43227a709a9 tempest-VolumesSnapshotTestJSON-1878797663 tempest-VolumesSnapshotTestJSON-1878797663-project-member] Lock "2294e4d8-7e62-4875-822f-bc9020721881" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.240s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:09:03 user nova-compute[74850]: DEBUG nova.compute.manager [req-37a618f4-0a9f-4c17-8e42-4387a9f020d1 req-27d1f865-c226-4cf1-89bd-f03bf28bd89c service nova] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Received event network-vif-plugged-2822a7a1-9ee8-4cf0-8019-d6910111297a {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:09:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-37a618f4-0a9f-4c17-8e42-4387a9f020d1 req-27d1f865-c226-4cf1-89bd-f03bf28bd89c service nova] Acquiring lock "2294e4d8-7e62-4875-822f-bc9020721881-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:09:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-37a618f4-0a9f-4c17-8e42-4387a9f020d1 req-27d1f865-c226-4cf1-89bd-f03bf28bd89c service nova] Lock "2294e4d8-7e62-4875-822f-bc9020721881-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:09:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-37a618f4-0a9f-4c17-8e42-4387a9f020d1 req-27d1f865-c226-4cf1-89bd-f03bf28bd89c service nova] Lock "2294e4d8-7e62-4875-822f-bc9020721881-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:09:03 user nova-compute[74850]: DEBUG nova.compute.manager [req-37a618f4-0a9f-4c17-8e42-4387a9f020d1 req-27d1f865-c226-4cf1-89bd-f03bf28bd89c service nova] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] No waiting events found dispatching network-vif-plugged-2822a7a1-9ee8-4cf0-8019-d6910111297a {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:09:03 user nova-compute[74850]: WARNING nova.compute.manager [req-37a618f4-0a9f-4c17-8e42-4387a9f020d1 req-27d1f865-c226-4cf1-89bd-f03bf28bd89c service nova] [instance: 2294e4d8-7e62-4875-822f-bc9020721881] Received unexpected event network-vif-plugged-2822a7a1-9ee8-4cf0-8019-d6910111297a for instance with vm_state deleted and task_state None.
Nov 14 01:09:05 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:09:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:09:06 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:09:06 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:09:06 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 01:09:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:09:07 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:09:07 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:09:08 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:09:09 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:09:09 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 01:09:09 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Didn't find any instances for network info cache update. {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 01:09:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:09:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:09:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:09:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:09:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:09:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:09:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:09:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:09:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:09:30 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:09:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:09:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:09:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:09:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:09:47 user nova-compute[74850]: DEBUG nova.compute.manager [req-6d3a8045-ce1c-4e78-8af3-e644de345ee1 req-5a96f772-5fb5-4c61-a066-5f74e8aa1a6a service nova] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Received event network-changed-5316b921-a92e-4c0f-93df-873d035c4ed0 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:09:47 user nova-compute[74850]: DEBUG nova.compute.manager [req-6d3a8045-ce1c-4e78-8af3-e644de345ee1 req-5a96f772-5fb5-4c61-a066-5f74e8aa1a6a service nova] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Refreshing instance network info cache due to event network-changed-5316b921-a92e-4c0f-93df-873d035c4ed0. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:09:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6d3a8045-ce1c-4e78-8af3-e644de345ee1 req-5a96f772-5fb5-4c61-a066-5f74e8aa1a6a service nova] Acquiring lock "refresh_cache-2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:09:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6d3a8045-ce1c-4e78-8af3-e644de345ee1 req-5a96f772-5fb5-4c61-a066-5f74e8aa1a6a service nova] Acquired lock "refresh_cache-2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:09:47 user nova-compute[74850]: DEBUG nova.network.neutron [req-6d3a8045-ce1c-4e78-8af3-e644de345ee1 req-5a96f772-5fb5-4c61-a066-5f74e8aa1a6a service nova] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Refreshing network info cache for port 5316b921-a92e-4c0f-93df-873d035c4ed0 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:09:48 user nova-compute[74850]: DEBUG nova.network.neutron [req-6d3a8045-ce1c-4e78-8af3-e644de345ee1 req-5a96f772-5fb5-4c61-a066-5f74e8aa1a6a service nova] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Updated VIF entry in instance network info cache for port 5316b921-a92e-4c0f-93df-873d035c4ed0. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:09:48 user nova-compute[74850]: DEBUG nova.network.neutron [req-6d3a8045-ce1c-4e78-8af3-e644de345ee1 req-5a96f772-5fb5-4c61-a066-5f74e8aa1a6a service nova] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Updating instance_info_cache with network_info: [{"id": "5316b921-a92e-4c0f-93df-873d035c4ed0", "address": "fa:16:3e:da:b9:ee", "network": {"id": "75650b3d-1169-46fa-a1cf-7ae51dd28e18", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227679489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3e629e632d444faf3898681aaafa79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5316b921-a9", "ovs_interfaceid": "5316b921-a92e-4c0f-93df-873d035c4ed0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:09:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6d3a8045-ce1c-4e78-8af3-e644de345ee1 req-5a96f772-5fb5-4c61-a066-5f74e8aa1a6a service nova] Releasing lock "refresh_cache-2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:09:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:09:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:09:49 user nova-compute[74850]: DEBUG nova.objects.instance [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lazy-loading 'flavor' on Instance uuid 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:09:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:09:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:09:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:09:49 user nova-compute[74850]: INFO nova.compute.manager [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Attaching volume 4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d to /dev/vdb
Nov 14 01:09:49 user nova-compute[74850]: DEBUG os_brick.utils [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:09:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:09:49 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da6b163-f810-4ed1-801e-74c3d86cf824]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:09:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:09:49 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[085dd40a-df7b-43c8-8014-b10f5feebf5e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:09:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:09:49 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9f01e3-b7f0-4509-961e-ba695f384d2c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:09:49 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fe7289-4fdf-40af-ba42-d8197a68ea0a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:09:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:09:49 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 01:09:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:09:49 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 01:09:49 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7569051-b429-45b2-8266-883c932b2937]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:09:49 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 01:09:49 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 01:09:49 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 01:09:49 user nova-compute[74850]: DEBUG os_brick.utils [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:09:49 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Updating existing volume attachment record: 645f3243-f979-4590-bffe-732f3b982186 {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 01:09:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:09:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:09:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ezcAFhmQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:09:54 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:09:54 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:09:54 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:09:54 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:09:54 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 01:09:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7764677a-acd4-46e8-abee-6a11dd84e841]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 01:09:54 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d24194-8bd4-468d-a761-98f9201cfaad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d] added
Nov 14 01:09:54 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[11cde450-eb7f-4840-9445-31235cf7308b]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2627ee66-249c-4bf5-a2b6-fb7cf9fa45f4]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ezcAFhmQ {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ezcAFhmQ" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[91031b27-9e3e-4d39-bc4c-87f9fa658614]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ezcAFhmQ'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[482c994d-cb92-46db-92e6-17800ca19062]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b0abdc-d86f-469c-92e4-4500002a7be2]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:09:54 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:09:54 user nova-compute[74850]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:09:54 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:09:54 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:09:54 user nova-compute[74850]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:09:54 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fd27ae-b122-4f42-9aef-d9b208f2b7a4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d, portal: 172.16.0.220,3260]
Nov 14 01:09:54 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d, portal: 172.16.0.220,3260] successful.
Nov 14 01:09:54 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a146f6-deee-4eb4-8a3e-d9b06b4e7727]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7aa97ea-dbc5-48a1-87b0-9800ca2ff73b]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:09:54 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:09:54 user nova-compute[74850]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:09:54 user nova-compute[74850]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d (non-flash)
Nov 14 01:09:54 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:09:54 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:09:54 user nova-compute[74850]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:09:54 user nova-compute[74850]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d (non-flash)
Nov 14 01:09:54 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b889920-f75d-48e5-8a7b-7f69dcd1b6b0]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:09:54 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: None {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:09:55 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:09:55 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ezcAFhmQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 01:09:55 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:09:55 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23865663134393237', 'path': '/dev/sdc'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:09:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865663134393237', 'path': '/dev/sdc'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 01:09:55 user nova-compute[74850]: DEBUG nova.objects.instance [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lazy-loading 'flavor' on Instance uuid 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:09:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 01:09:55 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:09:55 user nova-compute[74850]:   <source dev="/dev/sdc"/>
Nov 14 01:09:55 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:09:55 user nova-compute[74850]:   <serial>4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d</serial>
Nov 14 01:09:55 user nova-compute[74850]: </disk>
Nov 14 01:09:55 user nova-compute[74850]:  {{(pid=74850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 01:09:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:09:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:09:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] No VIF found with MAC fa:16:3e:da:b9:ee, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:09:56 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:09:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-0c6bfce2-6b58-47c7-972a-ed8f01abbc34 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.683s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:09:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:09:57 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:09:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:09:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:09:57 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:09:57 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 01:09:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:09:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:09:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:09:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:09:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:09:58 user nova-compute[74850]: DEBUG nova.objects.instance [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lazy-loading 'flavor' on Instance uuid 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:09:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:09:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/709f145b-a471-4a1d-86dc-327e1c3fabb9/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.110s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:09:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/709f145b-a471-4a1d-86dc-327e1c3fabb9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:09:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/709f145b-a471-4a1d-86dc-327e1c3fabb9/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:09:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:09:59 user nova-compute[74850]: INFO nova.compute.manager [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Attaching volume 20d5d44f-e942-487f-b2d6-c84ec4ce7be0 to /dev/vdc
Nov 14 01:09:59 user nova-compute[74850]: DEBUG os_brick.utils [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:09:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:09:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ce4ffa-ea91-4da1-9e68-9072617afa50]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:09:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:09:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40165bc-c6a9-41cb-9116-ec8912f68cdb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:09:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:09:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8cbbb2-0366-4c46-aa19-d1947c914ce2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:09:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8853304-0773-4952-b39d-03142bc0bccb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:09:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:09:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 01:09:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/709f145b-a471-4a1d-86dc-327e1c3fabb9/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:09:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:09:59 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 01:09:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b965be6-1b83-4309-b4c8-903ec838a441]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:09:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 01:09:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 01:09:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 01:09:59 user nova-compute[74850]: DEBUG os_brick.utils [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:09:59 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Updating existing volume attachment record: a8a3799b-d699-4357-abc5-02bb79490448 {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 01:09:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:09:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:09:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:09:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:09:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:09:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:09:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:10:00 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:10:00 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:10:00 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=8195MB free_disk=24.855243682861328GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 01:10:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:10:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:10:00 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance c7952bff-87d6-46c1-a6d4-7729dc4893ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:10:00 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 702746f7-305f-4eac-a71a-6c08b7cbccd8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:10:00 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 3504ddd3-bdd8-465e-aec5-190acdd563f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:10:00 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance e6e38d20-9aac-4037-b1b4-0c25005a9a67 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:10:00 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:10:00 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance ffaf0225-770f-4c7c-8fde-7aa258e5fc7c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:10:00 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 709f145b-a471-4a1d-86dc-327e1c3fabb9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:10:00 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 01:10:00 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 01:10:00 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:10:00 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:10:00 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 01:10:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.379s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:10:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:10:02 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:10:02 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lpkxMNci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:10:03 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:10:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:10:03 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:10:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:10:03 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 01:10:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa334be-88a9-4bc1-9be2-9d07da2aa69e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 01:10:03 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[011e2c30-297f-4f5c-a006-83479a1087a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0] added
Nov 14 01:10:03 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0779ac1f-cb8e-4f91-b6f7-75a9cd8f23a8]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3305fd-dc82-470a-8676-f22e89fbc1f8]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lpkxMNci {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lpkxMNci" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a652809-5727-4dc8-aa8f-33c2abecf2da]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lpkxMNci'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd753a82-9fc5-4fa6-a088-68d0f2ad54ad]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b3e19f-3e2e-40ff-b726-a81dac55208c]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:10:03 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:10:03 user nova-compute[74850]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:10:03 user nova-compute[74850]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d (non-flash)
Nov 14 01:10:03 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:10:03 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:10:03 user nova-compute[74850]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:10:03 user nova-compute[74850]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d (non-flash)
Nov 14 01:10:03 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acdcdaa-7f01-48f1-a967-7f44357157e0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0, portal: 172.16.0.220,3260]
Nov 14 01:10:03 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0, portal: 172.16.0.220,3260] successful.
Nov 14 01:10:03 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[78dcd69c-b849-4f9b-b589-75f74f6aa62f]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[880fe0d8-6658-487f-b5f9-b911bd45dd01]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:10:03 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:10:03 user nova-compute[74850]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:10:03 user nova-compute[74850]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d (non-flash)
Nov 14 01:10:03 user nova-compute[74850]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 (non-flash)
Nov 14 01:10:03 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:10:03 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:10:03 user nova-compute[74850]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:10:03 user nova-compute[74850]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d (non-flash)
Nov 14 01:10:03 user nova-compute[74850]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 (non-flash)
Nov 14 01:10:03 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] HCTL ('36', '-', '-', 0) found on session 50 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a899d208-624d-48dd-ab8a-0906ed06bb67]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:03 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Searching for a device in session 50 and hctl ['36', '*', '*', 0] yield: None {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:10:04 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Searching for a device in session 50 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:10:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lpkxMNci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 01:10:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:10:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26434346162643232', 'path': '/dev/sde'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:10:05 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434346162643232', 'path': '/dev/sde'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 01:10:05 user nova-compute[74850]: DEBUG nova.objects.instance [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lazy-loading 'flavor' on Instance uuid 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:10:05 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 01:10:05 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:10:05 user nova-compute[74850]:   <source dev="/dev/sde"/>
Nov 14 01:10:05 user nova-compute[74850]:   <target dev="vdc" bus="virtio"/>
Nov 14 01:10:05 user nova-compute[74850]:   <serial>20d5d44f-e942-487f-b2d6-c84ec4ce7be0</serial>
Nov 14 01:10:05 user nova-compute[74850]: </disk>
Nov 14 01:10:05 user nova-compute[74850]:  {{(pid=74850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 01:10:05 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:10:05 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:10:05 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:10:05 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] No VIF found with MAC fa:16:3e:da:b9:ee, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:10:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a578069a-8907-458d-bed9-5f64b9ab07c5 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.724s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:10:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:06 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:10:06 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:10:06 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:10:06 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 01:10:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b66ea83e-46b6-4c5f-bb9f-be3645a1f268 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:10:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b66ea83e-46b6-4c5f-bb9f-be3645a1f268 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:10:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:07 user nova-compute[74850]: INFO nova.compute.manager [None req-b66ea83e-46b6-4c5f-bb9f-be3645a1f268 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Detaching volume 4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d
Nov 14 01:10:07 user nova-compute[74850]: INFO nova.virt.block_device [None req-b66ea83e-46b6-4c5f-bb9f-be3645a1f268 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Attempting to driver detach volume 4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d from mountpoint /dev/vdb
Nov 14 01:10:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b66ea83e-46b6-4c5f-bb9f-be3645a1f268 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Attempting to detach device vdb from instance 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe from the persistent domain config. {{(pid=74850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 01:10:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-b66ea83e-46b6-4c5f-bb9f-be3645a1f268 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:10:07 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:10:07 user nova-compute[74850]:   <source dev="/dev/sdc"/>
Nov 14 01:10:07 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:10:07 user nova-compute[74850]:   <serial>4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d</serial>
Nov 14 01:10:07 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 01:10:07 user nova-compute[74850]: </disk>
Nov 14 01:10:07 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:10:07 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-b66ea83e-46b6-4c5f-bb9f-be3645a1f268 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Successfully detached device vdb from instance 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe from the persistent domain config.
Nov 14 01:10:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b66ea83e-46b6-4c5f-bb9f-be3645a1f268 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe from the live domain config. {{(pid=74850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 01:10:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-b66ea83e-46b6-4c5f-bb9f-be3645a1f268 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:10:07 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:10:07 user nova-compute[74850]:   <source dev="/dev/sdc"/>
Nov 14 01:10:07 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:10:07 user nova-compute[74850]:   <serial>4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d</serial>
Nov 14 01:10:07 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 01:10:07 user nova-compute[74850]: </disk>
Nov 14 01:10:07 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:10:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b66ea83e-46b6-4c5f-bb9f-be3645a1f268 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe {{(pid=74850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 01:10:09 user nova-compute[74850]: DEBUG nova.compute.manager [req-d61578b6-6927-4b33-ba54-cf0f8a3eed31 req-a09bf519-cff1-4fd6-84cc-22e4fad3e45e service nova] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Received event network-changed-85fc032b-0133-484f-a7ae-35602c304d7c {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:10:09 user nova-compute[74850]: DEBUG nova.compute.manager [req-d61578b6-6927-4b33-ba54-cf0f8a3eed31 req-a09bf519-cff1-4fd6-84cc-22e4fad3e45e service nova] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Refreshing instance network info cache due to event network-changed-85fc032b-0133-484f-a7ae-35602c304d7c. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:10:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d61578b6-6927-4b33-ba54-cf0f8a3eed31 req-a09bf519-cff1-4fd6-84cc-22e4fad3e45e service nova] Acquiring lock "refresh_cache-ffaf0225-770f-4c7c-8fde-7aa258e5fc7c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:10:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d61578b6-6927-4b33-ba54-cf0f8a3eed31 req-a09bf519-cff1-4fd6-84cc-22e4fad3e45e service nova] Acquired lock "refresh_cache-ffaf0225-770f-4c7c-8fde-7aa258e5fc7c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:10:09 user nova-compute[74850]: DEBUG nova.network.neutron [req-d61578b6-6927-4b33-ba54-cf0f8a3eed31 req-a09bf519-cff1-4fd6-84cc-22e4fad3e45e service nova] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Refreshing network info cache for port 85fc032b-0133-484f-a7ae-35602c304d7c {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:10:09 user nova-compute[74850]: DEBUG nova.network.neutron [req-d61578b6-6927-4b33-ba54-cf0f8a3eed31 req-a09bf519-cff1-4fd6-84cc-22e4fad3e45e service nova] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Updated VIF entry in instance network info cache for port 85fc032b-0133-484f-a7ae-35602c304d7c. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:10:09 user nova-compute[74850]: DEBUG nova.network.neutron [req-d61578b6-6927-4b33-ba54-cf0f8a3eed31 req-a09bf519-cff1-4fd6-84cc-22e4fad3e45e service nova] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Updating instance_info_cache with network_info: [{"id": "85fc032b-0133-484f-a7ae-35602c304d7c", "address": "fa:16:3e:7f:c7:b6", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fc032b-01", "ovs_interfaceid": "85fc032b-0133-484f-a7ae-35602c304d7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:10:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d61578b6-6927-4b33-ba54-cf0f8a3eed31 req-a09bf519-cff1-4fd6-84cc-22e4fad3e45e service nova] Releasing lock "refresh_cache-ffaf0225-770f-4c7c-8fde-7aa258e5fc7c" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:10:09 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:10:09 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 01:10:09 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Rebuilding the list of instances to heal {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 01:10:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "refresh_cache-c7952bff-87d6-46c1-a6d4-7729dc4893ff" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:10:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquired lock "refresh_cache-c7952bff-87d6-46c1-a6d4-7729dc4893ff" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:10:10 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Forcefully refreshing network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 01:10:10 user nova-compute[74850]: DEBUG nova.objects.instance [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lazy-loading 'info_cache' on Instance uuid c7952bff-87d6-46c1-a6d4-7729dc4893ff {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:10:10 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Updating instance_info_cache with network_info: [{"id": "de35d2a9-b199-4dbc-8394-915938223e27", "address": "fa:16:3e:b9:56:80", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde35d2a9-b1", "ovs_interfaceid": "de35d2a9-b199-4dbc-8394-915938223e27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:10:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Releasing lock "refresh_cache-c7952bff-87d6-46c1-a6d4-7729dc4893ff" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:10:10 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Updated the network info_cache for instance {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 01:10:10 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:10:10 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:10:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "ffaf0225-770f-4c7c-8fde-7aa258e5fc7c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:10:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "ffaf0225-770f-4c7c-8fde-7aa258e5fc7c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:10:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "ffaf0225-770f-4c7c-8fde-7aa258e5fc7c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:10:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "ffaf0225-770f-4c7c-8fde-7aa258e5fc7c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:10:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "ffaf0225-770f-4c7c-8fde-7aa258e5fc7c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:10:10 user nova-compute[74850]: INFO nova.compute.manager [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Terminating instance
Nov 14 01:10:10 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 01:10:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG nova.compute.manager [req-b003ebef-a7d4-4820-8e24-6633b7f96d06 req-6f0167ec-ca43-4ef1-91da-718ba5e953a7 service nova] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Received event network-vif-unplugged-85fc032b-0133-484f-a7ae-35602c304d7c {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b003ebef-a7d4-4820-8e24-6633b7f96d06 req-6f0167ec-ca43-4ef1-91da-718ba5e953a7 service nova] Acquiring lock "ffaf0225-770f-4c7c-8fde-7aa258e5fc7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b003ebef-a7d4-4820-8e24-6633b7f96d06 req-6f0167ec-ca43-4ef1-91da-718ba5e953a7 service nova] Lock "ffaf0225-770f-4c7c-8fde-7aa258e5fc7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b003ebef-a7d4-4820-8e24-6633b7f96d06 req-6f0167ec-ca43-4ef1-91da-718ba5e953a7 service nova] Lock "ffaf0225-770f-4c7c-8fde-7aa258e5fc7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG nova.compute.manager [req-b003ebef-a7d4-4820-8e24-6633b7f96d06 req-6f0167ec-ca43-4ef1-91da-718ba5e953a7 service nova] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] No waiting events found dispatching network-vif-unplugged-85fc032b-0133-484f-a7ae-35602c304d7c {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG nova.compute.manager [req-b003ebef-a7d4-4820-8e24-6633b7f96d06 req-6f0167ec-ca43-4ef1-91da-718ba5e953a7 service nova] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Received event network-vif-unplugged-85fc032b-0133-484f-a7ae-35602c304d7c for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 01:10:11 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Instance destroyed successfully.
Nov 14 01:10:11 user nova-compute[74850]: DEBUG nova.objects.instance [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lazy-loading 'resources' on Instance uuid ffaf0225-770f-4c7c-8fde-7aa258e5fc7c {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:08:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-487679215',display_name='tempest-TestVolumeBootPattern-server-487679215',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-487679215',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA94n5zD/7RpobhW+jYq5sAS9UK4izFU1jEjxsSgfhAiBUC2oNIUdSW107BwtkqMZ7Uku+sA2LquAPtuZM0gk2nZsUp6hWLP86Pz4tdmgGXQVoyyrGsrxeP25l2IFQWByQ==',key_name='tempest-TestVolumeBootPattern-543311029',keypairs=<?>,launch_index=0,launched_at=2023-11-14T01:08:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fdb1eb4b5fc841d1952b8db9ae05e446',ramdisk_id='',reservation_id='r-25turqwd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1536334624',owner_user_name='tempest-TestVolumeBootPattern-1536334624-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T01:08:28Z,user_data=None,user_id='6c91ddcee4e54a769eb626c816596bed',uuid=ffaf0225-770f-4c7c-8fde-7aa258e5fc7c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85fc032b-0133-484f-a7ae-35602c304d7c", "address": "fa:16:3e:7f:c7:b6", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fc032b-01", "ovs_interfaceid": "85fc032b-0133-484f-a7ae-35602c304d7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Converting VIF {"id": "85fc032b-0133-484f-a7ae-35602c304d7c", "address": "fa:16:3e:7f:c7:b6", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fc032b-01", "ovs_interfaceid": "85fc032b-0133-484f-a7ae-35602c304d7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:c7:b6,bridge_name='br-int',has_traffic_filtering=True,id=85fc032b-0133-484f-a7ae-35602c304d7c,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85fc032b-01') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG os_vif [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:c7:b6,bridge_name='br-int',has_traffic_filtering=True,id=85fc032b-0133-484f-a7ae-35602c304d7c,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85fc032b-01') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85fc032b-01, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0703443a-8427-4c1b-9b0a-936b23d51eb4) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:11 user nova-compute[74850]: INFO os_vif [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:c7:b6,bridge_name='br-int',has_traffic_filtering=True,id=85fc032b-0133-484f-a7ae-35602c304d7c,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85fc032b-01')
Nov 14 01:10:11 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'empAbWLq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:10:11 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:10:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67d6ad4-713c-4186-a4f4-d0992ed09485]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 01:10:11 user nova-compute[74850]: No targets found.
Nov 14 01:10:11 user nova-compute[74850]: iSNS:
Nov 14 01:10:11 user nova-compute[74850]: No targets found.
Nov 14 01:10:11 user nova-compute[74850]: STATIC:
Nov 14 01:10:11 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d
Nov 14 01:10:11 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:10:11 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:10:11 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d
Nov 14 01:10:11 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:10:11 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:10:11 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a
Nov 14 01:10:11 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:10:11 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:10:11 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8
Nov 14 01:10:11 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:10:11 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:10:11 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0
Nov 14 01:10:11 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:10:11 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:10:11 user nova-compute[74850]: FIRMWARE:
Nov 14 01:10:11 user nova-compute[74850]: No targets found.
Nov 14 01:10:11 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 01:10:11 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 01:10:11 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4bb4cd-dd42-422d-974e-4b40bc858b9c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8ffdc9-d949-4cda-9ea7-ead0b160dcd3]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:10:11 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:10:11 user nova-compute[74850]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:10:11 user nova-compute[74850]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d (non-flash)
Nov 14 01:10:11 user nova-compute[74850]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 (non-flash)
Nov 14 01:10:11 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:10:11 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:10:11 user nova-compute[74850]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:10:11 user nova-compute[74850]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d (non-flash)
Nov 14 01:10:11 user nova-compute[74850]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 (non-flash)
Nov 14 01:10:11 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a3c137640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8'): ({'sdb'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Removing single pathed devices sdb {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[02077dd8-1dae-4ce2-9fb8-4e7f2e390bf6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9289a4c9-c0eb-41ab-b6a2-06b7b78fb84d]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Flushing IO for device /dev/sdb {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[731a962e-63bd-441b-b7cb-79404a65ccdb]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.069s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49840af-5e33-4874-91b2-fc44cc718bce]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c059f6e-2abc-40be-8f23-30b4b63dbfa6]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7594e96-6bc2-430c-9cba-358a2c5cd1b9]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8, portal: 172.16.0.220,3260]
Nov 14 01:10:11 user nova-compute[74850]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8, portal: 172.16.0.220,3260] successful.
Nov 14 01:10:11 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acd9c6f-99a8-41eb-b1c3-0bbdcb2d57c4]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] <== disconnect_volume: return (357ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 01:10:11 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Deleting instance files /opt/stack/data/nova/instances/ffaf0225-770f-4c7c-8fde-7aa258e5fc7c_del
Nov 14 01:10:11 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Deletion of /opt/stack/data/nova/instances/ffaf0225-770f-4c7c-8fde-7aa258e5fc7c_del complete
Nov 14 01:10:11 user nova-compute[74850]: INFO nova.compute.manager [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 14 01:10:11 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 01:10:11 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 01:10:12 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:10:12 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Took 0.72 seconds to deallocate network for instance.
Nov 14 01:10:13 user nova-compute[74850]: DEBUG nova.compute.manager [req-8bea8e41-45bf-4841-b27e-29a24812abb6 req-52af555b-0b60-4e39-8f07-11ded3e6d4a0 service nova] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Received event network-vif-plugged-85fc032b-0133-484f-a7ae-35602c304d7c {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:10:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-8bea8e41-45bf-4841-b27e-29a24812abb6 req-52af555b-0b60-4e39-8f07-11ded3e6d4a0 service nova] Acquiring lock "ffaf0225-770f-4c7c-8fde-7aa258e5fc7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:10:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-8bea8e41-45bf-4841-b27e-29a24812abb6 req-52af555b-0b60-4e39-8f07-11ded3e6d4a0 service nova] Lock "ffaf0225-770f-4c7c-8fde-7aa258e5fc7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:10:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-8bea8e41-45bf-4841-b27e-29a24812abb6 req-52af555b-0b60-4e39-8f07-11ded3e6d4a0 service nova] Lock "ffaf0225-770f-4c7c-8fde-7aa258e5fc7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:10:13 user nova-compute[74850]: DEBUG nova.compute.manager [req-8bea8e41-45bf-4841-b27e-29a24812abb6 req-52af555b-0b60-4e39-8f07-11ded3e6d4a0 service nova] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] No waiting events found dispatching network-vif-plugged-85fc032b-0133-484f-a7ae-35602c304d7c {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:10:13 user nova-compute[74850]: WARNING nova.compute.manager [req-8bea8e41-45bf-4841-b27e-29a24812abb6 req-52af555b-0b60-4e39-8f07-11ded3e6d4a0 service nova] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Received unexpected event network-vif-plugged-85fc032b-0133-484f-a7ae-35602c304d7c for instance with vm_state active and task_state deleting.
Nov 14 01:10:13 user nova-compute[74850]: DEBUG nova.compute.manager [req-8bea8e41-45bf-4841-b27e-29a24812abb6 req-52af555b-0b60-4e39-8f07-11ded3e6d4a0 service nova] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Received event network-vif-deleted-85fc032b-0133-484f-a7ae-35602c304d7c {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:10:13 user nova-compute[74850]: INFO nova.compute.manager [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: ffaf0225-770f-4c7c-8fde-7aa258e5fc7c] Took 0.73 seconds to detach 1 volumes for instance.
Nov 14 01:10:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:10:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:10:13 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:10:13 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:10:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.243s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:10:13 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Deleted allocations for instance ffaf0225-770f-4c7c-8fde-7aa258e5fc7c
Nov 14 01:10:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6935be49-ed4e-44af-9c4e-989739dffee2 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "ffaf0225-770f-4c7c-8fde-7aa258e5fc7c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.377s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:10:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "efa96c60-9902-4ca9-8f0e-d27bdb883829" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:10:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "efa96c60-9902-4ca9-8f0e-d27bdb883829" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:10:16 user nova-compute[74850]: INFO nova.compute.manager [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Unshelving
Nov 14 01:10:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:10:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:10:17 user nova-compute[74850]: DEBUG nova.objects.instance [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lazy-loading 'pci_requests' on Instance uuid efa96c60-9902-4ca9-8f0e-d27bdb883829 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:10:17 user nova-compute[74850]: DEBUG nova.objects.instance [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lazy-loading 'numa_topology' on Instance uuid efa96c60-9902-4ca9-8f0e-d27bdb883829 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:10:17 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 01:10:17 user nova-compute[74850]: INFO nova.compute.claims [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Claim successful on node user
Nov 14 01:10:17 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:10:17 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:10:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.341s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:10:17 user nova-compute[74850]: INFO nova.network.neutron [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Updating port 5e053f78-6ef6-4f30-aedb-30306f10975b with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 01:10:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "refresh_cache-efa96c60-9902-4ca9-8f0e-d27bdb883829" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:10:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquired lock "refresh_cache-efa96c60-9902-4ca9-8f0e-d27bdb883829" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:10:18 user nova-compute[74850]: DEBUG nova.network.neutron [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 01:10:18 user nova-compute[74850]: DEBUG nova.compute.manager [req-8dc03495-e3e6-4c91-aeb2-570d3c5f1cc8 req-b1b40d06-15b8-4e47-af8e-60a37d1de671 service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Received event network-changed-5e053f78-6ef6-4f30-aedb-30306f10975b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:10:18 user nova-compute[74850]: DEBUG nova.compute.manager [req-8dc03495-e3e6-4c91-aeb2-570d3c5f1cc8 req-b1b40d06-15b8-4e47-af8e-60a37d1de671 service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Refreshing instance network info cache due to event network-changed-5e053f78-6ef6-4f30-aedb-30306f10975b. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:10:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-8dc03495-e3e6-4c91-aeb2-570d3c5f1cc8 req-b1b40d06-15b8-4e47-af8e-60a37d1de671 service nova] Acquiring lock "refresh_cache-efa96c60-9902-4ca9-8f0e-d27bdb883829" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:10:18 user nova-compute[74850]: DEBUG nova.network.neutron [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Updating instance_info_cache with network_info: [{"id": "5e053f78-6ef6-4f30-aedb-30306f10975b", "address": "fa:16:3e:fc:2e:f2", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e053f78-6e", "ovs_interfaceid": "5e053f78-6ef6-4f30-aedb-30306f10975b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:10:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Releasing lock "refresh_cache-efa96c60-9902-4ca9-8f0e-d27bdb883829" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:10:18 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 01:10:18 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Creating image(s)
Nov 14 01:10:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "/opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:10:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "/opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:10:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "/opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:10:18 user nova-compute[74850]: DEBUG nova.objects.instance [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lazy-loading 'trusted_certs' on Instance uuid efa96c60-9902-4ca9-8f0e-d27bdb883829 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:10:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-8dc03495-e3e6-4c91-aeb2-570d3c5f1cc8 req-b1b40d06-15b8-4e47-af8e-60a37d1de671 service nova] Acquired lock "refresh_cache-efa96c60-9902-4ca9-8f0e-d27bdb883829" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:10:18 user nova-compute[74850]: DEBUG nova.network.neutron [req-8dc03495-e3e6-4c91-aeb2-570d3c5f1cc8 req-b1b40d06-15b8-4e47-af8e-60a37d1de671 service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Refreshing network info cache for port 5e053f78-6ef6-4f30-aedb-30306f10975b {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:10:18 user nova-compute[74850]: DEBUG nova.objects.base [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Object Instance<efa96c60-9902-4ca9-8f0e-d27bdb883829> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 01:10:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "4ff42bc5edc5530bc20395ebf052158a647fe2e1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:10:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "4ff42bc5edc5530bc20395ebf052158a647fe2e1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:10:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ff42bc5edc5530bc20395ebf052158a647fe2e1.part --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ff42bc5edc5530bc20395ebf052158a647fe2e1.part --force-share --output=json" returned: 0 in 0.173s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:19 user nova-compute[74850]: DEBUG nova.virt.images [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] 3affc2ae-0eb0-415e-ae25-970cfd84dca7 was qcow2, converting to raw {{(pid=74850) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 01:10:19 user nova-compute[74850]: DEBUG nova.privsep.utils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74850) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 01:10:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4ff42bc5edc5530bc20395ebf052158a647fe2e1.part /opt/stack/data/nova/instances/_base/4ff42bc5edc5530bc20395ebf052158a647fe2e1.converted {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:20 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4ff42bc5edc5530bc20395ebf052158a647fe2e1.part /opt/stack/data/nova/instances/_base/4ff42bc5edc5530bc20395ebf052158a647fe2e1.converted" returned: 0 in 0.268s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:20 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ff42bc5edc5530bc20395ebf052158a647fe2e1.converted --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:20 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ff42bc5edc5530bc20395ebf052158a647fe2e1.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "4ff42bc5edc5530bc20395ebf052158a647fe2e1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.771s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:10:20 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ff42bc5edc5530bc20395ebf052158a647fe2e1 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:20 user nova-compute[74850]: DEBUG nova.network.neutron [req-8dc03495-e3e6-4c91-aeb2-570d3c5f1cc8 req-b1b40d06-15b8-4e47-af8e-60a37d1de671 service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Updated VIF entry in instance network info cache for port 5e053f78-6ef6-4f30-aedb-30306f10975b. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:10:20 user nova-compute[74850]: DEBUG nova.network.neutron [req-8dc03495-e3e6-4c91-aeb2-570d3c5f1cc8 req-b1b40d06-15b8-4e47-af8e-60a37d1de671 service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Updating instance_info_cache with network_info: [{"id": "5e053f78-6ef6-4f30-aedb-30306f10975b", "address": "fa:16:3e:fc:2e:f2", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e053f78-6e", "ovs_interfaceid": "5e053f78-6ef6-4f30-aedb-30306f10975b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:10:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-8dc03495-e3e6-4c91-aeb2-570d3c5f1cc8 req-b1b40d06-15b8-4e47-af8e-60a37d1de671 service nova] Releasing lock "refresh_cache-efa96c60-9902-4ca9-8f0e-d27bdb883829" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:10:20 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ff42bc5edc5530bc20395ebf052158a647fe2e1 --force-share --output=json" returned: 0 in 0.200s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "4ff42bc5edc5530bc20395ebf052158a647fe2e1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:10:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "4ff42bc5edc5530bc20395ebf052158a647fe2e1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:10:20 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ff42bc5edc5530bc20395ebf052158a647fe2e1 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:20 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ff42bc5edc5530bc20395ebf052158a647fe2e1 --force-share --output=json" returned: 0 in 0.185s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:20 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ff42bc5edc5530bc20395ebf052158a647fe2e1,backing_fmt=raw /opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:20 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ff42bc5edc5530bc20395ebf052158a647fe2e1,backing_fmt=raw /opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/disk 1073741824" returned: 0 in 0.063s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "4ff42bc5edc5530bc20395ebf052158a647fe2e1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:10:20 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ff42bc5edc5530bc20395ebf052158a647fe2e1 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:20 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ff42bc5edc5530bc20395ebf052158a647fe2e1 --force-share --output=json" returned: 0 in 0.206s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:21 user nova-compute[74850]: DEBUG nova.objects.instance [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lazy-loading 'migration_context' on Instance uuid efa96c60-9902-4ca9-8f0e-d27bdb883829 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:10:21 user nova-compute[74850]: DEBUG nova.objects.base [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Object Instance<efa96c60-9902-4ca9-8f0e-d27bdb883829> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 01:10:21 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Rebasing disk image.
Nov 14 01:10:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.198s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 -F raw /opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/disk {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 -F raw /opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/disk" returned: 0 in 1.998s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Ensure instance console log exists: /opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Start _get_guest_xml network_info=[{"id": "5e053f78-6ef6-4f30-aedb-30306f10975b", "address": "fa:16:3e:fc:2e:f2", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e053f78-6e", "ovs_interfaceid": "5e053f78-6ef6-4f30-aedb-30306f10975b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b128fbd091df79277be4c995976455b8',container_format='bare',created_at=2023-11-14T01:08:24Z,direct_url=<?>,disk_format='qcow2',id=3affc2ae-0eb0-415e-ae25-970cfd84dca7,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-133275307-shelved',owner='e396f5de82e54abfa812bf8a7e89b0c4',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T01:08:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 01:10:23 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:10:23 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:10:23 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b128fbd091df79277be4c995976455b8',container_format='bare',created_at=2023-11-14T01:08:24Z,direct_url=<?>,disk_format='qcow2',id=3affc2ae-0eb0-415e-ae25-970cfd84dca7,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-133275307-shelved',owner='e396f5de82e54abfa812bf8a7e89b0c4',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T01:08:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG nova.objects.instance [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lazy-loading 'vcpu_model' on Instance uuid efa96c60-9902-4ca9-8f0e-d27bdb883829 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG nova.objects.base [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Object Instance<efa96c60-9902-4ca9-8f0e-d27bdb883829> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T01:06:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-133275307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-133275307',id=42,image_ref='3affc2ae-0eb0-415e-ae25-970cfd84dca7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1001532645',keypairs=<?>,launch_index=0,launched_at=2023-11-14T01:06:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e396f5de82e54abfa812bf8a7e89b0c4',ramdisk_id='',reservation_id='r-gpaxa90f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-270753956',owner_user_name='tempest-AttachVolumeShelveTestJSON-270753956-project-member',shelved_at='2023-11-14T01:08:28.655972',shelved_host='user',shelved_image_id='3affc2ae-0eb0-415e-ae25-970cfd84dca7'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:10:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe8332d8221a49db86a402c5851b4882',uuid=efa96c60-9902-4ca9-8f0e-d27bdb883829,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5e053f78-6ef6-4f30-aedb-30306f10975b", "address": "fa:16:3e:fc:2e:f2", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e053f78-6e", "ovs_interfaceid": "5e053f78-6ef6-4f30-aedb-30306f10975b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Converting VIF {"id": "5e053f78-6ef6-4f30-aedb-30306f10975b", "address": "fa:16:3e:fc:2e:f2", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e053f78-6e", "ovs_interfaceid": "5e053f78-6ef6-4f30-aedb-30306f10975b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:2e:f2,bridge_name='br-int',has_traffic_filtering=True,id=5e053f78-6ef6-4f30-aedb-30306f10975b,network=Network(dfd22096-9f0c-4e0f-aac4-06c224b5b9f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e053f78-6e') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG nova.objects.instance [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lazy-loading 'pci_devices' on Instance uuid efa96c60-9902-4ca9-8f0e-d27bdb883829 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG nova.objects.base [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Object Instance<efa96c60-9902-4ca9-8f0e-d27bdb883829> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] End _get_guest_xml xml=<domain type="kvm">
Nov 14 01:10:23 user nova-compute[74850]:   <uuid>efa96c60-9902-4ca9-8f0e-d27bdb883829</uuid>
Nov 14 01:10:23 user nova-compute[74850]:   <name>instance-0000002a</name>
Nov 14 01:10:23 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 01:10:23 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 01:10:23 user nova-compute[74850]:   <metadata>
Nov 14 01:10:23 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 01:10:23 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 01:10:23 user nova-compute[74850]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-133275307</nova:name>
Nov 14 01:10:23 user nova-compute[74850]:       <nova:creationTime>2023-11-14 01:10:23</nova:creationTime>
Nov 14 01:10:23 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 01:10:23 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 01:10:23 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 01:10:23 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 01:10:23 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 01:10:23 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 01:10:23 user nova-compute[74850]:       </nova:flavor>
Nov 14 01:10:23 user nova-compute[74850]:       <nova:owner>
Nov 14 01:10:23 user nova-compute[74850]:         <nova:user uuid="fe8332d8221a49db86a402c5851b4882">tempest-AttachVolumeShelveTestJSON-270753956-project-member</nova:user>
Nov 14 01:10:23 user nova-compute[74850]:         <nova:project uuid="e396f5de82e54abfa812bf8a7e89b0c4">tempest-AttachVolumeShelveTestJSON-270753956</nova:project>
Nov 14 01:10:23 user nova-compute[74850]:       </nova:owner>
Nov 14 01:10:23 user nova-compute[74850]:       <nova:root type="image" uuid="3affc2ae-0eb0-415e-ae25-970cfd84dca7"/>
Nov 14 01:10:23 user nova-compute[74850]:       <nova:ports>
Nov 14 01:10:23 user nova-compute[74850]:         <nova:port uuid="5e053f78-6ef6-4f30-aedb-30306f10975b">
Nov 14 01:10:23 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 01:10:23 user nova-compute[74850]:         </nova:port>
Nov 14 01:10:23 user nova-compute[74850]:       </nova:ports>
Nov 14 01:10:23 user nova-compute[74850]:     </nova:instance>
Nov 14 01:10:23 user nova-compute[74850]:   </metadata>
Nov 14 01:10:23 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 01:10:23 user nova-compute[74850]:     <system>
Nov 14 01:10:23 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 01:10:23 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 01:10:23 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 01:10:23 user nova-compute[74850]:       <entry name="serial">efa96c60-9902-4ca9-8f0e-d27bdb883829</entry>
Nov 14 01:10:23 user nova-compute[74850]:       <entry name="uuid">efa96c60-9902-4ca9-8f0e-d27bdb883829</entry>
Nov 14 01:10:23 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 01:10:23 user nova-compute[74850]:     </system>
Nov 14 01:10:23 user nova-compute[74850]:   </sysinfo>
Nov 14 01:10:23 user nova-compute[74850]:   <os>
Nov 14 01:10:23 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 01:10:23 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 01:10:23 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 01:10:23 user nova-compute[74850]:   </os>
Nov 14 01:10:23 user nova-compute[74850]:   <features>
Nov 14 01:10:23 user nova-compute[74850]:     <acpi/>
Nov 14 01:10:23 user nova-compute[74850]:     <apic/>
Nov 14 01:10:23 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 01:10:23 user nova-compute[74850]:   </features>
Nov 14 01:10:23 user nova-compute[74850]:   <clock offset="utc">
Nov 14 01:10:23 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 01:10:23 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 01:10:23 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 01:10:23 user nova-compute[74850]:   </clock>
Nov 14 01:10:23 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 01:10:23 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 01:10:23 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 01:10:23 user nova-compute[74850]:   </cpu>
Nov 14 01:10:23 user nova-compute[74850]:   <devices>
Nov 14 01:10:23 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 01:10:23 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 01:10:23 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/disk"/>
Nov 14 01:10:23 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 01:10:23 user nova-compute[74850]:     </disk>
Nov 14 01:10:23 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 01:10:23 user nova-compute[74850]:       <mac address="fa:16:3e:fc:2e:f2"/>
Nov 14 01:10:23 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:10:23 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 01:10:23 user nova-compute[74850]:       <target dev="tap5e053f78-6e"/>
Nov 14 01:10:23 user nova-compute[74850]:     </interface>
Nov 14 01:10:23 user nova-compute[74850]:     <serial type="pty">
Nov 14 01:10:23 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/console.log" append="off"/>
Nov 14 01:10:23 user nova-compute[74850]:     </serial>
Nov 14 01:10:23 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 01:10:23 user nova-compute[74850]:     <video>
Nov 14 01:10:23 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:10:23 user nova-compute[74850]:     </video>
Nov 14 01:10:23 user nova-compute[74850]:     <rng model="virtio">
Nov 14 01:10:23 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 01:10:23 user nova-compute[74850]:     </rng>
Nov 14 01:10:23 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 01:10:23 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 01:10:23 user nova-compute[74850]:       <stats period="10"/>
Nov 14 01:10:23 user nova-compute[74850]:     </memballoon>
Nov 14 01:10:23 user nova-compute[74850]:   </devices>
Nov 14 01:10:23 user nova-compute[74850]: </domain>
Nov 14 01:10:23 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T01:06:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-133275307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-133275307',id=42,image_ref='3affc2ae-0eb0-415e-ae25-970cfd84dca7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1001532645',keypairs=<?>,launch_index=0,launched_at=2023-11-14T01:06:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e396f5de82e54abfa812bf8a7e89b0c4',ramdisk_id='',reservation_id='r-gpaxa90f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-270753956',owner_user_name='tempest-AttachVolumeShelveTestJSON-270753956-project-member',shelved_at='2023-11-14T01:08:28.655972',shelved_host='user',shelved_image_id='3affc2ae-0eb0-415e-ae25-970cfd84dca7'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:10:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe8332d8221a49db86a402c5851b4882',uuid=efa96c60-9902-4ca9-8f0e-d27bdb883829,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5e053f78-6ef6-4f30-aedb-30306f10975b", "address": "fa:16:3e:fc:2e:f2", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e053f78-6e", "ovs_interfaceid": "5e053f78-6ef6-4f30-aedb-30306f10975b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Converting VIF {"id": "5e053f78-6ef6-4f30-aedb-30306f10975b", "address": "fa:16:3e:fc:2e:f2", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e053f78-6e", "ovs_interfaceid": "5e053f78-6ef6-4f30-aedb-30306f10975b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:2e:f2,bridge_name='br-int',has_traffic_filtering=True,id=5e053f78-6ef6-4f30-aedb-30306f10975b,network=Network(dfd22096-9f0c-4e0f-aac4-06c224b5b9f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e053f78-6e') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG os_vif [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:2e:f2,bridge_name='br-int',has_traffic_filtering=True,id=5e053f78-6ef6-4f30-aedb-30306f10975b,network=Network(dfd22096-9f0c-4e0f-aac4-06c224b5b9f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e053f78-6e') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc3a99d2-9b32-582f-bf78-275a252ee9be', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e053f78-6e, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5e053f78-6e, col_values=(('qos', UUID('59064f35-debe-4a26-9a86-e4d77cfdc8c8')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5e053f78-6e, col_values=(('external_ids', {'iface-id': '5e053f78-6ef6-4f30-aedb-30306f10975b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:2e:f2', 'vm-uuid': 'efa96c60-9902-4ca9-8f0e-d27bdb883829'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:23 user nova-compute[74850]: INFO os_vif [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:2e:f2,bridge_name='br-int',has_traffic_filtering=True,id=5e053f78-6ef6-4f30-aedb-30306f10975b,network=Network(dfd22096-9f0c-4e0f-aac4-06c224b5b9f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e053f78-6e')
Nov 14 01:10:23 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:10:23 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] No VIF found with MAC fa:16:3e:fc:2e:f2, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:10:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:24 user nova-compute[74850]: DEBUG nova.compute.manager [req-df54becb-46a1-475c-b86e-097f1292013e req-a93dda73-71f7-47eb-93de-5b7245ff2e5b service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Received event network-vif-plugged-5e053f78-6ef6-4f30-aedb-30306f10975b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:10:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-df54becb-46a1-475c-b86e-097f1292013e req-a93dda73-71f7-47eb-93de-5b7245ff2e5b service nova] Acquiring lock "efa96c60-9902-4ca9-8f0e-d27bdb883829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:10:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-df54becb-46a1-475c-b86e-097f1292013e req-a93dda73-71f7-47eb-93de-5b7245ff2e5b service nova] Lock "efa96c60-9902-4ca9-8f0e-d27bdb883829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:10:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-df54becb-46a1-475c-b86e-097f1292013e req-a93dda73-71f7-47eb-93de-5b7245ff2e5b service nova] Lock "efa96c60-9902-4ca9-8f0e-d27bdb883829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:10:24 user nova-compute[74850]: DEBUG nova.compute.manager [req-df54becb-46a1-475c-b86e-097f1292013e req-a93dda73-71f7-47eb-93de-5b7245ff2e5b service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] No waiting events found dispatching network-vif-plugged-5e053f78-6ef6-4f30-aedb-30306f10975b {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:10:24 user nova-compute[74850]: WARNING nova.compute.manager [req-df54becb-46a1-475c-b86e-097f1292013e req-a93dda73-71f7-47eb-93de-5b7245ff2e5b service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Received unexpected event network-vif-plugged-5e053f78-6ef6-4f30-aedb-30306f10975b for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 01:10:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:26 user nova-compute[74850]: DEBUG nova.compute.manager [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 01:10:26 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 01:10:26 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Instance spawned successfully.
Nov 14 01:10:26 user nova-compute[74850]: DEBUG nova.compute.manager [req-a4f9f67c-0b91-4abe-a0e1-4acac43c1903 req-9e54044e-7de7-4b54-b94d-348cc01c9853 service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Received event network-vif-plugged-5e053f78-6ef6-4f30-aedb-30306f10975b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:10:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a4f9f67c-0b91-4abe-a0e1-4acac43c1903 req-9e54044e-7de7-4b54-b94d-348cc01c9853 service nova] Acquiring lock "efa96c60-9902-4ca9-8f0e-d27bdb883829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:10:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a4f9f67c-0b91-4abe-a0e1-4acac43c1903 req-9e54044e-7de7-4b54-b94d-348cc01c9853 service nova] Lock "efa96c60-9902-4ca9-8f0e-d27bdb883829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:10:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a4f9f67c-0b91-4abe-a0e1-4acac43c1903 req-9e54044e-7de7-4b54-b94d-348cc01c9853 service nova] Lock "efa96c60-9902-4ca9-8f0e-d27bdb883829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:10:26 user nova-compute[74850]: DEBUG nova.compute.manager [req-a4f9f67c-0b91-4abe-a0e1-4acac43c1903 req-9e54044e-7de7-4b54-b94d-348cc01c9853 service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] No waiting events found dispatching network-vif-plugged-5e053f78-6ef6-4f30-aedb-30306f10975b {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:10:26 user nova-compute[74850]: WARNING nova.compute.manager [req-a4f9f67c-0b91-4abe-a0e1-4acac43c1903 req-9e54044e-7de7-4b54-b94d-348cc01c9853 service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Received unexpected event network-vif-plugged-5e053f78-6ef6-4f30-aedb-30306f10975b for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 01:10:27 user nova-compute[74850]: DEBUG nova.compute.manager [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 01:10:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-cd9c9391-69ea-480e-af08-3b1347cc5305 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "efa96c60-9902-4ca9-8f0e-d27bdb883829" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.163s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:10:27 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-b66ea83e-46b6-4c5f-bb9f-be3645a1f268 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe is timed out.
Nov 14 01:10:27 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-b66ea83e-46b6-4c5f-bb9f-be3645a1f268 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Successfully detached device vdb from instance 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe from the live domain config.
Nov 14 01:10:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b66ea83e-46b6-4c5f-bb9f-be3645a1f268 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 01:10:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66ea83e-46b6-4c5f-bb9f-be3645a1f268 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ezcAFhmQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:10:27 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-b66ea83e-46b6-4c5f-bb9f-be3645a1f268 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:10:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-b66ea83e-46b6-4c5f-bb9f-be3645a1f268 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:10:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-b66ea83e-46b6-4c5f-bb9f-be3645a1f268 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:10:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:27 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1eaa650-f797-4ecf-b016-c95417b9c55c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66ea83e-46b6-4c5f-bb9f-be3645a1f268 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 01:10:27 user nova-compute[74850]: No targets found.
Nov 14 01:10:27 user nova-compute[74850]: iSNS:
Nov 14 01:10:27 user nova-compute[74850]: No targets found.
Nov 14 01:10:27 user nova-compute[74850]: STATIC:
Nov 14 01:10:27 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d
Nov 14 01:10:27 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:10:27 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:10:27 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d
Nov 14 01:10:27 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:10:27 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:10:27 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a
Nov 14 01:10:27 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:10:27 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:10:27 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0
Nov 14 01:10:27 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:10:27 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:10:27 user nova-compute[74850]: FIRMWARE:
Nov 14 01:10:27 user nova-compute[74850]: No targets found.
Nov 14 01:10:27 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:10:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66ea83e-46b6-4c5f-bb9f-be3645a1f268 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 01:10:27 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 01:10:27 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 01:10:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66ea83e-46b6-4c5f-bb9f-be3645a1f268 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 01:10:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:27 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d921fb17-a3d0-4b68-952a-ebd451cded0b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:27 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6196f4f2-6861-4750-b87b-5dfeba57bcb8]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66ea83e-46b6-4c5f-bb9f-be3645a1f268 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:10:27 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:10:27 user nova-compute[74850]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d (non-flash)
Nov 14 01:10:27 user nova-compute[74850]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 (non-flash)
Nov 14 01:10:27 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:10:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66ea83e-46b6-4c5f-bb9f-be3645a1f268 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:10:27 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:10:27 user nova-compute[74850]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d (non-flash)
Nov 14 01:10:27 user nova-compute[74850]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 (non-flash)
Nov 14 01:10:27 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:10:27 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66ea83e-46b6-4c5f-bb9f-be3645a1f268 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a3c381ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d'): ({'sdc'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 01:10:27 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-b66ea83e-46b6-4c5f-bb9f-be3645a1f268 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Removing single pathed devices sdc {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 01:10:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:27 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:27 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[efadc71c-a6b4-4f45-9938-d4784841a953]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:28 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbf2568-a34a-4cd8-925b-0c1ad4df4b2d]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:28 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-b66ea83e-46b6-4c5f-bb9f-be3645a1f268 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Flushing IO for device /dev/sdc {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 01:10:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:28 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c976bcf3-529e-427c-911c-dd20e4016839]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:28 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-b66ea83e-46b6-4c5f-bb9f-be3645a1f268 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 01:10:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:28 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fc1b8b-c6e3-49bf-8d83-ebcb2f4b21b3]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:28 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-b66ea83e-46b6-4c5f-bb9f-be3645a1f268 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 01:10:28 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-b66ea83e-46b6-4c5f-bb9f-be3645a1f268 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] SCSI volumes sdc have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 01:10:28 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66ea83e-46b6-4c5f-bb9f-be3645a1f268 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 01:10:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:28 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[84476406-0029-4524-bffa-f06983be7be9]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:28 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66ea83e-46b6-4c5f-bb9f-be3645a1f268 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:10:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:28 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4716d22c-80a2-4307-878c-55a85dbdf800]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:28 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66ea83e-46b6-4c5f-bb9f-be3645a1f268 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d, portal: 172.16.0.220,3260]
Nov 14 01:10:28 user nova-compute[74850]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d, portal: 172.16.0.220,3260] successful.
Nov 14 01:10:28 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:10:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:28 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7b5e4a-3c38-4d52-a3fd-0984bbfd888d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:28 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[81867498-0179-48cb-918b-76b8836ff5db]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:28 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66ea83e-46b6-4c5f-bb9f-be3645a1f268 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:10:28 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-b66ea83e-46b6-4c5f-bb9f-be3645a1f268 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:10:28 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66ea83e-46b6-4c5f-bb9f-be3645a1f268 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] <== disconnect_volume: return (359ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:10:28 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b66ea83e-46b6-4c5f-bb9f-be3645a1f268 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 01:10:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:29 user nova-compute[74850]: DEBUG nova.objects.instance [None req-b66ea83e-46b6-4c5f-bb9f-be3645a1f268 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lazy-loading 'flavor' on Instance uuid 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:10:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b66ea83e-46b6-4c5f-bb9f-be3645a1f268 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.743s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:10:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6091602a-b399-48b1-b030-88f5bdfa678e tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:10:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6091602a-b399-48b1-b030-88f5bdfa678e tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:10:30 user nova-compute[74850]: INFO nova.compute.manager [None req-6091602a-b399-48b1-b030-88f5bdfa678e tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Detaching volume 20d5d44f-e942-487f-b2d6-c84ec4ce7be0
Nov 14 01:10:30 user nova-compute[74850]: INFO nova.virt.block_device [None req-6091602a-b399-48b1-b030-88f5bdfa678e tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Attempting to driver detach volume 20d5d44f-e942-487f-b2d6-c84ec4ce7be0 from mountpoint /dev/vdc
Nov 14 01:10:30 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6091602a-b399-48b1-b030-88f5bdfa678e tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Attempting to detach device vdc from instance 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe from the persistent domain config. {{(pid=74850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 01:10:30 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-6091602a-b399-48b1-b030-88f5bdfa678e tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:10:30 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:10:30 user nova-compute[74850]:   <source dev="/dev/sde"/>
Nov 14 01:10:30 user nova-compute[74850]:   <target dev="vdc" bus="virtio"/>
Nov 14 01:10:30 user nova-compute[74850]:   <serial>20d5d44f-e942-487f-b2d6-c84ec4ce7be0</serial>
Nov 14 01:10:30 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 01:10:30 user nova-compute[74850]: </disk>
Nov 14 01:10:30 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:10:30 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-6091602a-b399-48b1-b030-88f5bdfa678e tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Successfully detached device vdc from instance 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe from the persistent domain config.
Nov 14 01:10:30 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6091602a-b399-48b1-b030-88f5bdfa678e tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe from the live domain config. {{(pid=74850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 01:10:30 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-6091602a-b399-48b1-b030-88f5bdfa678e tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:10:30 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:10:30 user nova-compute[74850]:   <source dev="/dev/sde"/>
Nov 14 01:10:30 user nova-compute[74850]:   <target dev="vdc" bus="virtio"/>
Nov 14 01:10:30 user nova-compute[74850]:   <serial>20d5d44f-e942-487f-b2d6-c84ec4ce7be0</serial>
Nov 14 01:10:30 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 01:10:30 user nova-compute[74850]: </disk>
Nov 14 01:10:30 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:10:30 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6091602a-b399-48b1-b030-88f5bdfa678e tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe {{(pid=74850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 01:10:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:10:37 user nova-compute[74850]: INFO nova.compute.manager [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Terminating instance
Nov 14 01:10:37 user nova-compute[74850]: DEBUG nova.compute.manager [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG nova.compute.manager [req-927afc9a-3c01-4b67-9470-1148e3ea04e4 req-7798101f-ff15-4eea-bce6-83715bb94a67 service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Received event network-vif-unplugged-9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-927afc9a-3c01-4b67-9470-1148e3ea04e4 req-7798101f-ff15-4eea-bce6-83715bb94a67 service nova] Acquiring lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-927afc9a-3c01-4b67-9470-1148e3ea04e4 req-7798101f-ff15-4eea-bce6-83715bb94a67 service nova] Lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-927afc9a-3c01-4b67-9470-1148e3ea04e4 req-7798101f-ff15-4eea-bce6-83715bb94a67 service nova] Lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG nova.compute.manager [req-927afc9a-3c01-4b67-9470-1148e3ea04e4 req-7798101f-ff15-4eea-bce6-83715bb94a67 service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] No waiting events found dispatching network-vif-unplugged-9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG nova.compute.manager [req-927afc9a-3c01-4b67-9470-1148e3ea04e4 req-7798101f-ff15-4eea-bce6-83715bb94a67 service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Received event network-vif-unplugged-9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:37 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Instance destroyed successfully.
Nov 14 01:10:37 user nova-compute[74850]: DEBUG nova.objects.instance [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lazy-loading 'resources' on Instance uuid e6e38d20-9aac-4037-b1b4-0c25005a9a67 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-836607346',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-836607346',id=40,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T01:07:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='491aa2a4f38140788cb0de9762a8baf4',ramdisk_id='',reservation_id='r-0bztva0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-726213232',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T01:08:51Z,user_data=None,user_id='a5bb5d788a3b4871ae41f57d06f785f2',uuid=e6e38d20-9aac-4037-b1b4-0c25005a9a67,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe", "address": "fa:16:3e:f7:6e:24", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c0cbd8f-1b", "ovs_interfaceid": "9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Converting VIF {"id": "9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe", "address": "fa:16:3e:f7:6e:24", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c0cbd8f-1b", "ovs_interfaceid": "9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:6e:24,bridge_name='br-int',has_traffic_filtering=True,id=9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe,network=Network(6f8f66ca-e2e8-4565-a05c-df75a16699ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c0cbd8f-1b') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG os_vif [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:6e:24,bridge_name='br-int',has_traffic_filtering=True,id=9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe,network=Network(6f8f66ca-e2e8-4565-a05c-df75a16699ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c0cbd8f-1b') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c0cbd8f-1b, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=99962546-0f6c-41d9-a86a-b66d96f1b742) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:10:37 user nova-compute[74850]: INFO os_vif [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:6e:24,bridge_name='br-int',has_traffic_filtering=True,id=9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe,network=Network(6f8f66ca-e2e8-4565-a05c-df75a16699ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c0cbd8f-1b')
Nov 14 01:10:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmWXAKaB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:10:37 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:10:37 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d49e28-acb4-4d04-8ee6-ab35c9885db0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 01:10:37 user nova-compute[74850]: No targets found.
Nov 14 01:10:37 user nova-compute[74850]: iSNS:
Nov 14 01:10:37 user nova-compute[74850]: No targets found.
Nov 14 01:10:37 user nova-compute[74850]: STATIC:
Nov 14 01:10:37 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d
Nov 14 01:10:37 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:10:37 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:10:37 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a
Nov 14 01:10:37 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:10:37 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:10:37 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0
Nov 14 01:10:37 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:10:37 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:10:37 user nova-compute[74850]: FIRMWARE:
Nov 14 01:10:37 user nova-compute[74850]: No targets found.
Nov 14 01:10:37 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 01:10:37 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 01:10:37 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6f8dbe-1dbf-4157-b148-9130e9c7e30d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[556155a0-fa88-4954-95dc-33a5a2ebd66d]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:10:37 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:10:37 user nova-compute[74850]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 (non-flash)
Nov 14 01:10:37 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:10:37 user nova-compute[74850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a (non-flash)
Nov 14 01:10:37 user nova-compute[74850]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 (non-flash)
Nov 14 01:10:37 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a5c50b130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a'): ({'sdd'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Removing single pathed devices sdd {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3568d5-3cd5-4142-a471-e1e5855f6f8e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[df894ada-8ba0-4202-94e9-9575677423b7]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Flushing IO for device /dev/sdd {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 01:10:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25d3e0b-cbad-4f41-a9f1-9382779672cb]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:38 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 01:10:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.067s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[34693564-61d9-4be9-a15c-7e4d9560dd2c]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:38 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 01:10:38 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] SCSI volumes sdd have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 01:10:38 user nova-compute[74850]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_190f4d71', '/dev/disk/by-id/scsi-23565356266363438', '/dev/disk/by-id/scsi-1SCST_BIO190f4d71-5e5bf648ec71b9a5') {{(pid=84948) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 01:10:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0746ce7f-6069-4d5f-b021-383fdebd1129]: (4, None) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 01:10:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[723854f7-9c19-4af2-9a40-215b823099a3]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:10:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5286ebd5-8b8f-4931-8e1d-3b5aeb826c74]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a, portal: 172.16.0.220,3260]
Nov 14 01:10:38 user nova-compute[74850]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a, portal: 172.16.0.220,3260] successful.
Nov 14 01:10:38 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:10:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e39afd2-04ef-410c-b7e3-d0eeceb59f5a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c57ddb6-4586-43c9-85ad-7911e24a52ce]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:10:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:10:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] <== disconnect_volume: return (355ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:10:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 01:10:38 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Deleting instance files /opt/stack/data/nova/instances/e6e38d20-9aac-4037-b1b4-0c25005a9a67_del
Nov 14 01:10:38 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Deletion of /opt/stack/data/nova/instances/e6e38d20-9aac-4037-b1b4-0c25005a9a67_del complete
Nov 14 01:10:38 user nova-compute[74850]: INFO nova.compute.manager [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 14 01:10:38 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 01:10:38 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 01:10:38 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 01:10:38 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:10:38 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Took 0.41 seconds to deallocate network for instance.
Nov 14 01:10:38 user nova-compute[74850]: DEBUG nova.compute.manager [req-22356bf0-7d20-46b5-a390-0873b4268d9d req-50a385b2-87ba-492d-9925-c865b2ae3518 service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Received event network-vif-deleted-9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:10:39 user nova-compute[74850]: DEBUG nova.compute.manager [req-e2bb61cf-58ca-470c-ba1b-659dd24a7f23 req-eac31326-ab28-4973-9bbf-c3e3916b872f service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Received event network-vif-plugged-9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:10:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e2bb61cf-58ca-470c-ba1b-659dd24a7f23 req-eac31326-ab28-4973-9bbf-c3e3916b872f service nova] Acquiring lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:10:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e2bb61cf-58ca-470c-ba1b-659dd24a7f23 req-eac31326-ab28-4973-9bbf-c3e3916b872f service nova] Lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:10:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e2bb61cf-58ca-470c-ba1b-659dd24a7f23 req-eac31326-ab28-4973-9bbf-c3e3916b872f service nova] Lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:10:39 user nova-compute[74850]: DEBUG nova.compute.manager [req-e2bb61cf-58ca-470c-ba1b-659dd24a7f23 req-eac31326-ab28-4973-9bbf-c3e3916b872f service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] No waiting events found dispatching network-vif-plugged-9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:10:39 user nova-compute[74850]: WARNING nova.compute.manager [req-e2bb61cf-58ca-470c-ba1b-659dd24a7f23 req-eac31326-ab28-4973-9bbf-c3e3916b872f service nova] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Received unexpected event network-vif-plugged-9c0cbd8f-1bad-44b5-a9c8-744e9ff216fe for instance with vm_state active and task_state deleting.
Nov 14 01:10:39 user nova-compute[74850]: INFO nova.compute.manager [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: e6e38d20-9aac-4037-b1b4-0c25005a9a67] Took 0.71 seconds to detach 1 volumes for instance.
Nov 14 01:10:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:10:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:10:39 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:10:39 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:10:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.250s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:10:39 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Deleted allocations for instance e6e38d20-9aac-4037-b1b4-0c25005a9a67
Nov 14 01:10:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-aa531abd-ba66-42c6-a79a-699868ea8225 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "e6e38d20-9aac-4037-b1b4-0c25005a9a67" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.769s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:10:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:41 user nova-compute[74850]: DEBUG nova.compute.manager [req-7c25c853-745b-4797-951b-06b0c6bcdbfb req-226c7bba-69f7-4469-89be-c29cac2b156d service nova] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Received event network-changed-2cdb56a9-9d40-470c-8640-cd9ce3308893 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:10:41 user nova-compute[74850]: DEBUG nova.compute.manager [req-7c25c853-745b-4797-951b-06b0c6bcdbfb req-226c7bba-69f7-4469-89be-c29cac2b156d service nova] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Refreshing instance network info cache due to event network-changed-2cdb56a9-9d40-470c-8640-cd9ce3308893. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:10:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7c25c853-745b-4797-951b-06b0c6bcdbfb req-226c7bba-69f7-4469-89be-c29cac2b156d service nova] Acquiring lock "refresh_cache-709f145b-a471-4a1d-86dc-327e1c3fabb9" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:10:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7c25c853-745b-4797-951b-06b0c6bcdbfb req-226c7bba-69f7-4469-89be-c29cac2b156d service nova] Acquired lock "refresh_cache-709f145b-a471-4a1d-86dc-327e1c3fabb9" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:10:41 user nova-compute[74850]: DEBUG nova.network.neutron [req-7c25c853-745b-4797-951b-06b0c6bcdbfb req-226c7bba-69f7-4469-89be-c29cac2b156d service nova] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Refreshing network info cache for port 2cdb56a9-9d40-470c-8640-cd9ce3308893 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:10:42 user nova-compute[74850]: DEBUG nova.network.neutron [req-7c25c853-745b-4797-951b-06b0c6bcdbfb req-226c7bba-69f7-4469-89be-c29cac2b156d service nova] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Updated VIF entry in instance network info cache for port 2cdb56a9-9d40-470c-8640-cd9ce3308893. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:10:42 user nova-compute[74850]: DEBUG nova.network.neutron [req-7c25c853-745b-4797-951b-06b0c6bcdbfb req-226c7bba-69f7-4469-89be-c29cac2b156d service nova] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Updating instance_info_cache with network_info: [{"id": "2cdb56a9-9d40-470c-8640-cd9ce3308893", "address": "fa:16:3e:85:8d:80", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cdb56a9-9d", "ovs_interfaceid": "2cdb56a9-9d40-470c-8640-cd9ce3308893", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:10:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-7c25c853-745b-4797-951b-06b0c6bcdbfb req-226c7bba-69f7-4469-89be-c29cac2b156d service nova] Releasing lock "refresh_cache-709f145b-a471-4a1d-86dc-327e1c3fabb9" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:10:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "709f145b-a471-4a1d-86dc-327e1c3fabb9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:10:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "709f145b-a471-4a1d-86dc-327e1c3fabb9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:10:44 user nova-compute[74850]: DEBUG nova.objects.instance [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lazy-loading 'flavor' on Instance uuid 709f145b-a471-4a1d-86dc-327e1c3fabb9 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:10:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "709f145b-a471-4a1d-86dc-327e1c3fabb9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:10:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "709f145b-a471-4a1d-86dc-327e1c3fabb9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:10:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "709f145b-a471-4a1d-86dc-327e1c3fabb9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:10:44 user nova-compute[74850]: INFO nova.compute.manager [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Attaching volume 01390776-9000-4b49-8994-483fea2dc4eb to /dev/vdb
Nov 14 01:10:44 user nova-compute[74850]: DEBUG os_brick.utils [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:10:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:44 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ca0441-ce65-41bf-8a4b-1c2249e0e34b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:44 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c035780-58c0-4685-a4f0-6bc269130f8b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:44 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6763aa9d-2d6b-46dc-89f4-628d926e8fdf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:44 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[699fd675-a06d-4257-8318-c8c402ae0b69]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:10:44 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 01:10:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:10:44 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 01:10:44 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[150e5c16-ceb2-43ef-b211-9992f830e081]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:44 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 01:10:44 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 01:10:44 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 01:10:44 user nova-compute[74850]: DEBUG os_brick.utils [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:10:44 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Updating existing volume attachment record: cb55e843-7d1a-4a6e-902e-691c078722f9 {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 01:10:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:47 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:10:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:48 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 01:10:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EvZUJcef', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:10:48 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:10:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:10:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:10:48 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:10:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:10:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:10:48 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 01:10:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d976a510-bda9-4649-8fc0-b28a183df671]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 01:10:48 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:10:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[de825d38-c327-4917-8d2b-7a8ae154af4b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb] added
Nov 14 01:10:48 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:10:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f11780-3e00-4c67-a977-9441e184c711]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:10:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[27944bf8-32fe-4bab-a087-4965acda6ad0]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:10:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EvZUJcef {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EvZUJcef" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e87fb6f-986a-4a0a-bf16-d86ab826db5b]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EvZUJcef'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:10:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:49 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de71af5-2105-4f9a-a01c-bb830cde49ef]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:49 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:10:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:49 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5affc8d3-fd43-44fc-b92d-5c071d6d217d]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:49 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:10:49 user nova-compute[74850]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 (non-flash)
Nov 14 01:10:49 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:10:49 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:10:49 user nova-compute[74850]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 (non-flash)
Nov 14 01:10:49 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:10:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:49 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[def155cb-2290-4e0d-90cd-cacdb2fceff0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:49 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb, portal: 172.16.0.220,3260]
Nov 14 01:10:49 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb, portal: 172.16.0.220,3260] successful.
Nov 14 01:10:49 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:10:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:49 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a85eb5d-44fc-48ff-8572-58ca31c41e4d]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:49 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:10:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:49 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a008331d-a443-4057-b531-fe199f68e2f6]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:49 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:10:49 user nova-compute[74850]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 (non-flash)
Nov 14 01:10:49 user nova-compute[74850]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb (non-flash)
Nov 14 01:10:49 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:10:49 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:10:49 user nova-compute[74850]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 (non-flash)
Nov 14 01:10:49 user nova-compute[74850]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb (non-flash)
Nov 14 01:10:49 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:10:49 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:10:49 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 01:10:49 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 01:10:49 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 01:10:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:49 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:49 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6d9014-8b9d-41c8-bf13-2d378381e031]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:49 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: None {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EvZUJcef', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23164613031383033', 'path': '/dev/sdb'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164613031383033', 'path': '/dev/sdb'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG nova.objects.instance [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lazy-loading 'flavor' on Instance uuid 709f145b-a471-4a1d-86dc-327e1c3fabb9 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 01:10:50 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:10:50 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 01:10:50 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:10:50 user nova-compute[74850]:   <serial>01390776-9000-4b49-8994-483fea2dc4eb</serial>
Nov 14 01:10:50 user nova-compute[74850]: </disk>
Nov 14 01:10:50 user nova-compute[74850]:  {{(pid=74850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] No VIF found with MAC fa:16:3e:85:8d:80, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:10:50 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-6091602a-b399-48b1-b030-88f5bdfa678e tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe is timed out.
Nov 14 01:10:50 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-6091602a-b399-48b1-b030-88f5bdfa678e tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Successfully detached device vdc from instance 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe from the live domain config.
Nov 14 01:10:50 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6091602a-b399-48b1-b030-88f5bdfa678e tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6091602a-b399-48b1-b030-88f5bdfa678e tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lpkxMNci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:10:50 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-6091602a-b399-48b1-b030-88f5bdfa678e tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:10:50 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-6091602a-b399-48b1-b030-88f5bdfa678e tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-6091602a-b399-48b1-b030-88f5bdfa678e tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ca7f93-b12c-46a9-9620-0e47be5969e4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6091602a-b399-48b1-b030-88f5bdfa678e tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 01:10:50 user nova-compute[74850]: No targets found.
Nov 14 01:10:50 user nova-compute[74850]: iSNS:
Nov 14 01:10:50 user nova-compute[74850]: No targets found.
Nov 14 01:10:50 user nova-compute[74850]: STATIC:
Nov 14 01:10:50 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d
Nov 14 01:10:50 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:10:50 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:10:50 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb
Nov 14 01:10:50 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:10:50 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:10:50 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0
Nov 14 01:10:50 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:10:50 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:10:50 user nova-compute[74850]: FIRMWARE:
Nov 14 01:10:50 user nova-compute[74850]: No targets found.
Nov 14 01:10:50 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6091602a-b399-48b1-b030-88f5bdfa678e tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 01:10:50 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 01:10:50 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6091602a-b399-48b1-b030-88f5bdfa678e tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0011706d-6fa0-4782-9710-aaa62fee0a9b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4efc06-8e34-4b64-ab06-e5dc4a00ce17]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6091602a-b399-48b1-b030-88f5bdfa678e tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:10:50 user nova-compute[74850]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 (non-flash)
Nov 14 01:10:50 user nova-compute[74850]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb (non-flash)
Nov 14 01:10:50 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6091602a-b399-48b1-b030-88f5bdfa678e tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:10:50 user nova-compute[74850]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 (non-flash)
Nov 14 01:10:50 user nova-compute[74850]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb (non-flash)
Nov 14 01:10:50 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6091602a-b399-48b1-b030-88f5bdfa678e tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a5fe0ac20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0'): ({'sde'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-6091602a-b399-48b1-b030-88f5bdfa678e tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Removing single pathed devices sde {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e26d8f23-c179-4337-a86a-739eb2f02b22 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "709f145b-a471-4a1d-86dc-327e1c3fabb9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.295s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d7f19e-67a4-4401-91bf-00a21384b807]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce70c60-36ac-4169-90c5-ac16c8329b8d]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-6091602a-b399-48b1-b030-88f5bdfa678e tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Flushing IO for device /dev/sde {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b36dd31-c8a6-4017-a2ac-de20d3c4e1be]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-6091602a-b399-48b1-b030-88f5bdfa678e tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c931117e-6fa4-4614-b906-9b665b3e4a60]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-6091602a-b399-48b1-b030-88f5bdfa678e tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-6091602a-b399-48b1-b030-88f5bdfa678e tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] SCSI volumes sde have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6091602a-b399-48b1-b030-88f5bdfa678e tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[42226fd3-e2dd-4d76-a878-379e5c8da36c]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6091602a-b399-48b1-b030-88f5bdfa678e tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:10:50 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:51 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f029a618-7f5b-4504-ac12-0382771f3108]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:51 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6091602a-b399-48b1-b030-88f5bdfa678e tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0, portal: 172.16.0.220,3260]
Nov 14 01:10:51 user nova-compute[74850]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0, portal: 172.16.0.220,3260] successful.
Nov 14 01:10:51 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:10:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:51 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d5d44f-e942-487f-b2d6-c84ec4ce7be0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:51 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[54836554-19b3-4ab7-aee0-6df8072ea24b]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:10:51 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6091602a-b399-48b1-b030-88f5bdfa678e tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:10:51 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-6091602a-b399-48b1-b030-88f5bdfa678e tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:10:51 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6091602a-b399-48b1-b030-88f5bdfa678e tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] <== disconnect_volume: return (322ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:10:51 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6091602a-b399-48b1-b030-88f5bdfa678e tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 01:10:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-02f3545d-43b6-4f67-92e3-a14388b45588 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "709f145b-a471-4a1d-86dc-327e1c3fabb9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:10:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-02f3545d-43b6-4f67-92e3-a14388b45588 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "709f145b-a471-4a1d-86dc-327e1c3fabb9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:10:51 user nova-compute[74850]: INFO nova.compute.manager [None req-02f3545d-43b6-4f67-92e3-a14388b45588 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Detaching volume 01390776-9000-4b49-8994-483fea2dc4eb
Nov 14 01:10:51 user nova-compute[74850]: INFO nova.virt.block_device [None req-02f3545d-43b6-4f67-92e3-a14388b45588 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Attempting to driver detach volume 01390776-9000-4b49-8994-483fea2dc4eb from mountpoint /dev/vdb
Nov 14 01:10:51 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-02f3545d-43b6-4f67-92e3-a14388b45588 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Attempting to detach device vdb from instance 709f145b-a471-4a1d-86dc-327e1c3fabb9 from the persistent domain config. {{(pid=74850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 01:10:51 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-02f3545d-43b6-4f67-92e3-a14388b45588 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:10:51 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:10:51 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 01:10:51 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:10:51 user nova-compute[74850]:   <serial>01390776-9000-4b49-8994-483fea2dc4eb</serial>
Nov 14 01:10:51 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 01:10:51 user nova-compute[74850]: </disk>
Nov 14 01:10:51 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:10:51 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-02f3545d-43b6-4f67-92e3-a14388b45588 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Successfully detached device vdb from instance 709f145b-a471-4a1d-86dc-327e1c3fabb9 from the persistent domain config.
Nov 14 01:10:51 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-02f3545d-43b6-4f67-92e3-a14388b45588 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 709f145b-a471-4a1d-86dc-327e1c3fabb9 from the live domain config. {{(pid=74850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 01:10:51 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-02f3545d-43b6-4f67-92e3-a14388b45588 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:10:51 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:10:51 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 01:10:51 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:10:51 user nova-compute[74850]:   <serial>01390776-9000-4b49-8994-483fea2dc4eb</serial>
Nov 14 01:10:51 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 01:10:51 user nova-compute[74850]: </disk>
Nov 14 01:10:51 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:10:51 user nova-compute[74850]: DEBUG nova.objects.instance [None req-6091602a-b399-48b1-b030-88f5bdfa678e tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lazy-loading 'flavor' on Instance uuid 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:10:51 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-02f3545d-43b6-4f67-92e3-a14388b45588 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 709f145b-a471-4a1d-86dc-327e1c3fabb9 {{(pid=74850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 01:10:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6091602a-b399-48b1-b030-88f5bdfa678e tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.717s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:10:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-13f60363-2947-4722-8776-24637f122bb8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:10:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-13f60363-2947-4722-8776-24637f122bb8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:10:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-13f60363-2947-4722-8776-24637f122bb8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:10:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-13f60363-2947-4722-8776-24637f122bb8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:10:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-13f60363-2947-4722-8776-24637f122bb8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:10:53 user nova-compute[74850]: INFO nova.compute.manager [None req-13f60363-2947-4722-8776-24637f122bb8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Terminating instance
Nov 14 01:10:53 user nova-compute[74850]: DEBUG nova.compute.manager [None req-13f60363-2947-4722-8776-24637f122bb8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 01:10:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:53 user nova-compute[74850]: DEBUG nova.compute.manager [req-5ca93e77-a3c8-4d5c-8e05-cc6af4cbf00e req-f0507b57-4d0f-4cf8-9caf-be8a9a68d036 service nova] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Received event network-vif-unplugged-5316b921-a92e-4c0f-93df-873d035c4ed0 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:10:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5ca93e77-a3c8-4d5c-8e05-cc6af4cbf00e req-f0507b57-4d0f-4cf8-9caf-be8a9a68d036 service nova] Acquiring lock "2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:10:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5ca93e77-a3c8-4d5c-8e05-cc6af4cbf00e req-f0507b57-4d0f-4cf8-9caf-be8a9a68d036 service nova] Lock "2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:10:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5ca93e77-a3c8-4d5c-8e05-cc6af4cbf00e req-f0507b57-4d0f-4cf8-9caf-be8a9a68d036 service nova] Lock "2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:10:53 user nova-compute[74850]: DEBUG nova.compute.manager [req-5ca93e77-a3c8-4d5c-8e05-cc6af4cbf00e req-f0507b57-4d0f-4cf8-9caf-be8a9a68d036 service nova] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] No waiting events found dispatching network-vif-unplugged-5316b921-a92e-4c0f-93df-873d035c4ed0 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:10:53 user nova-compute[74850]: DEBUG nova.compute.manager [req-5ca93e77-a3c8-4d5c-8e05-cc6af4cbf00e req-f0507b57-4d0f-4cf8-9caf-be8a9a68d036 service nova] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Received event network-vif-unplugged-5316b921-a92e-4c0f-93df-873d035c4ed0 for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 01:10:53 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Instance destroyed successfully.
Nov 14 01:10:53 user nova-compute[74850]: DEBUG nova.objects.instance [None req-13f60363-2947-4722-8776-24637f122bb8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lazy-loading 'resources' on Instance uuid 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:10:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-13f60363-2947-4722-8776-24637f122bb8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:07:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1709452662',display_name='tempest-AttachVolumeTestJSON-server-1709452662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1709452662',id=44,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFo2BL467Q/ec5NXXDWSRlq9MRMJMFuJLxWL0v53vzjEipJurbM7lzz1endbDpx+UwEjZQJIcYEIGibZcbnsXxFRCixjgH46YVKIeyZzfDi5OAX5th8BvR8PF5nAaXv5jQ==',key_name='tempest-keypair-1771496660',keypairs=<?>,launch_index=0,launched_at=2023-11-14T01:08:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c3e629e632d444faf3898681aaafa79',ramdisk_id='',reservation_id='r-q00d5w3n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1639440895',owner_user_name='tempest-AttachVolumeTestJSON-1639440895-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T01:08:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b677f8f7b06431cbeac4cbdfa2dcbf5',uuid=2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5316b921-a92e-4c0f-93df-873d035c4ed0", "address": "fa:16:3e:da:b9:ee", "network": {"id": "75650b3d-1169-46fa-a1cf-7ae51dd28e18", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227679489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3e629e632d444faf3898681aaafa79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5316b921-a9", "ovs_interfaceid": "5316b921-a92e-4c0f-93df-873d035c4ed0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 01:10:53 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-13f60363-2947-4722-8776-24637f122bb8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Converting VIF {"id": "5316b921-a92e-4c0f-93df-873d035c4ed0", "address": "fa:16:3e:da:b9:ee", "network": {"id": "75650b3d-1169-46fa-a1cf-7ae51dd28e18", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227679489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3e629e632d444faf3898681aaafa79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5316b921-a9", "ovs_interfaceid": "5316b921-a92e-4c0f-93df-873d035c4ed0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:10:53 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-13f60363-2947-4722-8776-24637f122bb8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:b9:ee,bridge_name='br-int',has_traffic_filtering=True,id=5316b921-a92e-4c0f-93df-873d035c4ed0,network=Network(75650b3d-1169-46fa-a1cf-7ae51dd28e18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5316b921-a9') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:10:53 user nova-compute[74850]: DEBUG os_vif [None req-13f60363-2947-4722-8776-24637f122bb8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:b9:ee,bridge_name='br-int',has_traffic_filtering=True,id=5316b921-a92e-4c0f-93df-873d035c4ed0,network=Network(75650b3d-1169-46fa-a1cf-7ae51dd28e18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5316b921-a9') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 01:10:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5316b921-a9, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:10:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1ec56674-2f9e-4873-8695-c34e99641035) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:10:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:53 user nova-compute[74850]: INFO os_vif [None req-13f60363-2947-4722-8776-24637f122bb8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:b9:ee,bridge_name='br-int',has_traffic_filtering=True,id=5316b921-a92e-4c0f-93df-873d035c4ed0,network=Network(75650b3d-1169-46fa-a1cf-7ae51dd28e18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5316b921-a9')
Nov 14 01:10:53 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-13f60363-2947-4722-8776-24637f122bb8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Deleting instance files /opt/stack/data/nova/instances/2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe_del
Nov 14 01:10:53 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-13f60363-2947-4722-8776-24637f122bb8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Deletion of /opt/stack/data/nova/instances/2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe_del complete
Nov 14 01:10:53 user nova-compute[74850]: INFO nova.compute.manager [None req-13f60363-2947-4722-8776-24637f122bb8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 14 01:10:53 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-13f60363-2947-4722-8776-24637f122bb8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 01:10:53 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 01:10:53 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 01:10:54 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:10:54 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Took 0.66 seconds to deallocate network for instance.
Nov 14 01:10:54 user nova-compute[74850]: DEBUG nova.compute.manager [req-ef87d76f-33a8-442f-8ecd-606fc5f4e752 req-7cc50042-ff6f-4aaf-88f9-be6574df0b95 service nova] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Received event network-vif-deleted-5316b921-a92e-4c0f-93df-873d035c4ed0 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:10:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-13f60363-2947-4722-8776-24637f122bb8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:10:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-13f60363-2947-4722-8776-24637f122bb8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:10:54 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-13f60363-2947-4722-8776-24637f122bb8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:10:54 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-13f60363-2947-4722-8776-24637f122bb8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:10:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-13f60363-2947-4722-8776-24637f122bb8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.239s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:10:54 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-13f60363-2947-4722-8776-24637f122bb8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Deleted allocations for instance 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe
Nov 14 01:10:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-13f60363-2947-4722-8776-24637f122bb8 tempest-AttachVolumeTestJSON-1639440895 tempest-AttachVolumeTestJSON-1639440895-project-member] Lock "2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.950s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:10:55 user nova-compute[74850]: DEBUG nova.compute.manager [req-6a4fcd38-6558-4f18-b0dc-a27cc49bf49b req-8cef1d15-3d8e-4636-b2ba-c56a949ac7b9 service nova] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Received event network-vif-plugged-5316b921-a92e-4c0f-93df-873d035c4ed0 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:10:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6a4fcd38-6558-4f18-b0dc-a27cc49bf49b req-8cef1d15-3d8e-4636-b2ba-c56a949ac7b9 service nova] Acquiring lock "2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:10:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6a4fcd38-6558-4f18-b0dc-a27cc49bf49b req-8cef1d15-3d8e-4636-b2ba-c56a949ac7b9 service nova] Lock "2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:10:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6a4fcd38-6558-4f18-b0dc-a27cc49bf49b req-8cef1d15-3d8e-4636-b2ba-c56a949ac7b9 service nova] Lock "2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:10:55 user nova-compute[74850]: DEBUG nova.compute.manager [req-6a4fcd38-6558-4f18-b0dc-a27cc49bf49b req-8cef1d15-3d8e-4636-b2ba-c56a949ac7b9 service nova] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] No waiting events found dispatching network-vif-plugged-5316b921-a92e-4c0f-93df-873d035c4ed0 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:10:55 user nova-compute[74850]: WARNING nova.compute.manager [req-6a4fcd38-6558-4f18-b0dc-a27cc49bf49b req-8cef1d15-3d8e-4636-b2ba-c56a949ac7b9 service nova] [instance: 2e9ad555-2366-4dfa-b7d5-fb6cdb944fbe] Received unexpected event network-vif-plugged-5316b921-a92e-4c0f-93df-873d035c4ed0 for instance with vm_state deleted and task_state None.
Nov 14 01:10:56 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:10:59 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:10:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:10:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:10:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:10:59 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 01:10:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:10:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:10:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:11:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:11:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:11:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:11:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/709f145b-a471-4a1d-86dc-327e1c3fabb9/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:11:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/709f145b-a471-4a1d-86dc-327e1c3fabb9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:11:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/709f145b-a471-4a1d-86dc-327e1c3fabb9/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:11:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/709f145b-a471-4a1d-86dc-327e1c3fabb9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:11:00 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:11:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:01 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:11:01 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:11:01 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=8384MB free_disk=24.844497680664062GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 01:11:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:11:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:11:01 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance c7952bff-87d6-46c1-a6d4-7729dc4893ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:11:01 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 702746f7-305f-4eac-a71a-6c08b7cbccd8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:11:01 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 3504ddd3-bdd8-465e-aec5-190acdd563f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:11:01 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 709f145b-a471-4a1d-86dc-327e1c3fabb9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:11:01 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance efa96c60-9902-4ca9-8f0e-d27bdb883829 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:11:01 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 01:11:01 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 01:11:01 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:11:01 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:11:01 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 01:11:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.320s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:11:02 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:11:02 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "6ac6355d-eb05-4d1a-94c5-8ca630e926f4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:11:02 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "6ac6355d-eb05-4d1a-94c5-8ca630e926f4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:11:02 user nova-compute[74850]: DEBUG nova.compute.manager [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 01:11:02 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:11:02 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:11:02 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 01:11:02 user nova-compute[74850]: INFO nova.compute.claims [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Claim successful on node user
Nov 14 01:11:03 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:11:03 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:11:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.318s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:11:03 user nova-compute[74850]: DEBUG nova.compute.manager [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 01:11:03 user nova-compute[74850]: DEBUG nova.compute.manager [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 01:11:03 user nova-compute[74850]: DEBUG nova.network.neutron [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 01:11:03 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 01:11:03 user nova-compute[74850]: DEBUG nova.compute.manager [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 01:11:03 user nova-compute[74850]: INFO nova.virt.block_device [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Booting with volume 32e7343b-b42b-4d04-9c90-8a06c1cf98b8 at /dev/vda
Nov 14 01:11:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:03 user nova-compute[74850]: DEBUG nova.policy [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c91ddcee4e54a769eb626c816596bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb1eb4b5fc841d1952b8db9ae05e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 01:11:03 user nova-compute[74850]: DEBUG os_brick.utils [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:11:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:11:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:11:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8d0e69-922f-4bb3-86de-96a1b12bdeff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:11:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:11:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:11:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e300e661-bfe6-43da-9215-6cc566849f3b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:11:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:11:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:11:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8822ddba-c1c7-475b-aab3-5b4a5a858dc8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:11:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3707f44e-c811-43e7-b3f6-2777cf4c1577]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:11:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:11:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:11:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 01:11:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:11:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:11:03 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 01:11:03 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3173d891-015a-4ad4-b6e9-0b985ace5174]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:11:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 01:11:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 01:11:03 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 01:11:03 user nova-compute[74850]: DEBUG os_brick.utils [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:11:03 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Updating existing volume attachment record: f2428c4f-4d56-4a16-bfd6-a66bd4bec02c {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 01:11:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:03 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:11:04 user nova-compute[74850]: DEBUG nova.network.neutron [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Successfully created port: 4f8a261a-c9f2-47b4-a0e7-ae6730ec962a {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 01:11:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:05 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:11:05 user nova-compute[74850]: DEBUG nova.network.neutron [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Successfully updated port: 4f8a261a-c9f2-47b4-a0e7-ae6730ec962a {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 01:11:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "refresh_cache-6ac6355d-eb05-4d1a-94c5-8ca630e926f4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:11:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquired lock "refresh_cache-6ac6355d-eb05-4d1a-94c5-8ca630e926f4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:11:06 user nova-compute[74850]: DEBUG nova.network.neutron [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 01:11:06 user nova-compute[74850]: DEBUG nova.network.neutron [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 01:11:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:06 user nova-compute[74850]: DEBUG nova.compute.manager [req-b92ccd1c-a64a-491a-a756-693b3f5a745c req-017ac575-ae1e-444b-8f7e-89f0f96dc0df service nova] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Received event network-changed-4f8a261a-c9f2-47b4-a0e7-ae6730ec962a {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:11:06 user nova-compute[74850]: DEBUG nova.compute.manager [req-b92ccd1c-a64a-491a-a756-693b3f5a745c req-017ac575-ae1e-444b-8f7e-89f0f96dc0df service nova] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Refreshing instance network info cache due to event network-changed-4f8a261a-c9f2-47b4-a0e7-ae6730ec962a. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:11:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b92ccd1c-a64a-491a-a756-693b3f5a745c req-017ac575-ae1e-444b-8f7e-89f0f96dc0df service nova] Acquiring lock "refresh_cache-6ac6355d-eb05-4d1a-94c5-8ca630e926f4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:11:06 user nova-compute[74850]: DEBUG nova.network.neutron [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Updating instance_info_cache with network_info: [{"id": "4f8a261a-c9f2-47b4-a0e7-ae6730ec962a", "address": "fa:16:3e:78:cd:0b", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8a261a-c9", "ovs_interfaceid": "4f8a261a-c9f2-47b4-a0e7-ae6730ec962a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:11:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Releasing lock "refresh_cache-6ac6355d-eb05-4d1a-94c5-8ca630e926f4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:11:06 user nova-compute[74850]: DEBUG nova.compute.manager [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Instance network_info: |[{"id": "4f8a261a-c9f2-47b4-a0e7-ae6730ec962a", "address": "fa:16:3e:78:cd:0b", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8a261a-c9", "ovs_interfaceid": "4f8a261a-c9f2-47b4-a0e7-ae6730ec962a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 01:11:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b92ccd1c-a64a-491a-a756-693b3f5a745c req-017ac575-ae1e-444b-8f7e-89f0f96dc0df service nova] Acquired lock "refresh_cache-6ac6355d-eb05-4d1a-94c5-8ca630e926f4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:11:06 user nova-compute[74850]: DEBUG nova.network.neutron [req-b92ccd1c-a64a-491a-a756-693b3f5a745c req-017ac575-ae1e-444b-8f7e-89f0f96dc0df service nova] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Refreshing network info cache for port 4f8a261a-c9f2-47b4-a0e7-ae6730ec962a {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:11:06 user nova-compute[74850]: DEBUG nova.network.neutron [req-b92ccd1c-a64a-491a-a756-693b3f5a745c req-017ac575-ae1e-444b-8f7e-89f0f96dc0df service nova] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Updated VIF entry in instance network info cache for port 4f8a261a-c9f2-47b4-a0e7-ae6730ec962a. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:11:06 user nova-compute[74850]: DEBUG nova.network.neutron [req-b92ccd1c-a64a-491a-a756-693b3f5a745c req-017ac575-ae1e-444b-8f7e-89f0f96dc0df service nova] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Updating instance_info_cache with network_info: [{"id": "4f8a261a-c9f2-47b4-a0e7-ae6730ec962a", "address": "fa:16:3e:78:cd:0b", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8a261a-c9", "ovs_interfaceid": "4f8a261a-c9f2-47b4-a0e7-ae6730ec962a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:11:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b92ccd1c-a64a-491a-a756-693b3f5a745c req-017ac575-ae1e-444b-8f7e-89f0f96dc0df service nova] Releasing lock "refresh_cache-6ac6355d-eb05-4d1a-94c5-8ca630e926f4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:11:06 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:11:06 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74850) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 01:11:07 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG nova.compute.manager [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 01:11:08 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Creating image(s)
Nov 14 01:11:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Did not create local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Ensure instance console log exists: /opt/stack/data/nova/instances/6ac6355d-eb05-4d1a-94c5-8ca630e926f4/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Start _get_guest_xml network_info=[{"id": "4f8a261a-c9f2-47b4-a0e7-ae6730ec962a", "address": "fa:16:3e:78:cd:0b", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8a261a-c9", "ovs_interfaceid": "4f8a261a-c9f2-47b4-a0e7-ae6730ec962a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f2428c4f-4d56-4a16-bfd6-a66bd4bec02c', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'empAbWLq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6ac6355d-eb05-4d1a-94c5-8ca630e926f4', 'attached_at': '', 'detached_at': '', 'volume_id': '32e7343b-b42b-4d04-9c90-8a06c1cf98b8', 'serial': '32e7343b-b42b-4d04-9c90-8a06c1cf98b8'}, 'volume_type': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 01:11:08 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:11:08 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:11:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'empAbWLq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:11:08 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:11:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:11:08 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:11:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:11:08 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 01:11:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce033043-9c77-42e0-9ecf-a705c7d5f44f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 01:11:08 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd04f38-f2c7-4305-82ab-afb82e0ccf0f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8] added
Nov 14 01:11:08 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bef0508-0f3f-45df-9ff4-0771f4469971]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[979f1423-4ffb-4a28-86b8-6e402f447965]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v empAbWLq {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v empAbWLq" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da3fc47-dec6-468a-b812-e724f912dcc4]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'empAbWLq'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4e2596-7568-4b5a-80cf-3b20f5cd1dde]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7426f01-b6f6-4425-bca0-375e7d7381e1]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:11:08 user nova-compute[74850]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb (non-flash)
Nov 14 01:11:08 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:11:08 user nova-compute[74850]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb (non-flash)
Nov 14 01:11:08 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15bd588-d230-4e4e-bb02-b5097783284b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8, portal: 172.16.0.220,3260]
Nov 14 01:11:08 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8, portal: 172.16.0.220,3260] successful.
Nov 14 01:11:08 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[673836cb-8eea-4714-a810-a3b8a5552642]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9c756d-29d0-45a8-9f33-20a7a5561912]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:11:08 user nova-compute[74850]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb (non-flash)
Nov 14 01:11:08 user nova-compute[74850]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:11:08 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:11:08 user nova-compute[74850]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb (non-flash)
Nov 14 01:11:08 user nova-compute[74850]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:11:08 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[596e5cec-f62c-4814-bfb1-d41e298d6e51]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'empAbWLq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:11:08 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 01:11:09 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:11:09 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23939376431393364', 'path': '/dev/sdc'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:11:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939376431393364', 'path': '/dev/sdc'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 01:11:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:11:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-588725013',display_name='tempest-TestVolumeBootPattern-server-588725013',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-588725013',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA94n5zD/7RpobhW+jYq5sAS9UK4izFU1jEjxsSgfhAiBUC2oNIUdSW107BwtkqMZ7Uku+sA2LquAPtuZM0gk2nZsUp6hWLP86Pz4tdmgGXQVoyyrGsrxeP25l2IFQWByQ==',key_name='tempest-TestVolumeBootPattern-543311029',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdb1eb4b5fc841d1952b8db9ae05e446',ramdisk_id='',reservation_id='r-hwkp5g77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1536334624',owner_user_name='tempest-TestVolumeBootPattern-1536334624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:11:03Z,user_data=None,user_id='6c91ddcee4e54a769eb626c816596bed',uuid=6ac6355d-eb05-4d1a-94c5-8ca630e926f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f8a261a-c9f2-47b4-a0e7-ae6730ec962a", "address": "fa:16:3e:78:cd:0b", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8a261a-c9", "ovs_interfaceid": "4f8a261a-c9f2-47b4-a0e7-ae6730ec962a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 01:11:09 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Converting VIF {"id": "4f8a261a-c9f2-47b4-a0e7-ae6730ec962a", "address": "fa:16:3e:78:cd:0b", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8a261a-c9", "ovs_interfaceid": "4f8a261a-c9f2-47b4-a0e7-ae6730ec962a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:11:09 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:cd:0b,bridge_name='br-int',has_traffic_filtering=True,id=4f8a261a-c9f2-47b4-a0e7-ae6730ec962a,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f8a261a-c9') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:11:09 user nova-compute[74850]: DEBUG nova.objects.instance [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ac6355d-eb05-4d1a-94c5-8ca630e926f4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:11:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] End _get_guest_xml xml=<domain type="kvm">
Nov 14 01:11:09 user nova-compute[74850]:   <uuid>6ac6355d-eb05-4d1a-94c5-8ca630e926f4</uuid>
Nov 14 01:11:09 user nova-compute[74850]:   <name>instance-0000002f</name>
Nov 14 01:11:09 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 01:11:09 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 01:11:09 user nova-compute[74850]:   <metadata>
Nov 14 01:11:09 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 01:11:09 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 01:11:09 user nova-compute[74850]:       <nova:name>tempest-TestVolumeBootPattern-server-588725013</nova:name>
Nov 14 01:11:09 user nova-compute[74850]:       <nova:creationTime>2023-11-14 01:11:08</nova:creationTime>
Nov 14 01:11:09 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 01:11:09 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 01:11:09 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 01:11:09 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 01:11:09 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 01:11:09 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 01:11:09 user nova-compute[74850]:       </nova:flavor>
Nov 14 01:11:09 user nova-compute[74850]:       <nova:owner>
Nov 14 01:11:09 user nova-compute[74850]:         <nova:user uuid="6c91ddcee4e54a769eb626c816596bed">tempest-TestVolumeBootPattern-1536334624-project-member</nova:user>
Nov 14 01:11:09 user nova-compute[74850]:         <nova:project uuid="fdb1eb4b5fc841d1952b8db9ae05e446">tempest-TestVolumeBootPattern-1536334624</nova:project>
Nov 14 01:11:09 user nova-compute[74850]:       </nova:owner>
Nov 14 01:11:09 user nova-compute[74850]:       <nova:ports>
Nov 14 01:11:09 user nova-compute[74850]:         <nova:port uuid="4f8a261a-c9f2-47b4-a0e7-ae6730ec962a">
Nov 14 01:11:09 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 01:11:09 user nova-compute[74850]:         </nova:port>
Nov 14 01:11:09 user nova-compute[74850]:       </nova:ports>
Nov 14 01:11:09 user nova-compute[74850]:     </nova:instance>
Nov 14 01:11:09 user nova-compute[74850]:   </metadata>
Nov 14 01:11:09 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 01:11:09 user nova-compute[74850]:     <system>
Nov 14 01:11:09 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 01:11:09 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 01:11:09 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 01:11:09 user nova-compute[74850]:       <entry name="serial">6ac6355d-eb05-4d1a-94c5-8ca630e926f4</entry>
Nov 14 01:11:09 user nova-compute[74850]:       <entry name="uuid">6ac6355d-eb05-4d1a-94c5-8ca630e926f4</entry>
Nov 14 01:11:09 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 01:11:09 user nova-compute[74850]:     </system>
Nov 14 01:11:09 user nova-compute[74850]:   </sysinfo>
Nov 14 01:11:09 user nova-compute[74850]:   <os>
Nov 14 01:11:09 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 01:11:09 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 01:11:09 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 01:11:09 user nova-compute[74850]:   </os>
Nov 14 01:11:09 user nova-compute[74850]:   <features>
Nov 14 01:11:09 user nova-compute[74850]:     <acpi/>
Nov 14 01:11:09 user nova-compute[74850]:     <apic/>
Nov 14 01:11:09 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 01:11:09 user nova-compute[74850]:   </features>
Nov 14 01:11:09 user nova-compute[74850]:   <clock offset="utc">
Nov 14 01:11:09 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 01:11:09 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 01:11:09 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 01:11:09 user nova-compute[74850]:   </clock>
Nov 14 01:11:09 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 01:11:09 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 01:11:09 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 01:11:09 user nova-compute[74850]:   </cpu>
Nov 14 01:11:09 user nova-compute[74850]:   <devices>
Nov 14 01:11:09 user nova-compute[74850]:     <disk type="block" device="disk">
Nov 14 01:11:09 user nova-compute[74850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:11:09 user nova-compute[74850]:       <source dev="/dev/sdc"/>
Nov 14 01:11:09 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 01:11:09 user nova-compute[74850]:       <serial>32e7343b-b42b-4d04-9c90-8a06c1cf98b8</serial>
Nov 14 01:11:09 user nova-compute[74850]:     </disk>
Nov 14 01:11:09 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 01:11:09 user nova-compute[74850]:       <mac address="fa:16:3e:78:cd:0b"/>
Nov 14 01:11:09 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:11:09 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 01:11:09 user nova-compute[74850]:       <target dev="tap4f8a261a-c9"/>
Nov 14 01:11:09 user nova-compute[74850]:     </interface>
Nov 14 01:11:09 user nova-compute[74850]:     <serial type="pty">
Nov 14 01:11:09 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/6ac6355d-eb05-4d1a-94c5-8ca630e926f4/console.log" append="off"/>
Nov 14 01:11:09 user nova-compute[74850]:     </serial>
Nov 14 01:11:09 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 01:11:09 user nova-compute[74850]:     <video>
Nov 14 01:11:09 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:11:09 user nova-compute[74850]:     </video>
Nov 14 01:11:09 user nova-compute[74850]:     <rng model="virtio">
Nov 14 01:11:09 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 01:11:09 user nova-compute[74850]:     </rng>
Nov 14 01:11:09 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 01:11:09 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 01:11:09 user nova-compute[74850]:       <stats period="10"/>
Nov 14 01:11:09 user nova-compute[74850]:     </memballoon>
Nov 14 01:11:09 user nova-compute[74850]:   </devices>
Nov 14 01:11:09 user nova-compute[74850]: </domain>
Nov 14 01:11:09 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 01:11:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:11:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-588725013',display_name='tempest-TestVolumeBootPattern-server-588725013',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-588725013',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA94n5zD/7RpobhW+jYq5sAS9UK4izFU1jEjxsSgfhAiBUC2oNIUdSW107BwtkqMZ7Uku+sA2LquAPtuZM0gk2nZsUp6hWLP86Pz4tdmgGXQVoyyrGsrxeP25l2IFQWByQ==',key_name='tempest-TestVolumeBootPattern-543311029',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdb1eb4b5fc841d1952b8db9ae05e446',ramdisk_id='',reservation_id='r-hwkp5g77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1536334624',owner_user_name='tempest-TestVolumeBootPattern-1536334624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:11:03Z,user_data=None,user_id='6c91ddcee4e54a769eb626c816596bed',uuid=6ac6355d-eb05-4d1a-94c5-8ca630e926f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f8a261a-c9f2-47b4-a0e7-ae6730ec962a", "address": "fa:16:3e:78:cd:0b", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8a261a-c9", "ovs_interfaceid": "4f8a261a-c9f2-47b4-a0e7-ae6730ec962a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 01:11:09 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Converting VIF {"id": "4f8a261a-c9f2-47b4-a0e7-ae6730ec962a", "address": "fa:16:3e:78:cd:0b", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8a261a-c9", "ovs_interfaceid": "4f8a261a-c9f2-47b4-a0e7-ae6730ec962a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:11:09 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:cd:0b,bridge_name='br-int',has_traffic_filtering=True,id=4f8a261a-c9f2-47b4-a0e7-ae6730ec962a,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f8a261a-c9') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:11:09 user nova-compute[74850]: DEBUG os_vif [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:cd:0b,bridge_name='br-int',has_traffic_filtering=True,id=4f8a261a-c9f2-47b4-a0e7-ae6730ec962a,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f8a261a-c9') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 01:11:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:11:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 01:11:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ec07bf83-21c5-5b8c-b91d-8903c4df0df1', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:11:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f8a261a-c9, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:11:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4f8a261a-c9, col_values=(('qos', UUID('d88fee5b-3da2-4eac-bd02-778397cea560')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:11:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4f8a261a-c9, col_values=(('external_ids', {'iface-id': '4f8a261a-c9f2-47b4-a0e7-ae6730ec962a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:cd:0b', 'vm-uuid': '6ac6355d-eb05-4d1a-94c5-8ca630e926f4'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:11:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:11:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:09 user nova-compute[74850]: INFO os_vif [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:cd:0b,bridge_name='br-int',has_traffic_filtering=True,id=4f8a261a-c9f2-47b4-a0e7-ae6730ec962a,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f8a261a-c9')
Nov 14 01:11:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:11:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] No VIF found with MAC fa:16:3e:78:cd:0b, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:11:09 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:11:09 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:11:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:10 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:11:10 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:11:10 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 01:11:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "refresh_cache-702746f7-305f-4eac-a71a-6c08b7cbccd8" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquired lock "refresh_cache-702746f7-305f-4eac-a71a-6c08b7cbccd8" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Forcefully refreshing network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Updating instance_info_cache with network_info: [{"id": "39232b36-eca6-4dac-880c-43aafa9f1719", "address": "fa:16:3e:ac:57:e7", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39232b36-ec", "ovs_interfaceid": "39232b36-eca6-4dac-880c-43aafa9f1719", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Releasing lock "refresh_cache-702746f7-305f-4eac-a71a-6c08b7cbccd8" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Updated the network info_cache for instance {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Cleaning up deleted instances {{(pid=74850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] There are 0 instances to clean {{(pid=74850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:11 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-02f3545d-43b6-4f67-92e3-a14388b45588 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 709f145b-a471-4a1d-86dc-327e1c3fabb9 is timed out.
Nov 14 01:11:11 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-02f3545d-43b6-4f67-92e3-a14388b45588 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Successfully detached device vdb from instance 709f145b-a471-4a1d-86dc-327e1c3fabb9 from the live domain config.
Nov 14 01:11:11 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02f3545d-43b6-4f67-92e3-a14388b45588 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f3545d-43b6-4f67-92e3-a14388b45588 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EvZUJcef', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:11:11 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-02f3545d-43b6-4f67-92e3-a14388b45588 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:11:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-02f3545d-43b6-4f67-92e3-a14388b45588 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-02f3545d-43b6-4f67-92e3-a14388b45588 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c8dc25-9e46-4de9-8387-c7d39fc8eb01]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f3545d-43b6-4f67-92e3-a14388b45588 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 01:11:11 user nova-compute[74850]: No targets found.
Nov 14 01:11:11 user nova-compute[74850]: iSNS:
Nov 14 01:11:11 user nova-compute[74850]: No targets found.
Nov 14 01:11:11 user nova-compute[74850]: STATIC:
Nov 14 01:11:11 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d
Nov 14 01:11:11 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:11:11 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:11:11 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb
Nov 14 01:11:11 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:11:11 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:11:11 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8
Nov 14 01:11:11 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:11:11 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:11:11 user nova-compute[74850]: FIRMWARE:
Nov 14 01:11:11 user nova-compute[74850]: No targets found.
Nov 14 01:11:11 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f3545d-43b6-4f67-92e3-a14388b45588 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 01:11:11 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 01:11:11 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f3545d-43b6-4f67-92e3-a14388b45588 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ed30fc-8cf6-4fcf-a798-9792209db619]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6820f1-a6e4-4379-aef5-fc625c1b75de]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f3545d-43b6-4f67-92e3-a14388b45588 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:11:11 user nova-compute[74850]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb (non-flash)
Nov 14 01:11:11 user nova-compute[74850]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:11:11 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f3545d-43b6-4f67-92e3-a14388b45588 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:11:11 user nova-compute[74850]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb (non-flash)
Nov 14 01:11:11 user nova-compute[74850]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:11:11 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f3545d-43b6-4f67-92e3-a14388b45588 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a3c382d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb'): ({'sdb'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-02f3545d-43b6-4f67-92e3-a14388b45588 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Removing single pathed devices sdb {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb086ff-a292-48c5-90c8-06fdfc9b9395]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[775a1f70-3336-4ba5-8be7-4ff129d6dd40]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-02f3545d-43b6-4f67-92e3-a14388b45588 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Flushing IO for device /dev/sdb {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e7c399-c9f0-4b89-89fa-380a953ef020]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-02f3545d-43b6-4f67-92e3-a14388b45588 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 01:11:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:11:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:11:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[59dcbb97-795e-4748-9be8-4d32e050613e]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:11:12 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-02f3545d-43b6-4f67-92e3-a14388b45588 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 01:11:12 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-02f3545d-43b6-4f67-92e3-a14388b45588 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 01:11:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f3545d-43b6-4f67-92e3-a14388b45588 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 01:11:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:11:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:11:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ee303a-8239-47bc-ab34-bacbaf0909b3]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:11:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f3545d-43b6-4f67-92e3-a14388b45588 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:11:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:11:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:11:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0bf33b-713e-4792-b0e4-767f5807b8fd]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:11:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f3545d-43b6-4f67-92e3-a14388b45588 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb, portal: 172.16.0.220,3260]
Nov 14 01:11:12 user nova-compute[74850]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb, portal: 172.16.0.220,3260] successful.
Nov 14 01:11:12 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:11:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:11:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01390776-9000-4b49-8994-483fea2dc4eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:11:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9350f3b5-8397-42f8-bb7d-37a6603aeb5f]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:11:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f3545d-43b6-4f67-92e3-a14388b45588 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:11:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-02f3545d-43b6-4f67-92e3-a14388b45588 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:11:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f3545d-43b6-4f67-92e3-a14388b45588 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] <== disconnect_volume: return (296ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:11:12 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02f3545d-43b6-4f67-92e3-a14388b45588 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 01:11:12 user nova-compute[74850]: DEBUG nova.objects.instance [None req-02f3545d-43b6-4f67-92e3-a14388b45588 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lazy-loading 'flavor' on Instance uuid 709f145b-a471-4a1d-86dc-327e1c3fabb9 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:11:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-02f3545d-43b6-4f67-92e3-a14388b45588 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "709f145b-a471-4a1d-86dc-327e1c3fabb9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.643s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:11:13 user nova-compute[74850]: DEBUG nova.compute.manager [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 01:11:13 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 01:11:13 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Instance spawned successfully.
Nov 14 01:11:13 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 01:11:13 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:11:13 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:11:13 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:11:13 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:11:13 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:11:13 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:11:13 user nova-compute[74850]: INFO nova.compute.manager [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Took 5.08 seconds to spawn the instance on the hypervisor.
Nov 14 01:11:13 user nova-compute[74850]: DEBUG nova.compute.manager [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 01:11:13 user nova-compute[74850]: INFO nova.compute.manager [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Took 10.59 seconds to build instance.
Nov 14 01:11:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2e0ed07a-0cad-47e8-abe0-e6ba2e89587c tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "6ac6355d-eb05-4d1a-94c5-8ca630e926f4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.682s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:11:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Acquiring lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:11:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:11:13 user nova-compute[74850]: DEBUG nova.compute.manager [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 01:11:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:11:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:11:13 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 01:11:13 user nova-compute[74850]: INFO nova.compute.claims [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Claim successful on node user
Nov 14 01:11:14 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:11:14 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:11:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.330s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:11:14 user nova-compute[74850]: DEBUG nova.compute.manager [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 01:11:14 user nova-compute[74850]: DEBUG nova.compute.manager [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 01:11:14 user nova-compute[74850]: DEBUG nova.network.neutron [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 01:11:14 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 01:11:14 user nova-compute[74850]: DEBUG nova.compute.manager [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 01:11:14 user nova-compute[74850]: DEBUG nova.policy [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82838be39f3c4e829121d45993ad5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2226993ed451286826a667f802a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 01:11:14 user nova-compute[74850]: DEBUG nova.compute.manager [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 01:11:14 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 01:11:14 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Creating image(s)
Nov 14 01:11:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Acquiring lock "/opt/stack/data/nova/instances/ebed89ae-c110-4bf3-94e2-af76b19c2a52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:11:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "/opt/stack/data/nova/instances/ebed89ae-c110-4bf3-94e2-af76b19c2a52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:11:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "/opt/stack/data/nova/instances/ebed89ae-c110-4bf3-94e2-af76b19c2a52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:11:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:11:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.182s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:11:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:11:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:11:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:11:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.195s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:11:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/ebed89ae-c110-4bf3-94e2-af76b19c2a52/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:11:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/ebed89ae-c110-4bf3-94e2-af76b19c2a52/disk 1073741824" returned: 0 in 0.050s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:11:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:11:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:11:15 user nova-compute[74850]: DEBUG nova.network.neutron [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Successfully created port: 73c210c0-59f3-4551-be32-77168edd3996 {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 01:11:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.184s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:11:15 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ebed89ae-c110-4bf3-94e2-af76b19c2a52/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 01:11:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebed89ae-c110-4bf3-94e2-af76b19c2a52/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:11:15 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebed89ae-c110-4bf3-94e2-af76b19c2a52/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:11:15 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Cannot resize image /opt/stack/data/nova/instances/ebed89ae-c110-4bf3-94e2-af76b19c2a52/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 01:11:15 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 01:11:15 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Ensure instance console log exists: /opt/stack/data/nova/instances/ebed89ae-c110-4bf3-94e2-af76b19c2a52/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 01:11:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:11:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:11:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:11:15 user nova-compute[74850]: DEBUG nova.network.neutron [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Successfully updated port: 73c210c0-59f3-4551-be32-77168edd3996 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 01:11:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Acquiring lock "refresh_cache-ebed89ae-c110-4bf3-94e2-af76b19c2a52" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:11:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Acquired lock "refresh_cache-ebed89ae-c110-4bf3-94e2-af76b19c2a52" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:11:15 user nova-compute[74850]: DEBUG nova.network.neutron [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 01:11:15 user nova-compute[74850]: DEBUG nova.compute.manager [req-3ff5bd26-3dae-4d14-b93a-20b6c3bd4fdf req-3d17d839-bb2a-47a6-9f9f-baadcd9c09bd service nova] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Received event network-changed-73c210c0-59f3-4551-be32-77168edd3996 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:11:15 user nova-compute[74850]: DEBUG nova.compute.manager [req-3ff5bd26-3dae-4d14-b93a-20b6c3bd4fdf req-3d17d839-bb2a-47a6-9f9f-baadcd9c09bd service nova] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Refreshing instance network info cache due to event network-changed-73c210c0-59f3-4551-be32-77168edd3996. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:11:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3ff5bd26-3dae-4d14-b93a-20b6c3bd4fdf req-3d17d839-bb2a-47a6-9f9f-baadcd9c09bd service nova] Acquiring lock "refresh_cache-ebed89ae-c110-4bf3-94e2-af76b19c2a52" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:11:15 user nova-compute[74850]: DEBUG nova.network.neutron [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG nova.network.neutron [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Updating instance_info_cache with network_info: [{"id": "73c210c0-59f3-4551-be32-77168edd3996", "address": "fa:16:3e:b9:08:c7", "network": {"id": "9ddeb146-c3d9-4d05-b46c-7fab63c8dfc2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1027315340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6c2226993ed451286826a667f802a76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c210c0-59", "ovs_interfaceid": "73c210c0-59f3-4551-be32-77168edd3996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Releasing lock "refresh_cache-ebed89ae-c110-4bf3-94e2-af76b19c2a52" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG nova.compute.manager [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Instance network_info: |[{"id": "73c210c0-59f3-4551-be32-77168edd3996", "address": "fa:16:3e:b9:08:c7", "network": {"id": "9ddeb146-c3d9-4d05-b46c-7fab63c8dfc2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1027315340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6c2226993ed451286826a667f802a76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c210c0-59", "ovs_interfaceid": "73c210c0-59f3-4551-be32-77168edd3996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3ff5bd26-3dae-4d14-b93a-20b6c3bd4fdf req-3d17d839-bb2a-47a6-9f9f-baadcd9c09bd service nova] Acquired lock "refresh_cache-ebed89ae-c110-4bf3-94e2-af76b19c2a52" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG nova.network.neutron [req-3ff5bd26-3dae-4d14-b93a-20b6c3bd4fdf req-3d17d839-bb2a-47a6-9f9f-baadcd9c09bd service nova] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Refreshing network info cache for port 73c210c0-59f3-4551-be32-77168edd3996 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Start _get_guest_xml network_info=[{"id": "73c210c0-59f3-4551-be32-77168edd3996", "address": "fa:16:3e:b9:08:c7", "network": {"id": "9ddeb146-c3d9-4d05-b46c-7fab63c8dfc2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1027315340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6c2226993ed451286826a667f802a76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c210c0-59", "ovs_interfaceid": "73c210c0-59f3-4551-be32-77168edd3996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 01:11:16 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:11:16 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:11:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:11:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-686842452',display_name='tempest-TestServerVolumeAttachmentScenario-server-686842452',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-686842452',id=48,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+ucdFGczkYtx3l5wA4WPIPUKBYvh+6AoM1IQM3aGxHuIaZqBCQ9BhMKH86+hVcdH3fcohZhEQ01mSt4Bpa332vfs5lrBt/MN9RuoVwKL4OgXvOD0FtpIy5fFQ22U6Rjg==',key_name='tempest-keypair-281209694',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6c2226993ed451286826a667f802a76',ramdisk_id='',reservation_id='r-h986oxot',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1207940089',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1207940089-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:11:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82838be39f3c4e829121d45993ad5531',uuid=ebed89ae-c110-4bf3-94e2-af76b19c2a52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73c210c0-59f3-4551-be32-77168edd3996", "address": "fa:16:3e:b9:08:c7", "network": {"id": "9ddeb146-c3d9-4d05-b46c-7fab63c8dfc2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1027315340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6c2226993ed451286826a667f802a76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c210c0-59", "ovs_interfaceid": "73c210c0-59f3-4551-be32-77168edd3996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Converting VIF {"id": "73c210c0-59f3-4551-be32-77168edd3996", "address": "fa:16:3e:b9:08:c7", "network": {"id": "9ddeb146-c3d9-4d05-b46c-7fab63c8dfc2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1027315340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6c2226993ed451286826a667f802a76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c210c0-59", "ovs_interfaceid": "73c210c0-59f3-4551-be32-77168edd3996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:08:c7,bridge_name='br-int',has_traffic_filtering=True,id=73c210c0-59f3-4551-be32-77168edd3996,network=Network(9ddeb146-c3d9-4d05-b46c-7fab63c8dfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73c210c0-59') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG nova.objects.instance [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lazy-loading 'pci_devices' on Instance uuid ebed89ae-c110-4bf3-94e2-af76b19c2a52 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] End _get_guest_xml xml=<domain type="kvm">
Nov 14 01:11:16 user nova-compute[74850]:   <uuid>ebed89ae-c110-4bf3-94e2-af76b19c2a52</uuid>
Nov 14 01:11:16 user nova-compute[74850]:   <name>instance-00000030</name>
Nov 14 01:11:16 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 01:11:16 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 01:11:16 user nova-compute[74850]:   <metadata>
Nov 14 01:11:16 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 01:11:16 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 01:11:16 user nova-compute[74850]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-686842452</nova:name>
Nov 14 01:11:16 user nova-compute[74850]:       <nova:creationTime>2023-11-14 01:11:16</nova:creationTime>
Nov 14 01:11:16 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 01:11:16 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 01:11:16 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 01:11:16 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 01:11:16 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 01:11:16 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 01:11:16 user nova-compute[74850]:       </nova:flavor>
Nov 14 01:11:16 user nova-compute[74850]:       <nova:owner>
Nov 14 01:11:16 user nova-compute[74850]:         <nova:user uuid="82838be39f3c4e829121d45993ad5531">tempest-TestServerVolumeAttachmentScenario-1207940089-project-member</nova:user>
Nov 14 01:11:16 user nova-compute[74850]:         <nova:project uuid="a6c2226993ed451286826a667f802a76">tempest-TestServerVolumeAttachmentScenario-1207940089</nova:project>
Nov 14 01:11:16 user nova-compute[74850]:       </nova:owner>
Nov 14 01:11:16 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 01:11:16 user nova-compute[74850]:       <nova:ports>
Nov 14 01:11:16 user nova-compute[74850]:         <nova:port uuid="73c210c0-59f3-4551-be32-77168edd3996">
Nov 14 01:11:16 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 01:11:16 user nova-compute[74850]:         </nova:port>
Nov 14 01:11:16 user nova-compute[74850]:       </nova:ports>
Nov 14 01:11:16 user nova-compute[74850]:     </nova:instance>
Nov 14 01:11:16 user nova-compute[74850]:   </metadata>
Nov 14 01:11:16 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 01:11:16 user nova-compute[74850]:     <system>
Nov 14 01:11:16 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 01:11:16 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 01:11:16 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 01:11:16 user nova-compute[74850]:       <entry name="serial">ebed89ae-c110-4bf3-94e2-af76b19c2a52</entry>
Nov 14 01:11:16 user nova-compute[74850]:       <entry name="uuid">ebed89ae-c110-4bf3-94e2-af76b19c2a52</entry>
Nov 14 01:11:16 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 01:11:16 user nova-compute[74850]:     </system>
Nov 14 01:11:16 user nova-compute[74850]:   </sysinfo>
Nov 14 01:11:16 user nova-compute[74850]:   <os>
Nov 14 01:11:16 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 01:11:16 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 01:11:16 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 01:11:16 user nova-compute[74850]:   </os>
Nov 14 01:11:16 user nova-compute[74850]:   <features>
Nov 14 01:11:16 user nova-compute[74850]:     <acpi/>
Nov 14 01:11:16 user nova-compute[74850]:     <apic/>
Nov 14 01:11:16 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 01:11:16 user nova-compute[74850]:   </features>
Nov 14 01:11:16 user nova-compute[74850]:   <clock offset="utc">
Nov 14 01:11:16 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 01:11:16 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 01:11:16 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 01:11:16 user nova-compute[74850]:   </clock>
Nov 14 01:11:16 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 01:11:16 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 01:11:16 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 01:11:16 user nova-compute[74850]:   </cpu>
Nov 14 01:11:16 user nova-compute[74850]:   <devices>
Nov 14 01:11:16 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 01:11:16 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 01:11:16 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/ebed89ae-c110-4bf3-94e2-af76b19c2a52/disk"/>
Nov 14 01:11:16 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 01:11:16 user nova-compute[74850]:     </disk>
Nov 14 01:11:16 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 01:11:16 user nova-compute[74850]:       <mac address="fa:16:3e:b9:08:c7"/>
Nov 14 01:11:16 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:11:16 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 01:11:16 user nova-compute[74850]:       <target dev="tap73c210c0-59"/>
Nov 14 01:11:16 user nova-compute[74850]:     </interface>
Nov 14 01:11:16 user nova-compute[74850]:     <serial type="pty">
Nov 14 01:11:16 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/ebed89ae-c110-4bf3-94e2-af76b19c2a52/console.log" append="off"/>
Nov 14 01:11:16 user nova-compute[74850]:     </serial>
Nov 14 01:11:16 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 01:11:16 user nova-compute[74850]:     <video>
Nov 14 01:11:16 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:11:16 user nova-compute[74850]:     </video>
Nov 14 01:11:16 user nova-compute[74850]:     <rng model="virtio">
Nov 14 01:11:16 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 01:11:16 user nova-compute[74850]:     </rng>
Nov 14 01:11:16 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 01:11:16 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 01:11:16 user nova-compute[74850]:       <stats period="10"/>
Nov 14 01:11:16 user nova-compute[74850]:     </memballoon>
Nov 14 01:11:16 user nova-compute[74850]:   </devices>
Nov 14 01:11:16 user nova-compute[74850]: </domain>
Nov 14 01:11:16 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:11:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-686842452',display_name='tempest-TestServerVolumeAttachmentScenario-server-686842452',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-686842452',id=48,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+ucdFGczkYtx3l5wA4WPIPUKBYvh+6AoM1IQM3aGxHuIaZqBCQ9BhMKH86+hVcdH3fcohZhEQ01mSt4Bpa332vfs5lrBt/MN9RuoVwKL4OgXvOD0FtpIy5fFQ22U6Rjg==',key_name='tempest-keypair-281209694',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6c2226993ed451286826a667f802a76',ramdisk_id='',reservation_id='r-h986oxot',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1207940089',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1207940089-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:11:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82838be39f3c4e829121d45993ad5531',uuid=ebed89ae-c110-4bf3-94e2-af76b19c2a52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73c210c0-59f3-4551-be32-77168edd3996", "address": "fa:16:3e:b9:08:c7", "network": {"id": "9ddeb146-c3d9-4d05-b46c-7fab63c8dfc2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1027315340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6c2226993ed451286826a667f802a76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c210c0-59", "ovs_interfaceid": "73c210c0-59f3-4551-be32-77168edd3996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Converting VIF {"id": "73c210c0-59f3-4551-be32-77168edd3996", "address": "fa:16:3e:b9:08:c7", "network": {"id": "9ddeb146-c3d9-4d05-b46c-7fab63c8dfc2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1027315340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6c2226993ed451286826a667f802a76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c210c0-59", "ovs_interfaceid": "73c210c0-59f3-4551-be32-77168edd3996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:08:c7,bridge_name='br-int',has_traffic_filtering=True,id=73c210c0-59f3-4551-be32-77168edd3996,network=Network(9ddeb146-c3d9-4d05-b46c-7fab63c8dfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73c210c0-59') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG os_vif [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:08:c7,bridge_name='br-int',has_traffic_filtering=True,id=73c210c0-59f3-4551-be32-77168edd3996,network=Network(9ddeb146-c3d9-4d05-b46c-7fab63c8dfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73c210c0-59') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2667a300-523b-5fe0-b756-1d6b5f2f2a66', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73c210c0-59, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap73c210c0-59, col_values=(('qos', UUID('2bd93e82-637b-46e1-b02e-988283ac68bc')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap73c210c0-59, col_values=(('external_ids', {'iface-id': '73c210c0-59f3-4551-be32-77168edd3996', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:08:c7', 'vm-uuid': 'ebed89ae-c110-4bf3-94e2-af76b19c2a52'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:16 user nova-compute[74850]: INFO os_vif [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:08:c7,bridge_name='br-int',has_traffic_filtering=True,id=73c210c0-59f3-4551-be32-77168edd3996,network=Network(9ddeb146-c3d9-4d05-b46c-7fab63c8dfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73c210c0-59')
Nov 14 01:11:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] No VIF found with MAC fa:16:3e:b9:08:c7, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG nova.network.neutron [req-3ff5bd26-3dae-4d14-b93a-20b6c3bd4fdf req-3d17d839-bb2a-47a6-9f9f-baadcd9c09bd service nova] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Updated VIF entry in instance network info cache for port 73c210c0-59f3-4551-be32-77168edd3996. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG nova.network.neutron [req-3ff5bd26-3dae-4d14-b93a-20b6c3bd4fdf req-3d17d839-bb2a-47a6-9f9f-baadcd9c09bd service nova] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Updating instance_info_cache with network_info: [{"id": "73c210c0-59f3-4551-be32-77168edd3996", "address": "fa:16:3e:b9:08:c7", "network": {"id": "9ddeb146-c3d9-4d05-b46c-7fab63c8dfc2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1027315340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6c2226993ed451286826a667f802a76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c210c0-59", "ovs_interfaceid": "73c210c0-59f3-4551-be32-77168edd3996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3ff5bd26-3dae-4d14-b93a-20b6c3bd4fdf req-3d17d839-bb2a-47a6-9f9f-baadcd9c09bd service nova] Releasing lock "refresh_cache-ebed89ae-c110-4bf3-94e2-af76b19c2a52" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG nova.compute.manager [req-5a485390-aeba-493f-ab73-9645dd9e9a1a req-6b0ffb60-5745-4e7a-8fe5-18c80ec01c0d service nova] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Received event network-vif-plugged-4f8a261a-c9f2-47b4-a0e7-ae6730ec962a {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5a485390-aeba-493f-ab73-9645dd9e9a1a req-6b0ffb60-5745-4e7a-8fe5-18c80ec01c0d service nova] Acquiring lock "6ac6355d-eb05-4d1a-94c5-8ca630e926f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5a485390-aeba-493f-ab73-9645dd9e9a1a req-6b0ffb60-5745-4e7a-8fe5-18c80ec01c0d service nova] Lock "6ac6355d-eb05-4d1a-94c5-8ca630e926f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5a485390-aeba-493f-ab73-9645dd9e9a1a req-6b0ffb60-5745-4e7a-8fe5-18c80ec01c0d service nova] Lock "6ac6355d-eb05-4d1a-94c5-8ca630e926f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:11:16 user nova-compute[74850]: DEBUG nova.compute.manager [req-5a485390-aeba-493f-ab73-9645dd9e9a1a req-6b0ffb60-5745-4e7a-8fe5-18c80ec01c0d service nova] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] No waiting events found dispatching network-vif-plugged-4f8a261a-c9f2-47b4-a0e7-ae6730ec962a {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:11:16 user nova-compute[74850]: WARNING nova.compute.manager [req-5a485390-aeba-493f-ab73-9645dd9e9a1a req-6b0ffb60-5745-4e7a-8fe5-18c80ec01c0d service nova] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Received unexpected event network-vif-plugged-4f8a261a-c9f2-47b4-a0e7-ae6730ec962a for instance with vm_state active and task_state None.
Nov 14 01:11:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:18 user nova-compute[74850]: DEBUG nova.compute.manager [req-6124df44-ecc5-42ec-acd7-3f3bb8fca1b2 req-e3931c01-8b48-48a9-8125-00e5168d9661 service nova] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Received event network-vif-plugged-4f8a261a-c9f2-47b4-a0e7-ae6730ec962a {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:11:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6124df44-ecc5-42ec-acd7-3f3bb8fca1b2 req-e3931c01-8b48-48a9-8125-00e5168d9661 service nova] Acquiring lock "6ac6355d-eb05-4d1a-94c5-8ca630e926f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:11:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6124df44-ecc5-42ec-acd7-3f3bb8fca1b2 req-e3931c01-8b48-48a9-8125-00e5168d9661 service nova] Lock "6ac6355d-eb05-4d1a-94c5-8ca630e926f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:11:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6124df44-ecc5-42ec-acd7-3f3bb8fca1b2 req-e3931c01-8b48-48a9-8125-00e5168d9661 service nova] Lock "6ac6355d-eb05-4d1a-94c5-8ca630e926f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:11:18 user nova-compute[74850]: DEBUG nova.compute.manager [req-6124df44-ecc5-42ec-acd7-3f3bb8fca1b2 req-e3931c01-8b48-48a9-8125-00e5168d9661 service nova] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] No waiting events found dispatching network-vif-plugged-4f8a261a-c9f2-47b4-a0e7-ae6730ec962a {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:11:18 user nova-compute[74850]: WARNING nova.compute.manager [req-6124df44-ecc5-42ec-acd7-3f3bb8fca1b2 req-e3931c01-8b48-48a9-8125-00e5168d9661 service nova] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Received unexpected event network-vif-plugged-4f8a261a-c9f2-47b4-a0e7-ae6730ec962a for instance with vm_state active and task_state None.
Nov 14 01:11:18 user nova-compute[74850]: DEBUG nova.compute.manager [req-6124df44-ecc5-42ec-acd7-3f3bb8fca1b2 req-e3931c01-8b48-48a9-8125-00e5168d9661 service nova] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Received event network-vif-plugged-73c210c0-59f3-4551-be32-77168edd3996 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:11:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6124df44-ecc5-42ec-acd7-3f3bb8fca1b2 req-e3931c01-8b48-48a9-8125-00e5168d9661 service nova] Acquiring lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:11:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6124df44-ecc5-42ec-acd7-3f3bb8fca1b2 req-e3931c01-8b48-48a9-8125-00e5168d9661 service nova] Lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:11:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6124df44-ecc5-42ec-acd7-3f3bb8fca1b2 req-e3931c01-8b48-48a9-8125-00e5168d9661 service nova] Lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:11:18 user nova-compute[74850]: DEBUG nova.compute.manager [req-6124df44-ecc5-42ec-acd7-3f3bb8fca1b2 req-e3931c01-8b48-48a9-8125-00e5168d9661 service nova] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] No waiting events found dispatching network-vif-plugged-73c210c0-59f3-4551-be32-77168edd3996 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:11:18 user nova-compute[74850]: WARNING nova.compute.manager [req-6124df44-ecc5-42ec-acd7-3f3bb8fca1b2 req-e3931c01-8b48-48a9-8125-00e5168d9661 service nova] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Received unexpected event network-vif-plugged-73c210c0-59f3-4551-be32-77168edd3996 for instance with vm_state building and task_state spawning.
Nov 14 01:11:18 user nova-compute[74850]: DEBUG nova.compute.manager [req-6124df44-ecc5-42ec-acd7-3f3bb8fca1b2 req-e3931c01-8b48-48a9-8125-00e5168d9661 service nova] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Received event network-vif-plugged-73c210c0-59f3-4551-be32-77168edd3996 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:11:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6124df44-ecc5-42ec-acd7-3f3bb8fca1b2 req-e3931c01-8b48-48a9-8125-00e5168d9661 service nova] Acquiring lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:11:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6124df44-ecc5-42ec-acd7-3f3bb8fca1b2 req-e3931c01-8b48-48a9-8125-00e5168d9661 service nova] Lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:11:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-6124df44-ecc5-42ec-acd7-3f3bb8fca1b2 req-e3931c01-8b48-48a9-8125-00e5168d9661 service nova] Lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:11:18 user nova-compute[74850]: DEBUG nova.compute.manager [req-6124df44-ecc5-42ec-acd7-3f3bb8fca1b2 req-e3931c01-8b48-48a9-8125-00e5168d9661 service nova] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] No waiting events found dispatching network-vif-plugged-73c210c0-59f3-4551-be32-77168edd3996 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:11:18 user nova-compute[74850]: WARNING nova.compute.manager [req-6124df44-ecc5-42ec-acd7-3f3bb8fca1b2 req-e3931c01-8b48-48a9-8125-00e5168d9661 service nova] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Received unexpected event network-vif-plugged-73c210c0-59f3-4551-be32-77168edd3996 for instance with vm_state building and task_state spawning.
Nov 14 01:11:19 user nova-compute[74850]: DEBUG nova.compute.manager [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 01:11:19 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 01:11:19 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Instance spawned successfully.
Nov 14 01:11:19 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 01:11:19 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:11:19 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:11:19 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:11:19 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:11:19 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:11:19 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:11:19 user nova-compute[74850]: INFO nova.compute.manager [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Took 5.27 seconds to spawn the instance on the hypervisor.
Nov 14 01:11:19 user nova-compute[74850]: DEBUG nova.compute.manager [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 01:11:19 user nova-compute[74850]: INFO nova.compute.manager [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Took 5.94 seconds to build instance.
Nov 14 01:11:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b64b08f4-5f24-4505-b755-7beb32a3ddb3 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.066s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:11:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:23 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:11:23 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Triggering sync for uuid c7952bff-87d6-46c1-a6d4-7729dc4893ff {{(pid=74850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 01:11:23 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Triggering sync for uuid 702746f7-305f-4eac-a71a-6c08b7cbccd8 {{(pid=74850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 01:11:23 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Triggering sync for uuid 3504ddd3-bdd8-465e-aec5-190acdd563f6 {{(pid=74850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 01:11:23 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Triggering sync for uuid 709f145b-a471-4a1d-86dc-327e1c3fabb9 {{(pid=74850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 01:11:23 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Triggering sync for uuid 6ac6355d-eb05-4d1a-94c5-8ca630e926f4 {{(pid=74850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 01:11:23 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Triggering sync for uuid ebed89ae-c110-4bf3-94e2-af76b19c2a52 {{(pid=74850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 01:11:23 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Triggering sync for uuid efa96c60-9902-4ca9-8f0e-d27bdb883829 {{(pid=74850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 01:11:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "c7952bff-87d6-46c1-a6d4-7729dc4893ff" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:11:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "c7952bff-87d6-46c1-a6d4-7729dc4893ff" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:11:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "702746f7-305f-4eac-a71a-6c08b7cbccd8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:11:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "702746f7-305f-4eac-a71a-6c08b7cbccd8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:11:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "3504ddd3-bdd8-465e-aec5-190acdd563f6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:11:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "3504ddd3-bdd8-465e-aec5-190acdd563f6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:11:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "709f145b-a471-4a1d-86dc-327e1c3fabb9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:11:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "709f145b-a471-4a1d-86dc-327e1c3fabb9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:11:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "6ac6355d-eb05-4d1a-94c5-8ca630e926f4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:11:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "6ac6355d-eb05-4d1a-94c5-8ca630e926f4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:11:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:11:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:11:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "efa96c60-9902-4ca9-8f0e-d27bdb883829" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:11:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "efa96c60-9902-4ca9-8f0e-d27bdb883829" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:11:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "c7952bff-87d6-46c1-a6d4-7729dc4893ff" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:11:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "702746f7-305f-4eac-a71a-6c08b7cbccd8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:11:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "3504ddd3-bdd8-465e-aec5-190acdd563f6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:11:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "6ac6355d-eb05-4d1a-94c5-8ca630e926f4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:11:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "709f145b-a471-4a1d-86dc-327e1c3fabb9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:11:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:11:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "efa96c60-9902-4ca9-8f0e-d27bdb883829" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:11:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-3aae51ba-d48e-435a-889d-1c2e8ce3990b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "3504ddd3-bdd8-465e-aec5-190acdd563f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:11:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-3aae51ba-d48e-435a-889d-1c2e8ce3990b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "3504ddd3-bdd8-465e-aec5-190acdd563f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:11:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-3aae51ba-d48e-435a-889d-1c2e8ce3990b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "3504ddd3-bdd8-465e-aec5-190acdd563f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:11:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-3aae51ba-d48e-435a-889d-1c2e8ce3990b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "3504ddd3-bdd8-465e-aec5-190acdd563f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:11:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-3aae51ba-d48e-435a-889d-1c2e8ce3990b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "3504ddd3-bdd8-465e-aec5-190acdd563f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:11:27 user nova-compute[74850]: INFO nova.compute.manager [None req-3aae51ba-d48e-435a-889d-1c2e8ce3990b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Terminating instance
Nov 14 01:11:27 user nova-compute[74850]: DEBUG nova.compute.manager [None req-3aae51ba-d48e-435a-889d-1c2e8ce3990b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 01:11:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:28 user nova-compute[74850]: DEBUG nova.compute.manager [req-204db17b-7557-4f96-bfac-94b8bb7649b5 req-b2a4c1a9-5b88-40e0-8eef-464f0a32bb00 service nova] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Received event network-vif-unplugged-8ac01677-8e6a-417b-b7a8-2fc5026404f9 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:11:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-204db17b-7557-4f96-bfac-94b8bb7649b5 req-b2a4c1a9-5b88-40e0-8eef-464f0a32bb00 service nova] Acquiring lock "3504ddd3-bdd8-465e-aec5-190acdd563f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:11:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-204db17b-7557-4f96-bfac-94b8bb7649b5 req-b2a4c1a9-5b88-40e0-8eef-464f0a32bb00 service nova] Lock "3504ddd3-bdd8-465e-aec5-190acdd563f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:11:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-204db17b-7557-4f96-bfac-94b8bb7649b5 req-b2a4c1a9-5b88-40e0-8eef-464f0a32bb00 service nova] Lock "3504ddd3-bdd8-465e-aec5-190acdd563f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:11:28 user nova-compute[74850]: DEBUG nova.compute.manager [req-204db17b-7557-4f96-bfac-94b8bb7649b5 req-b2a4c1a9-5b88-40e0-8eef-464f0a32bb00 service nova] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] No waiting events found dispatching network-vif-unplugged-8ac01677-8e6a-417b-b7a8-2fc5026404f9 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:11:28 user nova-compute[74850]: DEBUG nova.compute.manager [req-204db17b-7557-4f96-bfac-94b8bb7649b5 req-b2a4c1a9-5b88-40e0-8eef-464f0a32bb00 service nova] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Received event network-vif-unplugged-8ac01677-8e6a-417b-b7a8-2fc5026404f9 for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 01:11:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:28 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Instance destroyed successfully.
Nov 14 01:11:28 user nova-compute[74850]: DEBUG nova.objects.instance [None req-3aae51ba-d48e-435a-889d-1c2e8ce3990b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lazy-loading 'resources' on Instance uuid 3504ddd3-bdd8-465e-aec5-190acdd563f6 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:11:28 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-3aae51ba-d48e-435a-889d-1c2e8ce3990b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:02:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1277467798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1277467798',id=36,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T01:02:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='491aa2a4f38140788cb0de9762a8baf4',ramdisk_id='',reservation_id='r-xgxj39jn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-726213232',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T01:04:02Z,user_data=None,user_id='a5bb5d788a3b4871ae41f57d06f785f2',uuid=3504ddd3-bdd8-465e-aec5-190acdd563f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ac01677-8e6a-417b-b7a8-2fc5026404f9", "address": "fa:16:3e:2a:e3:16", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac01677-8e", "ovs_interfaceid": "8ac01677-8e6a-417b-b7a8-2fc5026404f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 01:11:28 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-3aae51ba-d48e-435a-889d-1c2e8ce3990b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Converting VIF {"id": "8ac01677-8e6a-417b-b7a8-2fc5026404f9", "address": "fa:16:3e:2a:e3:16", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac01677-8e", "ovs_interfaceid": "8ac01677-8e6a-417b-b7a8-2fc5026404f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:11:28 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-3aae51ba-d48e-435a-889d-1c2e8ce3990b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:e3:16,bridge_name='br-int',has_traffic_filtering=True,id=8ac01677-8e6a-417b-b7a8-2fc5026404f9,network=Network(6f8f66ca-e2e8-4565-a05c-df75a16699ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac01677-8e') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:11:28 user nova-compute[74850]: DEBUG os_vif [None req-3aae51ba-d48e-435a-889d-1c2e8ce3990b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:e3:16,bridge_name='br-int',has_traffic_filtering=True,id=8ac01677-8e6a-417b-b7a8-2fc5026404f9,network=Network(6f8f66ca-e2e8-4565-a05c-df75a16699ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac01677-8e') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 01:11:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ac01677-8e, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:11:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:11:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d83cb77-6dd9-488f-a500-132873b1c487) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:11:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:11:28 user nova-compute[74850]: INFO os_vif [None req-3aae51ba-d48e-435a-889d-1c2e8ce3990b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:e3:16,bridge_name='br-int',has_traffic_filtering=True,id=8ac01677-8e6a-417b-b7a8-2fc5026404f9,network=Network(6f8f66ca-e2e8-4565-a05c-df75a16699ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac01677-8e')
Nov 14 01:11:28 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-3aae51ba-d48e-435a-889d-1c2e8ce3990b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Deleting instance files /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6_del
Nov 14 01:11:28 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-3aae51ba-d48e-435a-889d-1c2e8ce3990b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Deletion of /opt/stack/data/nova/instances/3504ddd3-bdd8-465e-aec5-190acdd563f6_del complete
Nov 14 01:11:28 user nova-compute[74850]: INFO nova.compute.manager [None req-3aae51ba-d48e-435a-889d-1c2e8ce3990b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 14 01:11:28 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-3aae51ba-d48e-435a-889d-1c2e8ce3990b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 01:11:28 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 01:11:28 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 01:11:29 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:11:29 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Took 0.45 seconds to deallocate network for instance.
Nov 14 01:11:29 user nova-compute[74850]: DEBUG nova.compute.manager [req-5067dc71-0dd7-4f68-aaa5-2c55253d83f8 req-a835a75a-93d0-41bb-900c-a46864a476d2 service nova] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Received event network-vif-deleted-8ac01677-8e6a-417b-b7a8-2fc5026404f9 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:11:29 user nova-compute[74850]: INFO nova.compute.manager [req-5067dc71-0dd7-4f68-aaa5-2c55253d83f8 req-a835a75a-93d0-41bb-900c-a46864a476d2 service nova] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Neutron deleted interface 8ac01677-8e6a-417b-b7a8-2fc5026404f9; detaching it from the instance and deleting it from the info cache
Nov 14 01:11:29 user nova-compute[74850]: DEBUG nova.network.neutron [req-5067dc71-0dd7-4f68-aaa5-2c55253d83f8 req-a835a75a-93d0-41bb-900c-a46864a476d2 service nova] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:11:29 user nova-compute[74850]: DEBUG nova.compute.manager [req-5067dc71-0dd7-4f68-aaa5-2c55253d83f8 req-a835a75a-93d0-41bb-900c-a46864a476d2 service nova] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Detach interface failed, port_id=8ac01677-8e6a-417b-b7a8-2fc5026404f9, reason: Instance 3504ddd3-bdd8-465e-aec5-190acdd563f6 could not be found. {{(pid=74850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 01:11:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-3aae51ba-d48e-435a-889d-1c2e8ce3990b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:11:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-3aae51ba-d48e-435a-889d-1c2e8ce3990b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:11:29 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-3aae51ba-d48e-435a-889d-1c2e8ce3990b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:11:29 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-3aae51ba-d48e-435a-889d-1c2e8ce3990b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:11:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-3aae51ba-d48e-435a-889d-1c2e8ce3990b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.258s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:11:29 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-3aae51ba-d48e-435a-889d-1c2e8ce3990b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Deleted allocations for instance 3504ddd3-bdd8-465e-aec5-190acdd563f6
Nov 14 01:11:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-3aae51ba-d48e-435a-889d-1c2e8ce3990b tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "3504ddd3-bdd8-465e-aec5-190acdd563f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.829s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:11:30 user nova-compute[74850]: DEBUG nova.compute.manager [req-fd93609d-2be7-47aa-87a1-8615a107311d req-5ee92177-ac43-4ce7-b4a1-e1eec2f75ba9 service nova] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Received event network-vif-plugged-8ac01677-8e6a-417b-b7a8-2fc5026404f9 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:11:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fd93609d-2be7-47aa-87a1-8615a107311d req-5ee92177-ac43-4ce7-b4a1-e1eec2f75ba9 service nova] Acquiring lock "3504ddd3-bdd8-465e-aec5-190acdd563f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:11:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fd93609d-2be7-47aa-87a1-8615a107311d req-5ee92177-ac43-4ce7-b4a1-e1eec2f75ba9 service nova] Lock "3504ddd3-bdd8-465e-aec5-190acdd563f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:11:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fd93609d-2be7-47aa-87a1-8615a107311d req-5ee92177-ac43-4ce7-b4a1-e1eec2f75ba9 service nova] Lock "3504ddd3-bdd8-465e-aec5-190acdd563f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:11:30 user nova-compute[74850]: DEBUG nova.compute.manager [req-fd93609d-2be7-47aa-87a1-8615a107311d req-5ee92177-ac43-4ce7-b4a1-e1eec2f75ba9 service nova] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] No waiting events found dispatching network-vif-plugged-8ac01677-8e6a-417b-b7a8-2fc5026404f9 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:11:30 user nova-compute[74850]: WARNING nova.compute.manager [req-fd93609d-2be7-47aa-87a1-8615a107311d req-5ee92177-ac43-4ce7-b4a1-e1eec2f75ba9 service nova] [instance: 3504ddd3-bdd8-465e-aec5-190acdd563f6] Received unexpected event network-vif-plugged-8ac01677-8e6a-417b-b7a8-2fc5026404f9 for instance with vm_state deleted and task_state None.
Nov 14 01:11:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4be4c21b-0bbb-4d71-bddc-89d7b0353890 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "709f145b-a471-4a1d-86dc-327e1c3fabb9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:11:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4be4c21b-0bbb-4d71-bddc-89d7b0353890 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "709f145b-a471-4a1d-86dc-327e1c3fabb9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:11:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4be4c21b-0bbb-4d71-bddc-89d7b0353890 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "709f145b-a471-4a1d-86dc-327e1c3fabb9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:11:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4be4c21b-0bbb-4d71-bddc-89d7b0353890 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "709f145b-a471-4a1d-86dc-327e1c3fabb9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:11:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4be4c21b-0bbb-4d71-bddc-89d7b0353890 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "709f145b-a471-4a1d-86dc-327e1c3fabb9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:11:41 user nova-compute[74850]: INFO nova.compute.manager [None req-4be4c21b-0bbb-4d71-bddc-89d7b0353890 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Terminating instance
Nov 14 01:11:41 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4be4c21b-0bbb-4d71-bddc-89d7b0353890 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 01:11:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:41 user nova-compute[74850]: DEBUG nova.compute.manager [req-aaa896a7-f4d0-4130-afc3-670717fb0a53 req-6daead93-4025-40e2-bd5c-994caa7d3d6c service nova] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Received event network-vif-unplugged-2cdb56a9-9d40-470c-8640-cd9ce3308893 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:11:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-aaa896a7-f4d0-4130-afc3-670717fb0a53 req-6daead93-4025-40e2-bd5c-994caa7d3d6c service nova] Acquiring lock "709f145b-a471-4a1d-86dc-327e1c3fabb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:11:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-aaa896a7-f4d0-4130-afc3-670717fb0a53 req-6daead93-4025-40e2-bd5c-994caa7d3d6c service nova] Lock "709f145b-a471-4a1d-86dc-327e1c3fabb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:11:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-aaa896a7-f4d0-4130-afc3-670717fb0a53 req-6daead93-4025-40e2-bd5c-994caa7d3d6c service nova] Lock "709f145b-a471-4a1d-86dc-327e1c3fabb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:11:41 user nova-compute[74850]: DEBUG nova.compute.manager [req-aaa896a7-f4d0-4130-afc3-670717fb0a53 req-6daead93-4025-40e2-bd5c-994caa7d3d6c service nova] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] No waiting events found dispatching network-vif-unplugged-2cdb56a9-9d40-470c-8640-cd9ce3308893 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:11:41 user nova-compute[74850]: DEBUG nova.compute.manager [req-aaa896a7-f4d0-4130-afc3-670717fb0a53 req-6daead93-4025-40e2-bd5c-994caa7d3d6c service nova] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Received event network-vif-unplugged-2cdb56a9-9d40-470c-8640-cd9ce3308893 for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 01:11:42 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Instance destroyed successfully.
Nov 14 01:11:42 user nova-compute[74850]: DEBUG nova.objects.instance [None req-4be4c21b-0bbb-4d71-bddc-89d7b0353890 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lazy-loading 'resources' on Instance uuid 709f145b-a471-4a1d-86dc-327e1c3fabb9 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:11:42 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-4be4c21b-0bbb-4d71-bddc-89d7b0353890 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:08:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2112312360',display_name='tempest-AttachVolumeNegativeTest-server-2112312360',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2112312360',id=46,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0U/UT+aEjcUQ6Vd+cHQjHwFaX3CmTatHNXaTQqBKHsm7Q3bwOVV9YbnpTgRKLqMIxW7LlekOgXWlXyDWq8y2NlA56CNUn0e/YRNYCKerhwNV4ok9LMDE3nniToFyeHGQ==',key_name='tempest-keypair-893979353',keypairs=<?>,launch_index=0,launched_at=2023-11-14T01:08:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35f609057d1e44679838d565d80cade3',ramdisk_id='',reservation_id='r-sctdhzt6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1995397455',owner_user_name='tempest-AttachVolumeNegativeTest-1995397455-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T01:08:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb027592ab214b57b389227a97576a43',uuid=709f145b-a471-4a1d-86dc-327e1c3fabb9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2cdb56a9-9d40-470c-8640-cd9ce3308893", "address": "fa:16:3e:85:8d:80", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cdb56a9-9d", "ovs_interfaceid": "2cdb56a9-9d40-470c-8640-cd9ce3308893", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 01:11:42 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4be4c21b-0bbb-4d71-bddc-89d7b0353890 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Converting VIF {"id": "2cdb56a9-9d40-470c-8640-cd9ce3308893", "address": "fa:16:3e:85:8d:80", "network": {"id": "11208f55-0e63-4c33-a12c-e061c8061eec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1397301549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35f609057d1e44679838d565d80cade3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cdb56a9-9d", "ovs_interfaceid": "2cdb56a9-9d40-470c-8640-cd9ce3308893", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:11:42 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4be4c21b-0bbb-4d71-bddc-89d7b0353890 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:8d:80,bridge_name='br-int',has_traffic_filtering=True,id=2cdb56a9-9d40-470c-8640-cd9ce3308893,network=Network(11208f55-0e63-4c33-a12c-e061c8061eec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cdb56a9-9d') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:11:42 user nova-compute[74850]: DEBUG os_vif [None req-4be4c21b-0bbb-4d71-bddc-89d7b0353890 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:8d:80,bridge_name='br-int',has_traffic_filtering=True,id=2cdb56a9-9d40-470c-8640-cd9ce3308893,network=Network(11208f55-0e63-4c33-a12c-e061c8061eec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cdb56a9-9d') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 01:11:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2cdb56a9-9d, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:11:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:11:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38c1bc18-ea61-4b4a-83eb-26c55b480f69) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:11:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:42 user nova-compute[74850]: INFO os_vif [None req-4be4c21b-0bbb-4d71-bddc-89d7b0353890 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:8d:80,bridge_name='br-int',has_traffic_filtering=True,id=2cdb56a9-9d40-470c-8640-cd9ce3308893,network=Network(11208f55-0e63-4c33-a12c-e061c8061eec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cdb56a9-9d')
Nov 14 01:11:42 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-4be4c21b-0bbb-4d71-bddc-89d7b0353890 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Deleting instance files /opt/stack/data/nova/instances/709f145b-a471-4a1d-86dc-327e1c3fabb9_del
Nov 14 01:11:42 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-4be4c21b-0bbb-4d71-bddc-89d7b0353890 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Deletion of /opt/stack/data/nova/instances/709f145b-a471-4a1d-86dc-327e1c3fabb9_del complete
Nov 14 01:11:42 user nova-compute[74850]: INFO nova.compute.manager [None req-4be4c21b-0bbb-4d71-bddc-89d7b0353890 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Took 0.82 seconds to destroy the instance on the hypervisor.
Nov 14 01:11:42 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-4be4c21b-0bbb-4d71-bddc-89d7b0353890 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 01:11:42 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 01:11:42 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 01:11:43 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:11:43 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Took 0.73 seconds to deallocate network for instance.
Nov 14 01:11:43 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4be4c21b-0bbb-4d71-bddc-89d7b0353890 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:11:43 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4be4c21b-0bbb-4d71-bddc-89d7b0353890 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:11:43 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4be4c21b-0bbb-4d71-bddc-89d7b0353890 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:11:43 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4be4c21b-0bbb-4d71-bddc-89d7b0353890 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:11:43 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4be4c21b-0bbb-4d71-bddc-89d7b0353890 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:11:43 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-4be4c21b-0bbb-4d71-bddc-89d7b0353890 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Deleted allocations for instance 709f145b-a471-4a1d-86dc-327e1c3fabb9
Nov 14 01:11:43 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4be4c21b-0bbb-4d71-bddc-89d7b0353890 tempest-AttachVolumeNegativeTest-1995397455 tempest-AttachVolumeNegativeTest-1995397455-project-member] Lock "709f145b-a471-4a1d-86dc-327e1c3fabb9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.095s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:11:43 user nova-compute[74850]: DEBUG nova.compute.manager [req-5512dd00-4f72-4017-a651-93422f4cbe77 req-a79adca5-2ec5-47a6-96e5-9e72dd6beed4 service nova] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Received event network-vif-plugged-2cdb56a9-9d40-470c-8640-cd9ce3308893 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:11:43 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5512dd00-4f72-4017-a651-93422f4cbe77 req-a79adca5-2ec5-47a6-96e5-9e72dd6beed4 service nova] Acquiring lock "709f145b-a471-4a1d-86dc-327e1c3fabb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:11:43 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5512dd00-4f72-4017-a651-93422f4cbe77 req-a79adca5-2ec5-47a6-96e5-9e72dd6beed4 service nova] Lock "709f145b-a471-4a1d-86dc-327e1c3fabb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:11:43 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5512dd00-4f72-4017-a651-93422f4cbe77 req-a79adca5-2ec5-47a6-96e5-9e72dd6beed4 service nova] Lock "709f145b-a471-4a1d-86dc-327e1c3fabb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:11:43 user nova-compute[74850]: DEBUG nova.compute.manager [req-5512dd00-4f72-4017-a651-93422f4cbe77 req-a79adca5-2ec5-47a6-96e5-9e72dd6beed4 service nova] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] No waiting events found dispatching network-vif-plugged-2cdb56a9-9d40-470c-8640-cd9ce3308893 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:11:43 user nova-compute[74850]: WARNING nova.compute.manager [req-5512dd00-4f72-4017-a651-93422f4cbe77 req-a79adca5-2ec5-47a6-96e5-9e72dd6beed4 service nova] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Received unexpected event network-vif-plugged-2cdb56a9-9d40-470c-8640-cd9ce3308893 for instance with vm_state deleted and task_state None.
Nov 14 01:11:43 user nova-compute[74850]: DEBUG nova.compute.manager [req-5512dd00-4f72-4017-a651-93422f4cbe77 req-a79adca5-2ec5-47a6-96e5-9e72dd6beed4 service nova] [instance: 709f145b-a471-4a1d-86dc-327e1c3fabb9] Received event network-vif-deleted-2cdb56a9-9d40-470c-8640-cd9ce3308893 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:11:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:11:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:00 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:12:00 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:12:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:12:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:12:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:12:00 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 01:12:01 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:12:01 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:12:01 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:12:01 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:12:01 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:12:01 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:12:01 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:12:01 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:12:01 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:12:01 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:12:01 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebed89ae-c110-4bf3-94e2-af76b19c2a52/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:12:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebed89ae-c110-4bf3-94e2-af76b19c2a52/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:12:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebed89ae-c110-4bf3-94e2-af76b19c2a52/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:12:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebed89ae-c110-4bf3-94e2-af76b19c2a52/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:12:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:02 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:12:02 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:12:02 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=8311MB free_disk=24.964603424072266GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 01:12:02 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:12:02 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:12:02 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance c7952bff-87d6-46c1-a6d4-7729dc4893ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:12:02 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 702746f7-305f-4eac-a71a-6c08b7cbccd8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:12:02 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance efa96c60-9902-4ca9-8f0e-d27bdb883829 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:12:02 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 6ac6355d-eb05-4d1a-94c5-8ca630e926f4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:12:02 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance ebed89ae-c110-4bf3-94e2-af76b19c2a52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:12:02 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 01:12:02 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 01:12:02 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:12:02 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:12:02 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 01:12:02 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.316s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:12:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e4aa4f96-4a9e-471b-b82c-e97e716683b5 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "efa96c60-9902-4ca9-8f0e-d27bdb883829" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:12:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e4aa4f96-4a9e-471b-b82c-e97e716683b5 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "efa96c60-9902-4ca9-8f0e-d27bdb883829" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:12:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e4aa4f96-4a9e-471b-b82c-e97e716683b5 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "efa96c60-9902-4ca9-8f0e-d27bdb883829-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:12:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e4aa4f96-4a9e-471b-b82c-e97e716683b5 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "efa96c60-9902-4ca9-8f0e-d27bdb883829-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:12:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e4aa4f96-4a9e-471b-b82c-e97e716683b5 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "efa96c60-9902-4ca9-8f0e-d27bdb883829-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:12:07 user nova-compute[74850]: INFO nova.compute.manager [None req-e4aa4f96-4a9e-471b-b82c-e97e716683b5 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Terminating instance
Nov 14 01:12:07 user nova-compute[74850]: DEBUG nova.compute.manager [None req-e4aa4f96-4a9e-471b-b82c-e97e716683b5 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 01:12:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:07 user nova-compute[74850]: DEBUG nova.compute.manager [req-fffecf8c-c7b3-459a-8292-62e08a26bb25 req-bdc27e99-859e-4bfa-8097-fcac8e74bf21 service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Received event network-vif-unplugged-5e053f78-6ef6-4f30-aedb-30306f10975b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:12:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fffecf8c-c7b3-459a-8292-62e08a26bb25 req-bdc27e99-859e-4bfa-8097-fcac8e74bf21 service nova] Acquiring lock "efa96c60-9902-4ca9-8f0e-d27bdb883829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:12:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fffecf8c-c7b3-459a-8292-62e08a26bb25 req-bdc27e99-859e-4bfa-8097-fcac8e74bf21 service nova] Lock "efa96c60-9902-4ca9-8f0e-d27bdb883829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:12:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fffecf8c-c7b3-459a-8292-62e08a26bb25 req-bdc27e99-859e-4bfa-8097-fcac8e74bf21 service nova] Lock "efa96c60-9902-4ca9-8f0e-d27bdb883829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:12:07 user nova-compute[74850]: DEBUG nova.compute.manager [req-fffecf8c-c7b3-459a-8292-62e08a26bb25 req-bdc27e99-859e-4bfa-8097-fcac8e74bf21 service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] No waiting events found dispatching network-vif-unplugged-5e053f78-6ef6-4f30-aedb-30306f10975b {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:12:07 user nova-compute[74850]: DEBUG nova.compute.manager [req-fffecf8c-c7b3-459a-8292-62e08a26bb25 req-bdc27e99-859e-4bfa-8097-fcac8e74bf21 service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Received event network-vif-unplugged-5e053f78-6ef6-4f30-aedb-30306f10975b for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 01:12:07 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:12:07 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Instance destroyed successfully.
Nov 14 01:12:07 user nova-compute[74850]: DEBUG nova.objects.instance [None req-e4aa4f96-4a9e-471b-b82c-e97e716683b5 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lazy-loading 'resources' on Instance uuid efa96c60-9902-4ca9-8f0e-d27bdb883829 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:12:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-e4aa4f96-4a9e-471b-b82c-e97e716683b5 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T01:06:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-133275307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-133275307',id=42,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg2H30iyGq6swB2GrSqVRe5DtzdlWmt0jQC0U9I+/EN3haXyWHelTuvYsSUnUJrIukK4ZeGdNI+eYhTEQ/ZgDVAkbq+5RP8TRJqgY4+Kj2EGhPN8Eb7+ExDQLVf3Qgg+g==',key_name='tempest-keypair-1001532645',keypairs=<?>,launch_index=0,launched_at=2023-11-14T01:10:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e396f5de82e54abfa812bf8a7e89b0c4',ramdisk_id='',reservation_id='r-gpaxa90f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-270753956',owner_user_name='tempest-AttachVolumeShelveTestJSON-270753956-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T01:10:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe8332d8221a49db86a402c5851b4882',uuid=efa96c60-9902-4ca9-8f0e-d27bdb883829,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e053f78-6ef6-4f30-aedb-30306f10975b", "address": "fa:16:3e:fc:2e:f2", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e053f78-6e", "ovs_interfaceid": "5e053f78-6ef6-4f30-aedb-30306f10975b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 01:12:07 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-e4aa4f96-4a9e-471b-b82c-e97e716683b5 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Converting VIF {"id": "5e053f78-6ef6-4f30-aedb-30306f10975b", "address": "fa:16:3e:fc:2e:f2", "network": {"id": "dfd22096-9f0c-4e0f-aac4-06c224b5b9f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-948850305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e396f5de82e54abfa812bf8a7e89b0c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e053f78-6e", "ovs_interfaceid": "5e053f78-6ef6-4f30-aedb-30306f10975b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:12:07 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-e4aa4f96-4a9e-471b-b82c-e97e716683b5 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:2e:f2,bridge_name='br-int',has_traffic_filtering=True,id=5e053f78-6ef6-4f30-aedb-30306f10975b,network=Network(dfd22096-9f0c-4e0f-aac4-06c224b5b9f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e053f78-6e') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:12:07 user nova-compute[74850]: DEBUG os_vif [None req-e4aa4f96-4a9e-471b-b82c-e97e716683b5 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:2e:f2,bridge_name='br-int',has_traffic_filtering=True,id=5e053f78-6ef6-4f30-aedb-30306f10975b,network=Network(dfd22096-9f0c-4e0f-aac4-06c224b5b9f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e053f78-6e') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 01:12:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e053f78-6e, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:12:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:12:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=59064f35-debe-4a26-9a86-e4d77cfdc8c8) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:12:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:08 user nova-compute[74850]: INFO os_vif [None req-e4aa4f96-4a9e-471b-b82c-e97e716683b5 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:2e:f2,bridge_name='br-int',has_traffic_filtering=True,id=5e053f78-6ef6-4f30-aedb-30306f10975b,network=Network(dfd22096-9f0c-4e0f-aac4-06c224b5b9f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e053f78-6e')
Nov 14 01:12:08 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-e4aa4f96-4a9e-471b-b82c-e97e716683b5 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Deleting instance files /opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829_del
Nov 14 01:12:08 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-e4aa4f96-4a9e-471b-b82c-e97e716683b5 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Deletion of /opt/stack/data/nova/instances/efa96c60-9902-4ca9-8f0e-d27bdb883829_del complete
Nov 14 01:12:08 user nova-compute[74850]: INFO nova.compute.manager [None req-e4aa4f96-4a9e-471b-b82c-e97e716683b5 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 14 01:12:08 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-e4aa4f96-4a9e-471b-b82c-e97e716683b5 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 01:12:08 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 01:12:08 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 01:12:08 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:12:08 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Took 0.65 seconds to deallocate network for instance.
Nov 14 01:12:08 user nova-compute[74850]: DEBUG nova.compute.manager [req-cb2731bf-a1d4-40a7-824e-dad3a64548b4 req-61aecc95-5715-49c2-8b90-85eef568f217 service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Received event network-vif-deleted-5e053f78-6ef6-4f30-aedb-30306f10975b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:12:08 user nova-compute[74850]: INFO nova.compute.manager [req-cb2731bf-a1d4-40a7-824e-dad3a64548b4 req-61aecc95-5715-49c2-8b90-85eef568f217 service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Neutron deleted interface 5e053f78-6ef6-4f30-aedb-30306f10975b; detaching it from the instance and deleting it from the info cache
Nov 14 01:12:08 user nova-compute[74850]: DEBUG nova.network.neutron [req-cb2731bf-a1d4-40a7-824e-dad3a64548b4 req-61aecc95-5715-49c2-8b90-85eef568f217 service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:12:08 user nova-compute[74850]: DEBUG nova.compute.manager [req-cb2731bf-a1d4-40a7-824e-dad3a64548b4 req-61aecc95-5715-49c2-8b90-85eef568f217 service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Detach interface failed, port_id=5e053f78-6ef6-4f30-aedb-30306f10975b, reason: Instance efa96c60-9902-4ca9-8f0e-d27bdb883829 could not be found. {{(pid=74850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 01:12:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e4aa4f96-4a9e-471b-b82c-e97e716683b5 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:12:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e4aa4f96-4a9e-471b-b82c-e97e716683b5 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:12:08 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-e4aa4f96-4a9e-471b-b82c-e97e716683b5 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:12:08 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-e4aa4f96-4a9e-471b-b82c-e97e716683b5 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:12:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e4aa4f96-4a9e-471b-b82c-e97e716683b5 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.231s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:12:09 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-e4aa4f96-4a9e-471b-b82c-e97e716683b5 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Deleted allocations for instance efa96c60-9902-4ca9-8f0e-d27bdb883829
Nov 14 01:12:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e4aa4f96-4a9e-471b-b82c-e97e716683b5 tempest-AttachVolumeShelveTestJSON-270753956 tempest-AttachVolumeShelveTestJSON-270753956-project-member] Lock "efa96c60-9902-4ca9-8f0e-d27bdb883829" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.771s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:12:09 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:12:09 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:12:09 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:12:09 user nova-compute[74850]: DEBUG nova.compute.manager [req-02fa8c60-cc30-4de7-be25-5b70d78be539 req-08ee9bd9-f5fc-45a7-bc94-5bb9ac4d5dfe service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Received event network-vif-plugged-5e053f78-6ef6-4f30-aedb-30306f10975b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:12:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-02fa8c60-cc30-4de7-be25-5b70d78be539 req-08ee9bd9-f5fc-45a7-bc94-5bb9ac4d5dfe service nova] Acquiring lock "efa96c60-9902-4ca9-8f0e-d27bdb883829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:12:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-02fa8c60-cc30-4de7-be25-5b70d78be539 req-08ee9bd9-f5fc-45a7-bc94-5bb9ac4d5dfe service nova] Lock "efa96c60-9902-4ca9-8f0e-d27bdb883829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:12:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-02fa8c60-cc30-4de7-be25-5b70d78be539 req-08ee9bd9-f5fc-45a7-bc94-5bb9ac4d5dfe service nova] Lock "efa96c60-9902-4ca9-8f0e-d27bdb883829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:12:09 user nova-compute[74850]: DEBUG nova.compute.manager [req-02fa8c60-cc30-4de7-be25-5b70d78be539 req-08ee9bd9-f5fc-45a7-bc94-5bb9ac4d5dfe service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] No waiting events found dispatching network-vif-plugged-5e053f78-6ef6-4f30-aedb-30306f10975b {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:12:09 user nova-compute[74850]: WARNING nova.compute.manager [req-02fa8c60-cc30-4de7-be25-5b70d78be539 req-08ee9bd9-f5fc-45a7-bc94-5bb9ac4d5dfe service nova] [instance: efa96c60-9902-4ca9-8f0e-d27bdb883829] Received unexpected event network-vif-plugged-5e053f78-6ef6-4f30-aedb-30306f10975b for instance with vm_state deleted and task_state None.
Nov 14 01:12:10 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:12:10 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:12:10 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 01:12:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:12 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:12:12 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 01:12:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:13 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Didn't find any instances for network info cache update. {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 01:12:13 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "702746f7-305f-4eac-a71a-6c08b7cbccd8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:12:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "702746f7-305f-4eac-a71a-6c08b7cbccd8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:12:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "702746f7-305f-4eac-a71a-6c08b7cbccd8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:12:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "702746f7-305f-4eac-a71a-6c08b7cbccd8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:12:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "702746f7-305f-4eac-a71a-6c08b7cbccd8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:12:18 user nova-compute[74850]: INFO nova.compute.manager [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Terminating instance
Nov 14 01:12:18 user nova-compute[74850]: DEBUG nova.compute.manager [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 01:12:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:19 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Instance destroyed successfully.
Nov 14 01:12:19 user nova-compute[74850]: DEBUG nova.objects.instance [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lazy-loading 'resources' on Instance uuid 702746f7-305f-4eac-a71a-6c08b7cbccd8 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:56:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-829621186',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-829621186',id=29,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:58:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='491aa2a4f38140788cb0de9762a8baf4',ramdisk_id='',reservation_id='r-tiybmuy9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-726213232',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T01:00:18Z,user_data=None,user_id='a5bb5d788a3b4871ae41f57d06f785f2',uuid=702746f7-305f-4eac-a71a-6c08b7cbccd8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39232b36-eca6-4dac-880c-43aafa9f1719", "address": "fa:16:3e:ac:57:e7", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39232b36-ec", "ovs_interfaceid": "39232b36-eca6-4dac-880c-43aafa9f1719", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Converting VIF {"id": "39232b36-eca6-4dac-880c-43aafa9f1719", "address": "fa:16:3e:ac:57:e7", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39232b36-ec", "ovs_interfaceid": "39232b36-eca6-4dac-880c-43aafa9f1719", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:57:e7,bridge_name='br-int',has_traffic_filtering=True,id=39232b36-eca6-4dac-880c-43aafa9f1719,network=Network(6f8f66ca-e2e8-4565-a05c-df75a16699ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39232b36-ec') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG os_vif [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:57:e7,bridge_name='br-int',has_traffic_filtering=True,id=39232b36-eca6-4dac-880c-43aafa9f1719,network=Network(6f8f66ca-e2e8-4565-a05c-df75a16699ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39232b36-ec') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39232b36-ec, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9d6c9e80-ffcb-4aa3-ae17-cafe643ec427) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:12:19 user nova-compute[74850]: INFO os_vif [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:57:e7,bridge_name='br-int',has_traffic_filtering=True,id=39232b36-eca6-4dac-880c-43aafa9f1719,network=Network(6f8f66ca-e2e8-4565-a05c-df75a16699ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39232b36-ec')
Nov 14 01:12:19 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VeutpWAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:12:19 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:12:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f546feeb-ccf6-4246-851a-40a2f5fb11e1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 01:12:19 user nova-compute[74850]: No targets found.
Nov 14 01:12:19 user nova-compute[74850]: iSNS:
Nov 14 01:12:19 user nova-compute[74850]: No targets found.
Nov 14 01:12:19 user nova-compute[74850]: STATIC:
Nov 14 01:12:19 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d
Nov 14 01:12:19 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:12:19 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:12:19 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8
Nov 14 01:12:19 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:12:19 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:12:19 user nova-compute[74850]: FIRMWARE:
Nov 14 01:12:19 user nova-compute[74850]: No targets found.
Nov 14 01:12:19 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 01:12:19 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 01:12:19 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a69b79-4332-4b2c-9fd2-344950a7f324]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a0084b-2a41-475a-917c-9cf535345ba0]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:12:19 user nova-compute[74850]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:12:19 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d (non-flash)
Nov 14 01:12:19 user nova-compute[74850]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:12:19 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a5c25ce50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d'): ({'sdf'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Removing single pathed devices sdf {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d7c286-e5b7-42fd-a8d7-6427a95db831]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a723fff2-a5af-4271-be48-3038bed5eefb]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Flushing IO for device /dev/sdf {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e540ca-2799-4910-8ce7-396120e90feb]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f016497e-46e0-4e24-a677-9dc4a4cd7abe]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] SCSI volumes sdf have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3106ad-e395-47c8-9066-9039a44877a9]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae968e57-6fcd-44ef-8945-227810bc5568]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d, portal: 172.16.0.220,3260]
Nov 14 01:12:19 user nova-compute[74850]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d, portal: 172.16.0.220,3260] successful.
Nov 14 01:12:19 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83caba72-44f3-43f9-a484-d9f730b0b65d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b7b121-106b-44a1-acce-c66163326dea]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] <== disconnect_volume: return (305ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 01:12:19 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Deleting instance files /opt/stack/data/nova/instances/702746f7-305f-4eac-a71a-6c08b7cbccd8_del
Nov 14 01:12:19 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Deletion of /opt/stack/data/nova/instances/702746f7-305f-4eac-a71a-6c08b7cbccd8_del complete
Nov 14 01:12:19 user nova-compute[74850]: INFO nova.compute.manager [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 14 01:12:19 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 01:12:19 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 01:12:20 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:12:20 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Took 0.48 seconds to deallocate network for instance.
Nov 14 01:12:20 user nova-compute[74850]: DEBUG nova.compute.manager [req-fdefcf73-40fb-45c9-883d-1cc7ac37c88b req-93412a31-ac38-4822-bfd4-1591c2257773 service nova] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Received event network-vif-deleted-39232b36-eca6-4dac-880c-43aafa9f1719 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:12:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:20 user nova-compute[74850]: INFO nova.compute.manager [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: 702746f7-305f-4eac-a71a-6c08b7cbccd8] Took 0.83 seconds to detach 1 volumes for instance.
Nov 14 01:12:21 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:12:21 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:12:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:21 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:12:21 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:12:21 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.269s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:12:21 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Deleted allocations for instance 702746f7-305f-4eac-a71a-6c08b7cbccd8
Nov 14 01:12:21 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ac5ff33a-9ba0-414c-bc15-198a520c1b04 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "702746f7-305f-4eac-a71a-6c08b7cbccd8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.005s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:12:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Acquiring lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:12:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:12:30 user nova-compute[74850]: DEBUG nova.compute.manager [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 01:12:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:12:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:12:30 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 01:12:30 user nova-compute[74850]: INFO nova.compute.claims [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Claim successful on node user
Nov 14 01:12:30 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Refreshing inventories for resource provider fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 01:12:30 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Updating ProviderTree inventory for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 01:12:30 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Updating inventory in ProviderTree for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 01:12:30 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Refreshing aggregate associations for resource provider fe703abb-f68c-420d-a7f0-bf5240e23c54, aggregates: None {{(pid=74850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 01:12:31 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Refreshing trait associations for resource provider fe703abb-f68c-420d-a7f0-bf5240e23c54, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 01:12:31 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:12:31 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:12:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.364s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:12:31 user nova-compute[74850]: DEBUG nova.compute.manager [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 01:12:31 user nova-compute[74850]: DEBUG nova.compute.manager [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 01:12:31 user nova-compute[74850]: DEBUG nova.network.neutron [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 01:12:31 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 01:12:31 user nova-compute[74850]: DEBUG nova.compute.manager [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 01:12:31 user nova-compute[74850]: DEBUG nova.policy [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41daaa95d5be4e4f9587ca00c14ce962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b811df14b33a498db8a1a7eb95c5bb5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 01:12:31 user nova-compute[74850]: DEBUG nova.compute.manager [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 01:12:31 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 01:12:31 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Creating image(s)
Nov 14 01:12:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Acquiring lock "/opt/stack/data/nova/instances/2c18a949-25d9-4db9-bac5-b0b75d9a5751/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:12:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "/opt/stack/data/nova/instances/2c18a949-25d9-4db9-bac5-b0b75d9a5751/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:12:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "/opt/stack/data/nova/instances/2c18a949-25d9-4db9-bac5-b0b75d9a5751/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:12:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:12:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.178s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:12:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:12:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:12:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:12:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.169s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:12:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/2c18a949-25d9-4db9-bac5-b0b75d9a5751/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:12:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/2c18a949-25d9-4db9-bac5-b0b75d9a5751/disk 1073741824" returned: 0 in 0.049s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:12:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:12:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:12:32 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.182s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:12:32 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2c18a949-25d9-4db9-bac5-b0b75d9a5751/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 01:12:32 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c18a949-25d9-4db9-bac5-b0b75d9a5751/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:12:32 user nova-compute[74850]: DEBUG nova.network.neutron [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Successfully created port: a4ec3961-14e9-4085-8eca-c16a32d436f0 {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 01:12:32 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c18a949-25d9-4db9-bac5-b0b75d9a5751/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:12:32 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Cannot resize image /opt/stack/data/nova/instances/2c18a949-25d9-4db9-bac5-b0b75d9a5751/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 01:12:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 01:12:32 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Ensure instance console log exists: /opt/stack/data/nova/instances/2c18a949-25d9-4db9-bac5-b0b75d9a5751/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 01:12:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:12:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:12:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:12:32 user nova-compute[74850]: DEBUG nova.network.neutron [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Successfully updated port: a4ec3961-14e9-4085-8eca-c16a32d436f0 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 01:12:32 user nova-compute[74850]: DEBUG nova.compute.manager [req-fb5b04d0-d80a-497e-babe-a83e00bb5e80 req-d88668a6-ae32-4ba8-a976-ba141e79b0d4 service nova] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Received event network-changed-a4ec3961-14e9-4085-8eca-c16a32d436f0 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:12:32 user nova-compute[74850]: DEBUG nova.compute.manager [req-fb5b04d0-d80a-497e-babe-a83e00bb5e80 req-d88668a6-ae32-4ba8-a976-ba141e79b0d4 service nova] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Refreshing instance network info cache due to event network-changed-a4ec3961-14e9-4085-8eca-c16a32d436f0. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:12:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fb5b04d0-d80a-497e-babe-a83e00bb5e80 req-d88668a6-ae32-4ba8-a976-ba141e79b0d4 service nova] Acquiring lock "refresh_cache-2c18a949-25d9-4db9-bac5-b0b75d9a5751" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:12:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fb5b04d0-d80a-497e-babe-a83e00bb5e80 req-d88668a6-ae32-4ba8-a976-ba141e79b0d4 service nova] Acquired lock "refresh_cache-2c18a949-25d9-4db9-bac5-b0b75d9a5751" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:12:32 user nova-compute[74850]: DEBUG nova.network.neutron [req-fb5b04d0-d80a-497e-babe-a83e00bb5e80 req-d88668a6-ae32-4ba8-a976-ba141e79b0d4 service nova] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Refreshing network info cache for port a4ec3961-14e9-4085-8eca-c16a32d436f0 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:12:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Acquiring lock "refresh_cache-2c18a949-25d9-4db9-bac5-b0b75d9a5751" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:12:32 user nova-compute[74850]: DEBUG nova.network.neutron [req-fb5b04d0-d80a-497e-babe-a83e00bb5e80 req-d88668a6-ae32-4ba8-a976-ba141e79b0d4 service nova] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG nova.network.neutron [req-fb5b04d0-d80a-497e-babe-a83e00bb5e80 req-d88668a6-ae32-4ba8-a976-ba141e79b0d4 service nova] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-fb5b04d0-d80a-497e-babe-a83e00bb5e80 req-d88668a6-ae32-4ba8-a976-ba141e79b0d4 service nova] Releasing lock "refresh_cache-2c18a949-25d9-4db9-bac5-b0b75d9a5751" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Acquired lock "refresh_cache-2c18a949-25d9-4db9-bac5-b0b75d9a5751" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG nova.network.neutron [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG nova.network.neutron [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG nova.network.neutron [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Updating instance_info_cache with network_info: [{"id": "a4ec3961-14e9-4085-8eca-c16a32d436f0", "address": "fa:16:3e:92:61:d5", "network": {"id": "40ed88df-3a5a-4029-a9b5-4c73221823fa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1084755377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b811df14b33a498db8a1a7eb95c5bb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ec3961-14", "ovs_interfaceid": "a4ec3961-14e9-4085-8eca-c16a32d436f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Releasing lock "refresh_cache-2c18a949-25d9-4db9-bac5-b0b75d9a5751" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG nova.compute.manager [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Instance network_info: |[{"id": "a4ec3961-14e9-4085-8eca-c16a32d436f0", "address": "fa:16:3e:92:61:d5", "network": {"id": "40ed88df-3a5a-4029-a9b5-4c73221823fa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1084755377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b811df14b33a498db8a1a7eb95c5bb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ec3961-14", "ovs_interfaceid": "a4ec3961-14e9-4085-8eca-c16a32d436f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Start _get_guest_xml network_info=[{"id": "a4ec3961-14e9-4085-8eca-c16a32d436f0", "address": "fa:16:3e:92:61:d5", "network": {"id": "40ed88df-3a5a-4029-a9b5-4c73221823fa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1084755377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b811df14b33a498db8a1a7eb95c5bb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ec3961-14", "ovs_interfaceid": "a4ec3961-14e9-4085-8eca-c16a32d436f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 01:12:33 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:12:33 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:12:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:12:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1758729225',display_name='tempest-SnapshotDataIntegrityTests-server-1758729225',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1758729225',id=49,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+B6b5nZKS/9y8Mg9FkFUYeGFoLPQW6HXw0aiNEQHO6eZ6gQe0zSRx28kCZQRIkRl+9He2UywLuYEs5o716oQN/uqSnLxRVvhrY5AMwVJjcQhb/lmOIKIuOthgw8ZUslg==',key_name='tempest-keypair-1221671008',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b811df14b33a498db8a1a7eb95c5bb5a',ramdisk_id='',reservation_id='r-8wtwq0yx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-266495953',owner_user_name='tempest-SnapshotDataIntegrityTests-266495953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:12:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41daaa95d5be4e4f9587ca00c14ce962',uuid=2c18a949-25d9-4db9-bac5-b0b75d9a5751,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4ec3961-14e9-4085-8eca-c16a32d436f0", "address": "fa:16:3e:92:61:d5", "network": {"id": "40ed88df-3a5a-4029-a9b5-4c73221823fa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1084755377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b811df14b33a498db8a1a7eb95c5bb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ec3961-14", "ovs_interfaceid": "a4ec3961-14e9-4085-8eca-c16a32d436f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Converting VIF {"id": "a4ec3961-14e9-4085-8eca-c16a32d436f0", "address": "fa:16:3e:92:61:d5", "network": {"id": "40ed88df-3a5a-4029-a9b5-4c73221823fa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1084755377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b811df14b33a498db8a1a7eb95c5bb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ec3961-14", "ovs_interfaceid": "a4ec3961-14e9-4085-8eca-c16a32d436f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:61:d5,bridge_name='br-int',has_traffic_filtering=True,id=a4ec3961-14e9-4085-8eca-c16a32d436f0,network=Network(40ed88df-3a5a-4029-a9b5-4c73221823fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4ec3961-14') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG nova.objects.instance [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c18a949-25d9-4db9-bac5-b0b75d9a5751 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] End _get_guest_xml xml=<domain type="kvm">
Nov 14 01:12:33 user nova-compute[74850]:   <uuid>2c18a949-25d9-4db9-bac5-b0b75d9a5751</uuid>
Nov 14 01:12:33 user nova-compute[74850]:   <name>instance-00000031</name>
Nov 14 01:12:33 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 01:12:33 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 01:12:33 user nova-compute[74850]:   <metadata>
Nov 14 01:12:33 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 01:12:33 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 01:12:33 user nova-compute[74850]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1758729225</nova:name>
Nov 14 01:12:33 user nova-compute[74850]:       <nova:creationTime>2023-11-14 01:12:33</nova:creationTime>
Nov 14 01:12:33 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 01:12:33 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 01:12:33 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 01:12:33 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 01:12:33 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 01:12:33 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 01:12:33 user nova-compute[74850]:       </nova:flavor>
Nov 14 01:12:33 user nova-compute[74850]:       <nova:owner>
Nov 14 01:12:33 user nova-compute[74850]:         <nova:user uuid="41daaa95d5be4e4f9587ca00c14ce962">tempest-SnapshotDataIntegrityTests-266495953-project-member</nova:user>
Nov 14 01:12:33 user nova-compute[74850]:         <nova:project uuid="b811df14b33a498db8a1a7eb95c5bb5a">tempest-SnapshotDataIntegrityTests-266495953</nova:project>
Nov 14 01:12:33 user nova-compute[74850]:       </nova:owner>
Nov 14 01:12:33 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 01:12:33 user nova-compute[74850]:       <nova:ports>
Nov 14 01:12:33 user nova-compute[74850]:         <nova:port uuid="a4ec3961-14e9-4085-8eca-c16a32d436f0">
Nov 14 01:12:33 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 01:12:33 user nova-compute[74850]:         </nova:port>
Nov 14 01:12:33 user nova-compute[74850]:       </nova:ports>
Nov 14 01:12:33 user nova-compute[74850]:     </nova:instance>
Nov 14 01:12:33 user nova-compute[74850]:   </metadata>
Nov 14 01:12:33 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 01:12:33 user nova-compute[74850]:     <system>
Nov 14 01:12:33 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 01:12:33 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 01:12:33 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 01:12:33 user nova-compute[74850]:       <entry name="serial">2c18a949-25d9-4db9-bac5-b0b75d9a5751</entry>
Nov 14 01:12:33 user nova-compute[74850]:       <entry name="uuid">2c18a949-25d9-4db9-bac5-b0b75d9a5751</entry>
Nov 14 01:12:33 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 01:12:33 user nova-compute[74850]:     </system>
Nov 14 01:12:33 user nova-compute[74850]:   </sysinfo>
Nov 14 01:12:33 user nova-compute[74850]:   <os>
Nov 14 01:12:33 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 01:12:33 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 01:12:33 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 01:12:33 user nova-compute[74850]:   </os>
Nov 14 01:12:33 user nova-compute[74850]:   <features>
Nov 14 01:12:33 user nova-compute[74850]:     <acpi/>
Nov 14 01:12:33 user nova-compute[74850]:     <apic/>
Nov 14 01:12:33 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 01:12:33 user nova-compute[74850]:   </features>
Nov 14 01:12:33 user nova-compute[74850]:   <clock offset="utc">
Nov 14 01:12:33 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 01:12:33 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 01:12:33 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 01:12:33 user nova-compute[74850]:   </clock>
Nov 14 01:12:33 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 01:12:33 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 01:12:33 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 01:12:33 user nova-compute[74850]:   </cpu>
Nov 14 01:12:33 user nova-compute[74850]:   <devices>
Nov 14 01:12:33 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 01:12:33 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 01:12:33 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/2c18a949-25d9-4db9-bac5-b0b75d9a5751/disk"/>
Nov 14 01:12:33 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 01:12:33 user nova-compute[74850]:     </disk>
Nov 14 01:12:33 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 01:12:33 user nova-compute[74850]:       <mac address="fa:16:3e:92:61:d5"/>
Nov 14 01:12:33 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:12:33 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 01:12:33 user nova-compute[74850]:       <target dev="tapa4ec3961-14"/>
Nov 14 01:12:33 user nova-compute[74850]:     </interface>
Nov 14 01:12:33 user nova-compute[74850]:     <serial type="pty">
Nov 14 01:12:33 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/2c18a949-25d9-4db9-bac5-b0b75d9a5751/console.log" append="off"/>
Nov 14 01:12:33 user nova-compute[74850]:     </serial>
Nov 14 01:12:33 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 01:12:33 user nova-compute[74850]:     <video>
Nov 14 01:12:33 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:12:33 user nova-compute[74850]:     </video>
Nov 14 01:12:33 user nova-compute[74850]:     <rng model="virtio">
Nov 14 01:12:33 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 01:12:33 user nova-compute[74850]:     </rng>
Nov 14 01:12:33 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 01:12:33 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 01:12:33 user nova-compute[74850]:       <stats period="10"/>
Nov 14 01:12:33 user nova-compute[74850]:     </memballoon>
Nov 14 01:12:33 user nova-compute[74850]:   </devices>
Nov 14 01:12:33 user nova-compute[74850]: </domain>
Nov 14 01:12:33 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:12:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1758729225',display_name='tempest-SnapshotDataIntegrityTests-server-1758729225',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1758729225',id=49,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+B6b5nZKS/9y8Mg9FkFUYeGFoLPQW6HXw0aiNEQHO6eZ6gQe0zSRx28kCZQRIkRl+9He2UywLuYEs5o716oQN/uqSnLxRVvhrY5AMwVJjcQhb/lmOIKIuOthgw8ZUslg==',key_name='tempest-keypair-1221671008',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b811df14b33a498db8a1a7eb95c5bb5a',ramdisk_id='',reservation_id='r-8wtwq0yx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-266495953',owner_user_name='tempest-SnapshotDataIntegrityTests-266495953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:12:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41daaa95d5be4e4f9587ca00c14ce962',uuid=2c18a949-25d9-4db9-bac5-b0b75d9a5751,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4ec3961-14e9-4085-8eca-c16a32d436f0", "address": "fa:16:3e:92:61:d5", "network": {"id": "40ed88df-3a5a-4029-a9b5-4c73221823fa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1084755377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b811df14b33a498db8a1a7eb95c5bb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ec3961-14", "ovs_interfaceid": "a4ec3961-14e9-4085-8eca-c16a32d436f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Converting VIF {"id": "a4ec3961-14e9-4085-8eca-c16a32d436f0", "address": "fa:16:3e:92:61:d5", "network": {"id": "40ed88df-3a5a-4029-a9b5-4c73221823fa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1084755377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b811df14b33a498db8a1a7eb95c5bb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ec3961-14", "ovs_interfaceid": "a4ec3961-14e9-4085-8eca-c16a32d436f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:61:d5,bridge_name='br-int',has_traffic_filtering=True,id=a4ec3961-14e9-4085-8eca-c16a32d436f0,network=Network(40ed88df-3a5a-4029-a9b5-4c73221823fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4ec3961-14') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG os_vif [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:61:d5,bridge_name='br-int',has_traffic_filtering=True,id=a4ec3961-14e9-4085-8eca-c16a32d436f0,network=Network(40ed88df-3a5a-4029-a9b5-4c73221823fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4ec3961-14') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '133a4036-65f6-5870-be79-7b7a3bdaa75a', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4ec3961-14, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa4ec3961-14, col_values=(('qos', UUID('ca222bec-eb55-4845-8bea-140f58570568')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa4ec3961-14, col_values=(('external_ids', {'iface-id': 'a4ec3961-14e9-4085-8eca-c16a32d436f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:61:d5', 'vm-uuid': '2c18a949-25d9-4db9-bac5-b0b75d9a5751'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:33 user nova-compute[74850]: INFO os_vif [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:61:d5,bridge_name='br-int',has_traffic_filtering=True,id=a4ec3961-14e9-4085-8eca-c16a32d436f0,network=Network(40ed88df-3a5a-4029-a9b5-4c73221823fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4ec3961-14')
Nov 14 01:12:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:12:33 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] No VIF found with MAC fa:16:3e:92:61:d5, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:12:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:35 user nova-compute[74850]: DEBUG nova.compute.manager [req-78ff103c-4c59-47f7-8bc5-21622b69da4e req-387d54dd-264a-4018-bb13-18f50232c932 service nova] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Received event network-vif-plugged-a4ec3961-14e9-4085-8eca-c16a32d436f0 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:12:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-78ff103c-4c59-47f7-8bc5-21622b69da4e req-387d54dd-264a-4018-bb13-18f50232c932 service nova] Acquiring lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:12:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-78ff103c-4c59-47f7-8bc5-21622b69da4e req-387d54dd-264a-4018-bb13-18f50232c932 service nova] Lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:12:35 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-78ff103c-4c59-47f7-8bc5-21622b69da4e req-387d54dd-264a-4018-bb13-18f50232c932 service nova] Lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:12:35 user nova-compute[74850]: DEBUG nova.compute.manager [req-78ff103c-4c59-47f7-8bc5-21622b69da4e req-387d54dd-264a-4018-bb13-18f50232c932 service nova] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] No waiting events found dispatching network-vif-plugged-a4ec3961-14e9-4085-8eca-c16a32d436f0 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:12:35 user nova-compute[74850]: WARNING nova.compute.manager [req-78ff103c-4c59-47f7-8bc5-21622b69da4e req-387d54dd-264a-4018-bb13-18f50232c932 service nova] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Received unexpected event network-vif-plugged-a4ec3961-14e9-4085-8eca-c16a32d436f0 for instance with vm_state building and task_state spawning.
Nov 14 01:12:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:37 user nova-compute[74850]: DEBUG nova.compute.manager [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 01:12:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 01:12:37 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Instance spawned successfully.
Nov 14 01:12:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 01:12:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:12:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:12:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:12:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:12:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:12:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:12:37 user nova-compute[74850]: DEBUG nova.compute.manager [req-8c2f35ae-6162-4808-9ed0-192284d8cc5d req-c9bd820b-203c-4b79-9c3f-a030bac8841d service nova] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Received event network-vif-plugged-a4ec3961-14e9-4085-8eca-c16a32d436f0 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:12:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-8c2f35ae-6162-4808-9ed0-192284d8cc5d req-c9bd820b-203c-4b79-9c3f-a030bac8841d service nova] Acquiring lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:12:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-8c2f35ae-6162-4808-9ed0-192284d8cc5d req-c9bd820b-203c-4b79-9c3f-a030bac8841d service nova] Lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:12:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-8c2f35ae-6162-4808-9ed0-192284d8cc5d req-c9bd820b-203c-4b79-9c3f-a030bac8841d service nova] Lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:12:37 user nova-compute[74850]: DEBUG nova.compute.manager [req-8c2f35ae-6162-4808-9ed0-192284d8cc5d req-c9bd820b-203c-4b79-9c3f-a030bac8841d service nova] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] No waiting events found dispatching network-vif-plugged-a4ec3961-14e9-4085-8eca-c16a32d436f0 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:12:37 user nova-compute[74850]: WARNING nova.compute.manager [req-8c2f35ae-6162-4808-9ed0-192284d8cc5d req-c9bd820b-203c-4b79-9c3f-a030bac8841d service nova] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Received unexpected event network-vif-plugged-a4ec3961-14e9-4085-8eca-c16a32d436f0 for instance with vm_state building and task_state spawning.
Nov 14 01:12:37 user nova-compute[74850]: INFO nova.compute.manager [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Took 5.92 seconds to spawn the instance on the hypervisor.
Nov 14 01:12:37 user nova-compute[74850]: DEBUG nova.compute.manager [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 01:12:37 user nova-compute[74850]: INFO nova.compute.manager [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Took 6.60 seconds to build instance.
Nov 14 01:12:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e78fcace-0e3d-462c-bc15-fcac357f7085 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.692s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:12:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:43 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:54 user nova-compute[74850]: DEBUG nova.compute.manager [req-55d91b0c-331d-4477-9d61-ef3f1849f066 req-f1b45102-eaad-44e0-8e14-19458e14b217 service nova] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Received event network-changed-4f8a261a-c9f2-47b4-a0e7-ae6730ec962a {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:12:54 user nova-compute[74850]: DEBUG nova.compute.manager [req-55d91b0c-331d-4477-9d61-ef3f1849f066 req-f1b45102-eaad-44e0-8e14-19458e14b217 service nova] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Refreshing instance network info cache due to event network-changed-4f8a261a-c9f2-47b4-a0e7-ae6730ec962a. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:12:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-55d91b0c-331d-4477-9d61-ef3f1849f066 req-f1b45102-eaad-44e0-8e14-19458e14b217 service nova] Acquiring lock "refresh_cache-6ac6355d-eb05-4d1a-94c5-8ca630e926f4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:12:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-55d91b0c-331d-4477-9d61-ef3f1849f066 req-f1b45102-eaad-44e0-8e14-19458e14b217 service nova] Acquired lock "refresh_cache-6ac6355d-eb05-4d1a-94c5-8ca630e926f4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:12:54 user nova-compute[74850]: DEBUG nova.network.neutron [req-55d91b0c-331d-4477-9d61-ef3f1849f066 req-f1b45102-eaad-44e0-8e14-19458e14b217 service nova] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Refreshing network info cache for port 4f8a261a-c9f2-47b4-a0e7-ae6730ec962a {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:12:55 user nova-compute[74850]: DEBUG nova.network.neutron [req-55d91b0c-331d-4477-9d61-ef3f1849f066 req-f1b45102-eaad-44e0-8e14-19458e14b217 service nova] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Updated VIF entry in instance network info cache for port 4f8a261a-c9f2-47b4-a0e7-ae6730ec962a. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:12:55 user nova-compute[74850]: DEBUG nova.network.neutron [req-55d91b0c-331d-4477-9d61-ef3f1849f066 req-f1b45102-eaad-44e0-8e14-19458e14b217 service nova] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Updating instance_info_cache with network_info: [{"id": "4f8a261a-c9f2-47b4-a0e7-ae6730ec962a", "address": "fa:16:3e:78:cd:0b", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8a261a-c9", "ovs_interfaceid": "4f8a261a-c9f2-47b4-a0e7-ae6730ec962a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:12:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-55d91b0c-331d-4477-9d61-ef3f1849f066 req-f1b45102-eaad-44e0-8e14-19458e14b217 service nova] Releasing lock "refresh_cache-6ac6355d-eb05-4d1a-94c5-8ca630e926f4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:12:56 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquiring lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:12:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:12:56 user nova-compute[74850]: DEBUG nova.compute.manager [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 01:12:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:12:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:12:56 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 01:12:56 user nova-compute[74850]: INFO nova.compute.claims [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Claim successful on node user
Nov 14 01:12:56 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:12:56 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:12:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.283s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:12:56 user nova-compute[74850]: DEBUG nova.compute.manager [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 01:12:56 user nova-compute[74850]: DEBUG nova.compute.manager [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 01:12:56 user nova-compute[74850]: DEBUG nova.network.neutron [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 01:12:56 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 01:12:56 user nova-compute[74850]: DEBUG nova.compute.manager [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 01:12:56 user nova-compute[74850]: DEBUG nova.policy [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '534b22e8e0c7495f8d2f89dec7e9a66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ae3f5d3814451c9c7d7264707c8334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 01:12:56 user nova-compute[74850]: DEBUG nova.compute.manager [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 01:12:56 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 01:12:56 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Creating image(s)
Nov 14 01:12:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquiring lock "/opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:12:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "/opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:12:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "/opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:12:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquiring lock "1fc1b7c6620c95d32023865886143582e78fc686" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:12:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "1fc1b7c6620c95d32023865886143582e78fc686" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:12:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fc1b7c6620c95d32023865886143582e78fc686.part --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:12:57 user nova-compute[74850]: DEBUG nova.network.neutron [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Successfully created port: 08667be8-256e-4d3c-b3a1-e65917c9c2c8 {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 01:12:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fc1b7c6620c95d32023865886143582e78fc686.part --force-share --output=json" returned: 0 in 0.184s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:12:57 user nova-compute[74850]: DEBUG nova.virt.images [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] 8ba8bd50-9091-4da9-9f92-78c3d236b684 was qcow2, converting to raw {{(pid=74850) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 01:12:57 user nova-compute[74850]: DEBUG nova.privsep.utils [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74850) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 01:12:57 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1fc1b7c6620c95d32023865886143582e78fc686.part /opt/stack/data/nova/instances/_base/1fc1b7c6620c95d32023865886143582e78fc686.converted {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:12:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1fc1b7c6620c95d32023865886143582e78fc686.part /opt/stack/data/nova/instances/_base/1fc1b7c6620c95d32023865886143582e78fc686.converted" returned: 0 in 0.359s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:12:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fc1b7c6620c95d32023865886143582e78fc686.converted --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:12:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fc1b7c6620c95d32023865886143582e78fc686.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:12:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "1fc1b7c6620c95d32023865886143582e78fc686" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.348s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:12:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fc1b7c6620c95d32023865886143582e78fc686 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:12:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fc1b7c6620c95d32023865886143582e78fc686 --force-share --output=json" returned: 0 in 0.200s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:12:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquiring lock "1fc1b7c6620c95d32023865886143582e78fc686" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:12:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "1fc1b7c6620c95d32023865886143582e78fc686" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:12:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fc1b7c6620c95d32023865886143582e78fc686 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:12:58 user nova-compute[74850]: DEBUG nova.network.neutron [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Successfully updated port: 08667be8-256e-4d3c-b3a1-e65917c9c2c8 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 01:12:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fc1b7c6620c95d32023865886143582e78fc686 --force-share --output=json" returned: 0 in 0.210s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:12:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1fc1b7c6620c95d32023865886143582e78fc686,backing_fmt=raw /opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:12:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquiring lock "refresh_cache-5416dd03-4161-4411-a74b-8d6a6e2e9f54" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:12:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquired lock "refresh_cache-5416dd03-4161-4411-a74b-8d6a6e2e9f54" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:12:58 user nova-compute[74850]: DEBUG nova.network.neutron [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 01:12:58 user nova-compute[74850]: DEBUG nova.compute.manager [req-ae4b81ff-7b52-47b0-93b6-263db227b451 req-5eba7ba6-3d12-4e36-a650-b8e3e410a920 service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Received event network-changed-08667be8-256e-4d3c-b3a1-e65917c9c2c8 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:12:58 user nova-compute[74850]: DEBUG nova.compute.manager [req-ae4b81ff-7b52-47b0-93b6-263db227b451 req-5eba7ba6-3d12-4e36-a650-b8e3e410a920 service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Refreshing instance network info cache due to event network-changed-08667be8-256e-4d3c-b3a1-e65917c9c2c8. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:12:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ae4b81ff-7b52-47b0-93b6-263db227b451 req-5eba7ba6-3d12-4e36-a650-b8e3e410a920 service nova] Acquiring lock "refresh_cache-5416dd03-4161-4411-a74b-8d6a6e2e9f54" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:12:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1fc1b7c6620c95d32023865886143582e78fc686,backing_fmt=raw /opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54/disk 1073741824" returned: 0 in 0.057s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:12:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "1fc1b7c6620c95d32023865886143582e78fc686" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:12:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fc1b7c6620c95d32023865886143582e78fc686 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:12:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:58 user nova-compute[74850]: DEBUG nova.network.neutron [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 01:12:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fc1b7c6620c95d32023865886143582e78fc686 --force-share --output=json" returned: 0 in 0.186s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:12:58 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 01:12:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "e9b11ad8-52e3-4fd7-9300-80ce830964ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "e9b11ad8-52e3-4fd7-9300-80ce830964ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 01:12:59 user nova-compute[74850]: INFO nova.compute.claims [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Claim successful on node user
Nov 14 01:12:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Cannot resize image /opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Ensure instance console log exists: /opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.network.neutron [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Updating instance_info_cache with network_info: [{"id": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "address": "fa:16:3e:d5:a5:65", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08667be8-25", "ovs_interfaceid": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Releasing lock "refresh_cache-5416dd03-4161-4411-a74b-8d6a6e2e9f54" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.compute.manager [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Instance network_info: |[{"id": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "address": "fa:16:3e:d5:a5:65", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08667be8-25", "ovs_interfaceid": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ae4b81ff-7b52-47b0-93b6-263db227b451 req-5eba7ba6-3d12-4e36-a650-b8e3e410a920 service nova] Acquired lock "refresh_cache-5416dd03-4161-4411-a74b-8d6a6e2e9f54" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.network.neutron [req-ae4b81ff-7b52-47b0-93b6-263db227b451 req-5eba7ba6-3d12-4e36-a650-b8e3e410a920 service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Refreshing network info cache for port 08667be8-256e-4d3c-b3a1-e65917c9c2c8 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Start _get_guest_xml network_info=[{"id": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "address": "fa:16:3e:d5:a5:65", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08667be8-25", "ovs_interfaceid": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T01:12:54Z,direct_url=<?>,disk_format='qcow2',id=8ba8bd50-9091-4da9-9f92-78c3d236b684,min_disk=0,min_ram=0,name='tempest-scenario-img--937594975',owner='e0ae3f5d3814451c9c7d7264707c8334',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T01:12:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '8ba8bd50-9091-4da9-9f92-78c3d236b684'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 01:12:59 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:12:59 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T01:12:54Z,direct_url=<?>,disk_format='qcow2',id=8ba8bd50-9091-4da9-9f92-78c3d236b684,min_disk=0,min_ram=0,name='tempest-scenario-img--937594975',owner='e0ae3f5d3814451c9c7d7264707c8334',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T01:12:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1246065015',display_name='tempest-TestMinimumBasicScenario-server-1246065015',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1246065015',id=50,image_ref='8ba8bd50-9091-4da9-9f92-78c3d236b684',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCle3EU/m/g9NKR8n+0V6pqHrWP89VQbKtrtNAoI/KQMQsZllveB7EoYMhQdEgVXwVfsjyPlHxXAhJrn14OjYkLuq3H0x9kXgNYXCap00oAFcwtZTMn2iW22mWyQxNulQA==',key_name='tempest-TestMinimumBasicScenario-1702432917',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0ae3f5d3814451c9c7d7264707c8334',ramdisk_id='',reservation_id='r-2c6xm05p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8ba8bd50-9091-4da9-9f92-78c3d236b684',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2056291063',owner_user_name='tempest-TestMinimumBasicScenario-2056291063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:12:57Z,user_data=None,user_id='534b22e8e0c7495f8d2f89dec7e9a66c',uuid=5416dd03-4161-4411-a74b-8d6a6e2e9f54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "address": "fa:16:3e:d5:a5:65", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08667be8-25", "ovs_interfaceid": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Converting VIF {"id": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "address": "fa:16:3e:d5:a5:65", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08667be8-25", "ovs_interfaceid": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:a5:65,bridge_name='br-int',has_traffic_filtering=True,id=08667be8-256e-4d3c-b3a1-e65917c9c2c8,network=Network(7a6e0781-a6cd-4125-bdaf-9b9d53c4d254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08667be8-25') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.objects.instance [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lazy-loading 'pci_devices' on Instance uuid 5416dd03-4161-4411-a74b-8d6a6e2e9f54 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] End _get_guest_xml xml=<domain type="kvm">
Nov 14 01:12:59 user nova-compute[74850]:   <uuid>5416dd03-4161-4411-a74b-8d6a6e2e9f54</uuid>
Nov 14 01:12:59 user nova-compute[74850]:   <name>instance-00000032</name>
Nov 14 01:12:59 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 01:12:59 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 01:12:59 user nova-compute[74850]:   <metadata>
Nov 14 01:12:59 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 01:12:59 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 01:12:59 user nova-compute[74850]:       <nova:name>tempest-TestMinimumBasicScenario-server-1246065015</nova:name>
Nov 14 01:12:59 user nova-compute[74850]:       <nova:creationTime>2023-11-14 01:12:59</nova:creationTime>
Nov 14 01:12:59 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 01:12:59 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 01:12:59 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 01:12:59 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 01:12:59 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 01:12:59 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 01:12:59 user nova-compute[74850]:       </nova:flavor>
Nov 14 01:12:59 user nova-compute[74850]:       <nova:owner>
Nov 14 01:12:59 user nova-compute[74850]:         <nova:user uuid="534b22e8e0c7495f8d2f89dec7e9a66c">tempest-TestMinimumBasicScenario-2056291063-project-member</nova:user>
Nov 14 01:12:59 user nova-compute[74850]:         <nova:project uuid="e0ae3f5d3814451c9c7d7264707c8334">tempest-TestMinimumBasicScenario-2056291063</nova:project>
Nov 14 01:12:59 user nova-compute[74850]:       </nova:owner>
Nov 14 01:12:59 user nova-compute[74850]:       <nova:root type="image" uuid="8ba8bd50-9091-4da9-9f92-78c3d236b684"/>
Nov 14 01:12:59 user nova-compute[74850]:       <nova:ports>
Nov 14 01:12:59 user nova-compute[74850]:         <nova:port uuid="08667be8-256e-4d3c-b3a1-e65917c9c2c8">
Nov 14 01:12:59 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 01:12:59 user nova-compute[74850]:         </nova:port>
Nov 14 01:12:59 user nova-compute[74850]:       </nova:ports>
Nov 14 01:12:59 user nova-compute[74850]:     </nova:instance>
Nov 14 01:12:59 user nova-compute[74850]:   </metadata>
Nov 14 01:12:59 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 01:12:59 user nova-compute[74850]:     <system>
Nov 14 01:12:59 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 01:12:59 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 01:12:59 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 01:12:59 user nova-compute[74850]:       <entry name="serial">5416dd03-4161-4411-a74b-8d6a6e2e9f54</entry>
Nov 14 01:12:59 user nova-compute[74850]:       <entry name="uuid">5416dd03-4161-4411-a74b-8d6a6e2e9f54</entry>
Nov 14 01:12:59 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 01:12:59 user nova-compute[74850]:     </system>
Nov 14 01:12:59 user nova-compute[74850]:   </sysinfo>
Nov 14 01:12:59 user nova-compute[74850]:   <os>
Nov 14 01:12:59 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 01:12:59 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 01:12:59 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 01:12:59 user nova-compute[74850]:   </os>
Nov 14 01:12:59 user nova-compute[74850]:   <features>
Nov 14 01:12:59 user nova-compute[74850]:     <acpi/>
Nov 14 01:12:59 user nova-compute[74850]:     <apic/>
Nov 14 01:12:59 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 01:12:59 user nova-compute[74850]:   </features>
Nov 14 01:12:59 user nova-compute[74850]:   <clock offset="utc">
Nov 14 01:12:59 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 01:12:59 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 01:12:59 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 01:12:59 user nova-compute[74850]:   </clock>
Nov 14 01:12:59 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 01:12:59 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 01:12:59 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 01:12:59 user nova-compute[74850]:   </cpu>
Nov 14 01:12:59 user nova-compute[74850]:   <devices>
Nov 14 01:12:59 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 01:12:59 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 01:12:59 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54/disk"/>
Nov 14 01:12:59 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 01:12:59 user nova-compute[74850]:     </disk>
Nov 14 01:12:59 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 01:12:59 user nova-compute[74850]:       <mac address="fa:16:3e:d5:a5:65"/>
Nov 14 01:12:59 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:12:59 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 01:12:59 user nova-compute[74850]:       <target dev="tap08667be8-25"/>
Nov 14 01:12:59 user nova-compute[74850]:     </interface>
Nov 14 01:12:59 user nova-compute[74850]:     <serial type="pty">
Nov 14 01:12:59 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54/console.log" append="off"/>
Nov 14 01:12:59 user nova-compute[74850]:     </serial>
Nov 14 01:12:59 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 01:12:59 user nova-compute[74850]:     <video>
Nov 14 01:12:59 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:12:59 user nova-compute[74850]:     </video>
Nov 14 01:12:59 user nova-compute[74850]:     <rng model="virtio">
Nov 14 01:12:59 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 01:12:59 user nova-compute[74850]:     </rng>
Nov 14 01:12:59 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 01:12:59 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 01:12:59 user nova-compute[74850]:       <stats period="10"/>
Nov 14 01:12:59 user nova-compute[74850]:     </memballoon>
Nov 14 01:12:59 user nova-compute[74850]:   </devices>
Nov 14 01:12:59 user nova-compute[74850]: </domain>
Nov 14 01:12:59 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1246065015',display_name='tempest-TestMinimumBasicScenario-server-1246065015',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1246065015',id=50,image_ref='8ba8bd50-9091-4da9-9f92-78c3d236b684',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCle3EU/m/g9NKR8n+0V6pqHrWP89VQbKtrtNAoI/KQMQsZllveB7EoYMhQdEgVXwVfsjyPlHxXAhJrn14OjYkLuq3H0x9kXgNYXCap00oAFcwtZTMn2iW22mWyQxNulQA==',key_name='tempest-TestMinimumBasicScenario-1702432917',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0ae3f5d3814451c9c7d7264707c8334',ramdisk_id='',reservation_id='r-2c6xm05p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8ba8bd50-9091-4da9-9f92-78c3d236b684',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2056291063',owner_user_name='tempest-TestMinimumBasicScenario-2056291063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:12:57Z,user_data=None,user_id='534b22e8e0c7495f8d2f89dec7e9a66c',uuid=5416dd03-4161-4411-a74b-8d6a6e2e9f54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "address": "fa:16:3e:d5:a5:65", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08667be8-25", "ovs_interfaceid": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Converting VIF {"id": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "address": "fa:16:3e:d5:a5:65", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08667be8-25", "ovs_interfaceid": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:a5:65,bridge_name='br-int',has_traffic_filtering=True,id=08667be8-256e-4d3c-b3a1-e65917c9c2c8,network=Network(7a6e0781-a6cd-4125-bdaf-9b9d53c4d254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08667be8-25') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG os_vif [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:a5:65,bridge_name='br-int',has_traffic_filtering=True,id=08667be8-256e-4d3c-b3a1-e65917c9c2c8,network=Network(7a6e0781-a6cd-4125-bdaf-9b9d53c4d254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08667be8-25') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c64c3842-ad90-5c25-b97f-36456187a99d', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08667be8-25, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap08667be8-25, col_values=(('qos', UUID('84d7c643-d974-4485-9068-50ca2c5f6ad9')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap08667be8-25, col_values=(('external_ids', {'iface-id': '08667be8-256e-4d3c-b3a1-e65917c9c2c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:a5:65', 'vm-uuid': '5416dd03-4161-4411-a74b-8d6a6e2e9f54'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:12:59 user nova-compute[74850]: INFO os_vif [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:a5:65,bridge_name='br-int',has_traffic_filtering=True,id=08667be8-256e-4d3c-b3a1-e65917c9c2c8,network=Network(7a6e0781-a6cd-4125-bdaf-9b9d53c4d254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08667be8-25')
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] No VIF found with MAC fa:16:3e:d5:a5:65, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.361s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 01:12:59 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.network.neutron [req-ae4b81ff-7b52-47b0-93b6-263db227b451 req-5eba7ba6-3d12-4e36-a650-b8e3e410a920 service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Updated VIF entry in instance network info cache for port 08667be8-256e-4d3c-b3a1-e65917c9c2c8. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.network.neutron [req-ae4b81ff-7b52-47b0-93b6-263db227b451 req-5eba7ba6-3d12-4e36-a650-b8e3e410a920 service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Updating instance_info_cache with network_info: [{"id": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "address": "fa:16:3e:d5:a5:65", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08667be8-25", "ovs_interfaceid": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ae4b81ff-7b52-47b0-93b6-263db227b451 req-5eba7ba6-3d12-4e36-a650-b8e3e410a920 service nova] Releasing lock "refresh_cache-5416dd03-4161-4411-a74b-8d6a6e2e9f54" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:12:59 user nova-compute[74850]: INFO nova.virt.block_device [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Booting with volume e5f61623-a91d-46a3-9c5c-7b87d34c9755 at /dev/vda
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.policy [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c91ddcee4e54a769eb626c816596bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb1eb4b5fc841d1952b8db9ae05e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG os_brick.utils [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e90ff8-952b-4eeb-a165-8bc1dce655f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4aebf4-9cc7-4888-89f7-496670fd3d48]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a7b75b-5af6-4146-924f-71df82ae7a78]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e5d30f-6a02-4a20-8e72-07ab56f394bf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:12:59 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 01:12:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de04d4f-8396-4209-9260-a04fd8b5e929]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG os_brick.utils [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:12:59 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Updating existing volume attachment record: ca0ddc2c-8f55-4db8-9412-a4e6ceed4f57 {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 01:13:00 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Successfully created port: 0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 01:13:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:13:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:13:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:13:00 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:13:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:13:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:13:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:13:00 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 01:13:01 user nova-compute[74850]: DEBUG nova.compute.manager [req-39555ff2-aead-4a8b-8410-1c472288b7b3 req-3c0e0334-8b02-4776-9bea-8de2191351b1 service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Received event network-vif-plugged-08667be8-256e-4d3c-b3a1-e65917c9c2c8 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:13:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-39555ff2-aead-4a8b-8410-1c472288b7b3 req-3c0e0334-8b02-4776-9bea-8de2191351b1 service nova] Acquiring lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:13:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-39555ff2-aead-4a8b-8410-1c472288b7b3 req-3c0e0334-8b02-4776-9bea-8de2191351b1 service nova] Lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:13:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-39555ff2-aead-4a8b-8410-1c472288b7b3 req-3c0e0334-8b02-4776-9bea-8de2191351b1 service nova] Lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:13:01 user nova-compute[74850]: DEBUG nova.compute.manager [req-39555ff2-aead-4a8b-8410-1c472288b7b3 req-3c0e0334-8b02-4776-9bea-8de2191351b1 service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] No waiting events found dispatching network-vif-plugged-08667be8-256e-4d3c-b3a1-e65917c9c2c8 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:13:01 user nova-compute[74850]: WARNING nova.compute.manager [req-39555ff2-aead-4a8b-8410-1c472288b7b3 req-3c0e0334-8b02-4776-9bea-8de2191351b1 service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Received unexpected event network-vif-plugged-08667be8-256e-4d3c-b3a1-e65917c9c2c8 for instance with vm_state building and task_state spawning.
Nov 14 01:13:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:13:01 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Successfully updated port: 0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 01:13:01 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:13:01 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebed89ae-c110-4bf3-94e2-af76b19c2a52/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:01 user nova-compute[74850]: DEBUG nova.compute.manager [req-3800a6c6-a708-47f1-bf4e-42928a9b3b52 req-7fe91ef4-e385-49ee-902a-bc318f377cb8 service nova] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Received event network-changed-0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:13:01 user nova-compute[74850]: DEBUG nova.compute.manager [req-3800a6c6-a708-47f1-bf4e-42928a9b3b52 req-7fe91ef4-e385-49ee-902a-bc318f377cb8 service nova] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Refreshing instance network info cache due to event network-changed-0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:13:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3800a6c6-a708-47f1-bf4e-42928a9b3b52 req-7fe91ef4-e385-49ee-902a-bc318f377cb8 service nova] Acquiring lock "refresh_cache-e9b11ad8-52e3-4fd7-9300-80ce830964ec" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:13:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3800a6c6-a708-47f1-bf4e-42928a9b3b52 req-7fe91ef4-e385-49ee-902a-bc318f377cb8 service nova] Acquired lock "refresh_cache-e9b11ad8-52e3-4fd7-9300-80ce830964ec" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:13:01 user nova-compute[74850]: DEBUG nova.network.neutron [req-3800a6c6-a708-47f1-bf4e-42928a9b3b52 req-7fe91ef4-e385-49ee-902a-bc318f377cb8 service nova] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Refreshing network info cache for port 0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:13:01 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebed89ae-c110-4bf3-94e2-af76b19c2a52/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:01 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebed89ae-c110-4bf3-94e2-af76b19c2a52/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:01 user nova-compute[74850]: DEBUG nova.network.neutron [req-3800a6c6-a708-47f1-bf4e-42928a9b3b52 req-7fe91ef4-e385-49ee-902a-bc318f377cb8 service nova] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 01:13:01 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebed89ae-c110-4bf3-94e2-af76b19c2a52/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:13:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "refresh_cache-e9b11ad8-52e3-4fd7-9300-80ce830964ec" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:13:01 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:13:01 user nova-compute[74850]: DEBUG nova.network.neutron [req-3800a6c6-a708-47f1-bf4e-42928a9b3b52 req-7fe91ef4-e385-49ee-902a-bc318f377cb8 service nova] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:13:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3800a6c6-a708-47f1-bf4e-42928a9b3b52 req-7fe91ef4-e385-49ee-902a-bc318f377cb8 service nova] Releasing lock "refresh_cache-e9b11ad8-52e3-4fd7-9300-80ce830964ec" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:13:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquired lock "refresh_cache-e9b11ad8-52e3-4fd7-9300-80ce830964ec" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:13:01 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 01:13:01 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 01:13:01 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:01 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:02 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Updating instance_info_cache with network_info: [{"id": "0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b", "address": "fa:16:3e:d3:f2:a5", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f3488f7-dd", "ovs_interfaceid": "0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:13:02 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Releasing lock "refresh_cache-e9b11ad8-52e3-4fd7-9300-80ce830964ec" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:13:02 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Instance network_info: |[{"id": "0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b", "address": "fa:16:3e:d3:f2:a5", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f3488f7-dd", "ovs_interfaceid": "0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 01:13:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c18a949-25d9-4db9-bac5-b0b75d9a5751/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c18a949-25d9-4db9-bac5-b0b75d9a5751/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c18a949-25d9-4db9-bac5-b0b75d9a5751/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c18a949-25d9-4db9-bac5-b0b75d9a5751/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:03 user nova-compute[74850]: DEBUG nova.compute.manager [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 01:13:03 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 01:13:03 user nova-compute[74850]: DEBUG nova.compute.manager [req-365728dc-74f0-44e9-bdee-cdd9a98202d2 req-8607a296-b7ff-4934-8fa3-89fc9b2fb533 service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Received event network-vif-plugged-08667be8-256e-4d3c-b3a1-e65917c9c2c8 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:13:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-365728dc-74f0-44e9-bdee-cdd9a98202d2 req-8607a296-b7ff-4934-8fa3-89fc9b2fb533 service nova] Acquiring lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:13:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-365728dc-74f0-44e9-bdee-cdd9a98202d2 req-8607a296-b7ff-4934-8fa3-89fc9b2fb533 service nova] Lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:13:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-365728dc-74f0-44e9-bdee-cdd9a98202d2 req-8607a296-b7ff-4934-8fa3-89fc9b2fb533 service nova] Lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:13:03 user nova-compute[74850]: DEBUG nova.compute.manager [req-365728dc-74f0-44e9-bdee-cdd9a98202d2 req-8607a296-b7ff-4934-8fa3-89fc9b2fb533 service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] No waiting events found dispatching network-vif-plugged-08667be8-256e-4d3c-b3a1-e65917c9c2c8 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:13:03 user nova-compute[74850]: WARNING nova.compute.manager [req-365728dc-74f0-44e9-bdee-cdd9a98202d2 req-8607a296-b7ff-4934-8fa3-89fc9b2fb533 service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Received unexpected event network-vif-plugged-08667be8-256e-4d3c-b3a1-e65917c9c2c8 for instance with vm_state building and task_state spawning.
Nov 14 01:13:03 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Instance spawned successfully.
Nov 14 01:13:03 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:13:03 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:13:03 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=8381MB free_disk=24.882091522216797GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 01:13:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:13:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:13:03 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 01:13:03 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:13:03 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:13:03 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:13:03 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:13:03 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:13:03 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:13:03 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance c7952bff-87d6-46c1-a6d4-7729dc4893ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:13:03 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 6ac6355d-eb05-4d1a-94c5-8ca630e926f4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:13:03 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance ebed89ae-c110-4bf3-94e2-af76b19c2a52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:13:03 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 2c18a949-25d9-4db9-bac5-b0b75d9a5751 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:13:03 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 5416dd03-4161-4411-a74b-8d6a6e2e9f54 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:13:03 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance e9b11ad8-52e3-4fd7-9300-80ce830964ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:13:03 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 01:13:03 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 01:13:03 user nova-compute[74850]: INFO nova.compute.manager [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Took 6.78 seconds to spawn the instance on the hypervisor.
Nov 14 01:13:03 user nova-compute[74850]: DEBUG nova.compute.manager [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 01:13:03 user nova-compute[74850]: INFO nova.compute.manager [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Took 7.41 seconds to build instance.
Nov 14 01:13:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-19039bb9-4ebb-4de4-9caa-f420777f67e2 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.508s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:13:03 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:13:03 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.412s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 01:13:04 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Creating image(s)
Nov 14 01:13:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Did not create local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Ensure instance console log exists: /opt/stack/data/nova/instances/e9b11ad8-52e3-4fd7-9300-80ce830964ec/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Start _get_guest_xml network_info=[{"id": "0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b", "address": "fa:16:3e:d3:f2:a5", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f3488f7-dd", "ovs_interfaceid": "0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ca0ddc2c-8f55-4db8-9412-a4e6ceed4f57', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wRZimIVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e9b11ad8-52e3-4fd7-9300-80ce830964ec', 'attached_at': '', 'detached_at': '', 'volume_id': 'e5f61623-a91d-46a3-9c5c-7b87d34c9755', 'serial': 'e5f61623-a91d-46a3-9c5c-7b87d34c9755'}, 'volume_type': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 01:13:04 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:13:04 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:13:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wRZimIVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:13:04 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:13:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:13:04 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:13:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:13:04 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 01:13:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e55c9c6-941c-4558-8f1c-0e6b5215bf72]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 01:13:04 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed12e82-27c4-4540-a31e-47408b4b95d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755] added
Nov 14 01:13:04 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc087d3a-aa17-475e-8748-9983814ac0e7]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[29423d5b-bd06-4ad9-917a-eae5b83c5794]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wRZimIVl {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wRZimIVl" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e671c36-5af1-49e7-bd17-42940a043045]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wRZimIVl'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c849bd9-18a7-4705-816c-548c094e1e94]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34f1722-949f-4c77-a28f-77d05f8fe392]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:13:04 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:13:04 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dee3fe0-0a3c-437c-a006-b9de03016bd9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755, portal: 172.16.0.220,3260]
Nov 14 01:13:04 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755, portal: 172.16.0.220,3260] successful.
Nov 14 01:13:04 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfdb296-6f76-4f58-905e-66f47873f2f7]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94ee9d0-1c02-4115-ae31-c941018bda5e]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:13:04 user nova-compute[74850]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 (non-flash)
Nov 14 01:13:04 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:13:04 user nova-compute[74850]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 (non-flash)
Nov 14 01:13:04 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a6a76c-ddb6-4857-ab32-3082bd09d7d5]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:13:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wRZimIVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG nova.compute.manager [req-ddb4d7b5-4511-4c33-8794-a0d7ec578e8a req-fcaa643b-f1bc-48fd-a2a9-1e98be5cf509 service nova] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Received event network-changed-73c210c0-59f3-4551-be32-77168edd3996 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG nova.compute.manager [req-ddb4d7b5-4511-4c33-8794-a0d7ec578e8a req-fcaa643b-f1bc-48fd-a2a9-1e98be5cf509 service nova] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Refreshing instance network info cache due to event network-changed-73c210c0-59f3-4551-be32-77168edd3996. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ddb4d7b5-4511-4c33-8794-a0d7ec578e8a req-fcaa643b-f1bc-48fd-a2a9-1e98be5cf509 service nova] Acquiring lock "refresh_cache-ebed89ae-c110-4bf3-94e2-af76b19c2a52" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ddb4d7b5-4511-4c33-8794-a0d7ec578e8a req-fcaa643b-f1bc-48fd-a2a9-1e98be5cf509 service nova] Acquired lock "refresh_cache-ebed89ae-c110-4bf3-94e2-af76b19c2a52" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG nova.network.neutron [req-ddb4d7b5-4511-4c33-8794-a0d7ec578e8a req-fcaa643b-f1bc-48fd-a2a9-1e98be5cf509 service nova] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Refreshing network info cache for port 73c210c0-59f3-4551-be32-77168edd3996 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Acquiring lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG nova.objects.instance [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lazy-loading 'flavor' on Instance uuid ebed89ae-c110-4bf3-94e2-af76b19c2a52 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23365636634646438', 'path': '/dev/sdb'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365636634646438', 'path': '/dev/sdb'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:12:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-919979771',display_name='tempest-TestVolumeBootPattern-server-919979771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-919979771',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA94n5zD/7RpobhW+jYq5sAS9UK4izFU1jEjxsSgfhAiBUC2oNIUdSW107BwtkqMZ7Uku+sA2LquAPtuZM0gk2nZsUp6hWLP86Pz4tdmgGXQVoyyrGsrxeP25l2IFQWByQ==',key_name='tempest-TestVolumeBootPattern-543311029',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdb1eb4b5fc841d1952b8db9ae05e446',ramdisk_id='',reservation_id='r-70mlhk5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1536334624',owner_user_name='tempest-TestVolumeBootPattern-1536334624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:13:00Z,user_data=None,user_id='6c91ddcee4e54a769eb626c816596bed',uuid=e9b11ad8-52e3-4fd7-9300-80ce830964ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b", "address": "fa:16:3e:d3:f2:a5", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f3488f7-dd", "ovs_interfaceid": "0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Converting VIF {"id": "0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b", "address": "fa:16:3e:d3:f2:a5", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f3488f7-dd", "ovs_interfaceid": "0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:f2:a5,bridge_name='br-int',has_traffic_filtering=True,id=0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f3488f7-dd') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG nova.objects.instance [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lazy-loading 'pci_devices' on Instance uuid e9b11ad8-52e3-4fd7-9300-80ce830964ec {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Acquiring lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:13:05 user nova-compute[74850]: INFO nova.compute.manager [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Attaching volume e31d0be8-ab13-4032-8649-d56cd2b2dcca to /dev/vdb
Nov 14 01:13:05 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] End _get_guest_xml xml=<domain type="kvm">
Nov 14 01:13:05 user nova-compute[74850]:   <uuid>e9b11ad8-52e3-4fd7-9300-80ce830964ec</uuid>
Nov 14 01:13:05 user nova-compute[74850]:   <name>instance-00000033</name>
Nov 14 01:13:05 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 01:13:05 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 01:13:05 user nova-compute[74850]:   <metadata>
Nov 14 01:13:05 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 01:13:05 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 01:13:05 user nova-compute[74850]:       <nova:name>tempest-TestVolumeBootPattern-server-919979771</nova:name>
Nov 14 01:13:05 user nova-compute[74850]:       <nova:creationTime>2023-11-14 01:13:04</nova:creationTime>
Nov 14 01:13:05 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 01:13:05 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 01:13:05 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 01:13:05 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 01:13:05 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 01:13:05 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 01:13:05 user nova-compute[74850]:       </nova:flavor>
Nov 14 01:13:05 user nova-compute[74850]:       <nova:owner>
Nov 14 01:13:05 user nova-compute[74850]:         <nova:user uuid="6c91ddcee4e54a769eb626c816596bed">tempest-TestVolumeBootPattern-1536334624-project-member</nova:user>
Nov 14 01:13:05 user nova-compute[74850]:         <nova:project uuid="fdb1eb4b5fc841d1952b8db9ae05e446">tempest-TestVolumeBootPattern-1536334624</nova:project>
Nov 14 01:13:05 user nova-compute[74850]:       </nova:owner>
Nov 14 01:13:05 user nova-compute[74850]:       <nova:ports>
Nov 14 01:13:05 user nova-compute[74850]:         <nova:port uuid="0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b">
Nov 14 01:13:05 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 01:13:05 user nova-compute[74850]:         </nova:port>
Nov 14 01:13:05 user nova-compute[74850]:       </nova:ports>
Nov 14 01:13:05 user nova-compute[74850]:     </nova:instance>
Nov 14 01:13:05 user nova-compute[74850]:   </metadata>
Nov 14 01:13:05 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 01:13:05 user nova-compute[74850]:     <system>
Nov 14 01:13:05 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 01:13:05 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 01:13:05 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 01:13:05 user nova-compute[74850]:       <entry name="serial">e9b11ad8-52e3-4fd7-9300-80ce830964ec</entry>
Nov 14 01:13:05 user nova-compute[74850]:       <entry name="uuid">e9b11ad8-52e3-4fd7-9300-80ce830964ec</entry>
Nov 14 01:13:05 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 01:13:05 user nova-compute[74850]:     </system>
Nov 14 01:13:05 user nova-compute[74850]:   </sysinfo>
Nov 14 01:13:05 user nova-compute[74850]:   <os>
Nov 14 01:13:05 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 01:13:05 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 01:13:05 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 01:13:05 user nova-compute[74850]:   </os>
Nov 14 01:13:05 user nova-compute[74850]:   <features>
Nov 14 01:13:05 user nova-compute[74850]:     <acpi/>
Nov 14 01:13:05 user nova-compute[74850]:     <apic/>
Nov 14 01:13:05 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 01:13:05 user nova-compute[74850]:   </features>
Nov 14 01:13:05 user nova-compute[74850]:   <clock offset="utc">
Nov 14 01:13:05 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 01:13:05 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 01:13:05 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 01:13:05 user nova-compute[74850]:   </clock>
Nov 14 01:13:05 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 01:13:05 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 01:13:05 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 01:13:05 user nova-compute[74850]:   </cpu>
Nov 14 01:13:05 user nova-compute[74850]:   <devices>
Nov 14 01:13:05 user nova-compute[74850]:     <disk type="block" device="disk">
Nov 14 01:13:05 user nova-compute[74850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:13:05 user nova-compute[74850]:       <source dev="/dev/sdb"/>
Nov 14 01:13:05 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 01:13:05 user nova-compute[74850]:       <serial>e5f61623-a91d-46a3-9c5c-7b87d34c9755</serial>
Nov 14 01:13:05 user nova-compute[74850]:     </disk>
Nov 14 01:13:05 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 01:13:05 user nova-compute[74850]:       <mac address="fa:16:3e:d3:f2:a5"/>
Nov 14 01:13:05 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:13:05 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 01:13:05 user nova-compute[74850]:       <target dev="tap0f3488f7-dd"/>
Nov 14 01:13:05 user nova-compute[74850]:     </interface>
Nov 14 01:13:05 user nova-compute[74850]:     <serial type="pty">
Nov 14 01:13:05 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/e9b11ad8-52e3-4fd7-9300-80ce830964ec/console.log" append="off"/>
Nov 14 01:13:05 user nova-compute[74850]:     </serial>
Nov 14 01:13:05 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 01:13:05 user nova-compute[74850]:     <video>
Nov 14 01:13:05 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:13:05 user nova-compute[74850]:     </video>
Nov 14 01:13:05 user nova-compute[74850]:     <rng model="virtio">
Nov 14 01:13:05 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 01:13:05 user nova-compute[74850]:     </rng>
Nov 14 01:13:05 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 01:13:05 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 01:13:05 user nova-compute[74850]:       <stats period="10"/>
Nov 14 01:13:05 user nova-compute[74850]:     </memballoon>
Nov 14 01:13:05 user nova-compute[74850]:   </devices>
Nov 14 01:13:05 user nova-compute[74850]: </domain>
Nov 14 01:13:05 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:12:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-919979771',display_name='tempest-TestVolumeBootPattern-server-919979771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-919979771',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA94n5zD/7RpobhW+jYq5sAS9UK4izFU1jEjxsSgfhAiBUC2oNIUdSW107BwtkqMZ7Uku+sA2LquAPtuZM0gk2nZsUp6hWLP86Pz4tdmgGXQVoyyrGsrxeP25l2IFQWByQ==',key_name='tempest-TestVolumeBootPattern-543311029',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdb1eb4b5fc841d1952b8db9ae05e446',ramdisk_id='',reservation_id='r-70mlhk5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1536334624',owner_user_name='tempest-TestVolumeBootPattern-1536334624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:13:00Z,user_data=None,user_id='6c91ddcee4e54a769eb626c816596bed',uuid=e9b11ad8-52e3-4fd7-9300-80ce830964ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b", "address": "fa:16:3e:d3:f2:a5", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f3488f7-dd", "ovs_interfaceid": "0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Converting VIF {"id": "0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b", "address": "fa:16:3e:d3:f2:a5", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f3488f7-dd", "ovs_interfaceid": "0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:f2:a5,bridge_name='br-int',has_traffic_filtering=True,id=0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f3488f7-dd') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG os_vif [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:f2:a5,bridge_name='br-int',has_traffic_filtering=True,id=0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f3488f7-dd') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '531f2677-d77f-51d4-befc-82143ddc6204', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f3488f7-dd, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f3488f7-dd, col_values=(('qos', UUID('8d6f7623-565c-4c79-a225-7487c5fc9bc5')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f3488f7-dd, col_values=(('external_ids', {'iface-id': '0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:f2:a5', 'vm-uuid': 'e9b11ad8-52e3-4fd7-9300-80ce830964ec'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:13:05 user nova-compute[74850]: INFO os_vif [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:f2:a5,bridge_name='br-int',has_traffic_filtering=True,id=0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f3488f7-dd')
Nov 14 01:13:05 user nova-compute[74850]: DEBUG os_brick.utils [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[777362dc-cddf-42f9-b481-81ba6ac65ae3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fcdc0e-3e7a-4566-8843-8be3e057785d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[710718bb-168e-4a47-b934-400af19dbaca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[544ff8e1-e8e8-4518-8728-83962f375b7b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] No VIF found with MAC fa:16:3e:d3:f2:a5, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:13:05 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 01:13:05 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3caedf03-c625-422a-890b-33de4eaf65ec]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG os_brick.utils [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:13:05 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Updating existing volume attachment record: dea34098-728c-4bf6-9325-25159d11d3c5 {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 01:13:06 user nova-compute[74850]: DEBUG nova.network.neutron [req-ddb4d7b5-4511-4c33-8794-a0d7ec578e8a req-fcaa643b-f1bc-48fd-a2a9-1e98be5cf509 service nova] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Updated VIF entry in instance network info cache for port 73c210c0-59f3-4551-be32-77168edd3996. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:13:06 user nova-compute[74850]: DEBUG nova.network.neutron [req-ddb4d7b5-4511-4c33-8794-a0d7ec578e8a req-fcaa643b-f1bc-48fd-a2a9-1e98be5cf509 service nova] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Updating instance_info_cache with network_info: [{"id": "73c210c0-59f3-4551-be32-77168edd3996", "address": "fa:16:3e:b9:08:c7", "network": {"id": "9ddeb146-c3d9-4d05-b46c-7fab63c8dfc2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1027315340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6c2226993ed451286826a667f802a76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c210c0-59", "ovs_interfaceid": "73c210c0-59f3-4551-be32-77168edd3996", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:13:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ddb4d7b5-4511-4c33-8794-a0d7ec578e8a req-fcaa643b-f1bc-48fd-a2a9-1e98be5cf509 service nova] Releasing lock "refresh_cache-ebed89ae-c110-4bf3-94e2-af76b19c2a52" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:13:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:13:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:13:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:13:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:13:07 user nova-compute[74850]: DEBUG nova.compute.manager [req-0baf4afe-f1b9-4732-8dc3-0d90a2db1856 req-5c0208ba-0723-4309-bcb6-021f09fb1c5b service nova] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Received event network-vif-plugged-0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:13:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-0baf4afe-f1b9-4732-8dc3-0d90a2db1856 req-5c0208ba-0723-4309-bcb6-021f09fb1c5b service nova] Acquiring lock "e9b11ad8-52e3-4fd7-9300-80ce830964ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:13:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-0baf4afe-f1b9-4732-8dc3-0d90a2db1856 req-5c0208ba-0723-4309-bcb6-021f09fb1c5b service nova] Lock "e9b11ad8-52e3-4fd7-9300-80ce830964ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:13:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-0baf4afe-f1b9-4732-8dc3-0d90a2db1856 req-5c0208ba-0723-4309-bcb6-021f09fb1c5b service nova] Lock "e9b11ad8-52e3-4fd7-9300-80ce830964ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:13:07 user nova-compute[74850]: DEBUG nova.compute.manager [req-0baf4afe-f1b9-4732-8dc3-0d90a2db1856 req-5c0208ba-0723-4309-bcb6-021f09fb1c5b service nova] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] No waiting events found dispatching network-vif-plugged-0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:13:07 user nova-compute[74850]: WARNING nova.compute.manager [req-0baf4afe-f1b9-4732-8dc3-0d90a2db1856 req-5c0208ba-0723-4309-bcb6-021f09fb1c5b service nova] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Received unexpected event network-vif-plugged-0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b for instance with vm_state building and task_state spawning.
Nov 14 01:13:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:13:09 user nova-compute[74850]: DEBUG nova.compute.manager [req-829ba61c-8910-4958-b331-e84aa76ea55f req-42a4024d-28e9-41ad-baee-aa9bfa51d9de service nova] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Received event network-vif-plugged-0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:13:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-829ba61c-8910-4958-b331-e84aa76ea55f req-42a4024d-28e9-41ad-baee-aa9bfa51d9de service nova] Acquiring lock "e9b11ad8-52e3-4fd7-9300-80ce830964ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:13:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-829ba61c-8910-4958-b331-e84aa76ea55f req-42a4024d-28e9-41ad-baee-aa9bfa51d9de service nova] Lock "e9b11ad8-52e3-4fd7-9300-80ce830964ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:13:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-829ba61c-8910-4958-b331-e84aa76ea55f req-42a4024d-28e9-41ad-baee-aa9bfa51d9de service nova] Lock "e9b11ad8-52e3-4fd7-9300-80ce830964ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:13:09 user nova-compute[74850]: DEBUG nova.compute.manager [req-829ba61c-8910-4958-b331-e84aa76ea55f req-42a4024d-28e9-41ad-baee-aa9bfa51d9de service nova] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] No waiting events found dispatching network-vif-plugged-0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:13:09 user nova-compute[74850]: WARNING nova.compute.manager [req-829ba61c-8910-4958-b331-e84aa76ea55f req-42a4024d-28e9-41ad-baee-aa9bfa51d9de service nova] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Received unexpected event network-vif-plugged-0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b for instance with vm_state building and task_state spawning.
Nov 14 01:13:09 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 01:13:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 01:13:09 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Instance spawned successfully.
Nov 14 01:13:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 01:13:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:13:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:13:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:13:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:13:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:13:09 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:13:09 user nova-compute[74850]: INFO nova.compute.manager [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Took 5.54 seconds to spawn the instance on the hypervisor.
Nov 14 01:13:09 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 01:13:09 user nova-compute[74850]: INFO nova.compute.manager [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Took 10.84 seconds to build instance.
Nov 14 01:13:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4dff121d-065c-4087-b141-84c74678e0b3 tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "e9b11ad8-52e3-4fd7-9300-80ce830964ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.955s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-776f309d-661b-49ba-848f-267aa6330b77 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "c7952bff-87d6-46c1-a6d4-7729dc4893ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-776f309d-661b-49ba-848f-267aa6330b77 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "c7952bff-87d6-46c1-a6d4-7729dc4893ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-776f309d-661b-49ba-848f-267aa6330b77 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "c7952bff-87d6-46c1-a6d4-7729dc4893ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-776f309d-661b-49ba-848f-267aa6330b77 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "c7952bff-87d6-46c1-a6d4-7729dc4893ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-776f309d-661b-49ba-848f-267aa6330b77 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "c7952bff-87d6-46c1-a6d4-7729dc4893ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:13:10 user nova-compute[74850]: INFO nova.compute.manager [None req-776f309d-661b-49ba-848f-267aa6330b77 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Terminating instance
Nov 14 01:13:10 user nova-compute[74850]: DEBUG nova.compute.manager [None req-776f309d-661b-49ba-848f-267aa6330b77 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UFwRkTMs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:13:10 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:13:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:13:10 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:13:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:13:10 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[194f8b9a-9dd7-4940-a81c-9b2bdf7e5aa1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 01:13:10 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd42a17-7c51-4ea0-b419-75bbde36f21d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca] added
Nov 14 01:13:10 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[83eaacfc-9a75-4a2d-8b1d-953076691350]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG nova.compute.manager [req-2fd1f5d4-28d4-4867-a5eb-220af87eb083 req-c0f0013d-25a9-4ce4-a26e-8c5097c73c42 service nova] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Received event network-vif-unplugged-de35d2a9-b199-4dbc-8394-915938223e27 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-2fd1f5d4-28d4-4867-a5eb-220af87eb083 req-c0f0013d-25a9-4ce4-a26e-8c5097c73c42 service nova] Acquiring lock "c7952bff-87d6-46c1-a6d4-7729dc4893ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-2fd1f5d4-28d4-4867-a5eb-220af87eb083 req-c0f0013d-25a9-4ce4-a26e-8c5097c73c42 service nova] Lock "c7952bff-87d6-46c1-a6d4-7729dc4893ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-2fd1f5d4-28d4-4867-a5eb-220af87eb083 req-c0f0013d-25a9-4ce4-a26e-8c5097c73c42 service nova] Lock "c7952bff-87d6-46c1-a6d4-7729dc4893ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG nova.compute.manager [req-2fd1f5d4-28d4-4867-a5eb-220af87eb083 req-c0f0013d-25a9-4ce4-a26e-8c5097c73c42 service nova] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] No waiting events found dispatching network-vif-unplugged-de35d2a9-b199-4dbc-8394-915938223e27 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG nova.compute.manager [req-2fd1f5d4-28d4-4867-a5eb-220af87eb083 req-c0f0013d-25a9-4ce4-a26e-8c5097c73c42 service nova] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Received event network-vif-unplugged-de35d2a9-b199-4dbc-8394-915938223e27 for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ff9a10-0de7-40af-80c5-dc313aa6388b]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UFwRkTMs {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UFwRkTMs" returned: 0 in 0.024s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb29b6b-c5af-4a24-9fc2-b318b817249d]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UFwRkTMs'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb088772-6336-4160-974f-5fbfa72435a7]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf91e72-d40e-43d1-8d93-1b9744b702c0]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:13:10 user nova-compute[74850]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 (non-flash)
Nov 14 01:13:10 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:13:10 user nova-compute[74850]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 (non-flash)
Nov 14 01:13:10 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3fa2d3-6f2d-48b2-b829-2c75ae670037]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca, portal: 172.16.0.220,3260]
Nov 14 01:13:10 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca, portal: 172.16.0.220,3260] successful.
Nov 14 01:13:10 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:10 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Instance destroyed successfully.
Nov 14 01:13:10 user nova-compute[74850]: DEBUG nova.objects.instance [None req-776f309d-661b-49ba-848f-267aa6330b77 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lazy-loading 'resources' on Instance uuid c7952bff-87d6-46c1-a6d4-7729dc4893ff {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[de40a070-341b-4958-b5b3-7108c317aa15]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-776f309d-661b-49ba-848f-267aa6330b77 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:53:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1812687421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1812687421',id=26,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:53:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='491aa2a4f38140788cb0de9762a8baf4',ramdisk_id='',reservation_id='r-w45a4rq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-726213232',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:55:30Z,user_data=None,user_id='a5bb5d788a3b4871ae41f57d06f785f2',uuid=c7952bff-87d6-46c1-a6d4-7729dc4893ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de35d2a9-b199-4dbc-8394-915938223e27", "address": "fa:16:3e:b9:56:80", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde35d2a9-b1", "ovs_interfaceid": "de35d2a9-b199-4dbc-8394-915938223e27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-776f309d-661b-49ba-848f-267aa6330b77 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Converting VIF {"id": "de35d2a9-b199-4dbc-8394-915938223e27", "address": "fa:16:3e:b9:56:80", "network": {"id": "6f8f66ca-e2e8-4565-a05c-df75a16699ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-391373132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491aa2a4f38140788cb0de9762a8baf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde35d2a9-b1", "ovs_interfaceid": "de35d2a9-b199-4dbc-8394-915938223e27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-776f309d-661b-49ba-848f-267aa6330b77 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:56:80,bridge_name='br-int',has_traffic_filtering=True,id=de35d2a9-b199-4dbc-8394-915938223e27,network=Network(6f8f66ca-e2e8-4565-a05c-df75a16699ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde35d2a9-b1') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG os_vif [None req-776f309d-661b-49ba-848f-267aa6330b77 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:56:80,bridge_name='br-int',has_traffic_filtering=True,id=de35d2a9-b199-4dbc-8394-915938223e27,network=Network(6f8f66ca-e2e8-4565-a05c-df75a16699ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde35d2a9-b1') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7a3ebb-b1a9-4774-aa80-85ec1bc381ed]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:13:10 user nova-compute[74850]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 (non-flash)
Nov 14 01:13:10 user nova-compute[74850]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca (non-flash)
Nov 14 01:13:10 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:13:10 user nova-compute[74850]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 (non-flash)
Nov 14 01:13:10 user nova-compute[74850]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca (non-flash)
Nov 14 01:13:10 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] HCTL ('35', '-', '-', 0) found on session 54 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde35d2a9-b1, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3ef9eb47-107b-4250-b7bc-ff2a03564449) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:13:10 user nova-compute[74850]: INFO os_vif [None req-776f309d-661b-49ba-848f-267aa6330b77 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:56:80,bridge_name='br-int',has_traffic_filtering=True,id=de35d2a9-b199-4dbc-8394-915938223e27,network=Network(6f8f66ca-e2e8-4565-a05c-df75a16699ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde35d2a9-b1')
Nov 14 01:13:10 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-776f309d-661b-49ba-848f-267aa6330b77 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Deleting instance files /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff_del
Nov 14 01:13:10 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-776f309d-661b-49ba-848f-267aa6330b77 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Deletion of /opt/stack/data/nova/instances/c7952bff-87d6-46c1-a6d4-7729dc4893ff_del complete
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfba7c2-4865-48cd-86d1-df21119d85c1]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UFwRkTMs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 01:13:10 user nova-compute[74850]: INFO nova.compute.manager [None req-776f309d-661b-49ba-848f-267aa6330b77 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Took 0.78 seconds to destroy the instance on the hypervisor.
Nov 14 01:13:10 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-776f309d-661b-49ba-848f-267aa6330b77 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 01:13:10 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 01:13:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:13:11 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:13:11 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Took 0.64 seconds to deallocate network for instance.
Nov 14 01:13:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-776f309d-661b-49ba-848f-267aa6330b77 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:13:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-776f309d-661b-49ba-848f-267aa6330b77 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:13:11 user nova-compute[74850]: DEBUG nova.compute.manager [req-f378f663-8b4c-4f5b-8fbb-45e17be37d84 req-d82e88eb-c727-4f02-9f4d-a8828eab76c2 service nova] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Received event network-vif-deleted-de35d2a9-b199-4dbc-8394-915938223e27 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:13:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:13:11 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '26138636633343761', 'path': '/dev/sdd'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:13:11 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138636633343761', 'path': '/dev/sdd'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 01:13:11 user nova-compute[74850]: DEBUG nova.objects.instance [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lazy-loading 'flavor' on Instance uuid ebed89ae-c110-4bf3-94e2-af76b19c2a52 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:13:11 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 01:13:11 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:13:11 user nova-compute[74850]:   <source dev="/dev/sdd"/>
Nov 14 01:13:11 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:13:11 user nova-compute[74850]:   <serial>e31d0be8-ab13-4032-8649-d56cd2b2dcca</serial>
Nov 14 01:13:11 user nova-compute[74850]: </disk>
Nov 14 01:13:11 user nova-compute[74850]:  {{(pid=74850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 01:13:11 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-776f309d-661b-49ba-848f-267aa6330b77 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:13:11 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-776f309d-661b-49ba-848f-267aa6330b77 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:13:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-776f309d-661b-49ba-848f-267aa6330b77 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:13:11 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-776f309d-661b-49ba-848f-267aa6330b77 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Deleted allocations for instance c7952bff-87d6-46c1-a6d4-7729dc4893ff
Nov 14 01:13:11 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:13:11 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:13:11 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:13:11 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:13:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-776f309d-661b-49ba-848f-267aa6330b77 tempest-ServerBootFromVolumeStableRescueTest-726213232 tempest-ServerBootFromVolumeStableRescueTest-726213232-project-member] Lock "c7952bff-87d6-46c1-a6d4-7729dc4893ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.945s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:13:12 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:13:12 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:13:12 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] No VIF found with MAC fa:16:3e:b9:08:c7, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:13:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-8d400836-7949-4524-a25f-a5b664b41864 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.617s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:13:12 user nova-compute[74850]: DEBUG nova.compute.manager [req-89ce186d-6b7f-4e75-b521-86511a5f89b4 req-e5253f08-d766-45e8-ac0d-2773520bf017 service nova] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Received event network-vif-plugged-de35d2a9-b199-4dbc-8394-915938223e27 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:13:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-89ce186d-6b7f-4e75-b521-86511a5f89b4 req-e5253f08-d766-45e8-ac0d-2773520bf017 service nova] Acquiring lock "c7952bff-87d6-46c1-a6d4-7729dc4893ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:13:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-89ce186d-6b7f-4e75-b521-86511a5f89b4 req-e5253f08-d766-45e8-ac0d-2773520bf017 service nova] Lock "c7952bff-87d6-46c1-a6d4-7729dc4893ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:13:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-89ce186d-6b7f-4e75-b521-86511a5f89b4 req-e5253f08-d766-45e8-ac0d-2773520bf017 service nova] Lock "c7952bff-87d6-46c1-a6d4-7729dc4893ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:13:12 user nova-compute[74850]: DEBUG nova.compute.manager [req-89ce186d-6b7f-4e75-b521-86511a5f89b4 req-e5253f08-d766-45e8-ac0d-2773520bf017 service nova] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] No waiting events found dispatching network-vif-plugged-de35d2a9-b199-4dbc-8394-915938223e27 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:13:12 user nova-compute[74850]: WARNING nova.compute.manager [req-89ce186d-6b7f-4e75-b521-86511a5f89b4 req-e5253f08-d766-45e8-ac0d-2773520bf017 service nova] [instance: c7952bff-87d6-46c1-a6d4-7729dc4893ff] Received unexpected event network-vif-plugged-de35d2a9-b199-4dbc-8394-915938223e27 for instance with vm_state deleted and task_state None.
Nov 14 01:13:12 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:13:12 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 01:13:13 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:13:13 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 01:13:13 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Rebuilding the list of instances to heal {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 01:13:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "refresh_cache-6ac6355d-eb05-4d1a-94c5-8ca630e926f4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:13:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquired lock "refresh_cache-6ac6355d-eb05-4d1a-94c5-8ca630e926f4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:13:14 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Forcefully refreshing network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 01:13:14 user nova-compute[74850]: DEBUG nova.objects.instance [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lazy-loading 'info_cache' on Instance uuid 6ac6355d-eb05-4d1a-94c5-8ca630e926f4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:13:14 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Updating instance_info_cache with network_info: [{"id": "4f8a261a-c9f2-47b4-a0e7-ae6730ec962a", "address": "fa:16:3e:78:cd:0b", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8a261a-c9", "ovs_interfaceid": "4f8a261a-c9f2-47b4-a0e7-ae6730ec962a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:13:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Releasing lock "refresh_cache-6ac6355d-eb05-4d1a-94c5-8ca630e926f4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:13:14 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Updated the network info_cache for instance {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 01:13:15 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:13:15 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:13:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:13:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Acquiring lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:13:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:13:16 user nova-compute[74850]: DEBUG nova.objects.instance [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lazy-loading 'flavor' on Instance uuid ebed89ae-c110-4bf3-94e2-af76b19c2a52 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:13:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:13:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Acquiring lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:13:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:13:16 user nova-compute[74850]: INFO nova.compute.manager [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Attaching volume 32d3329a-38b2-4536-b46f-b9240911fe77 to /dev/vdc
Nov 14 01:13:16 user nova-compute[74850]: DEBUG os_brick.utils [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:13:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:16 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[45501c76-2867-4da8-8f0a-0bb3c294b0f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:16 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1368a64-01dc-472d-b2ff-cff620ecbfda]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:16 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[15369998-6511-42ba-857e-1ec0777317c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:16 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3061fa-d2ed-455c-b26d-368458da300f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:13:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 01:13:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:13:16 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 01:13:16 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba9cc71-8f0c-4bf4-bee1-cde176ebde35]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 01:13:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 01:13:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 01:13:16 user nova-compute[74850]: DEBUG os_brick.utils [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:13:16 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Updating existing volume attachment record: 4525f68b-02b7-47c7-9035-c8111d6ecf89 {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 01:13:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HcgpAbUx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:13:21 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:13:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:13:21 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:13:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:13:21 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 01:13:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77 -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f973bc-1878-4cfc-be10-14502b8d65fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 01:13:21 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77 -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1249fb3-d771-4c50-b0ec-dffb15ccccb5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77] added
Nov 14 01:13:21 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8340c7ee-d433-4b5c-b91b-da048bb68352]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c0c846-870d-45de-8203-6d36f0ebb395]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HcgpAbUx {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HcgpAbUx" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d77297-39de-472f-a7a9-1130cea43952]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HcgpAbUx'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7431935a-fb38-42cc-ab63-5b28c5f1103a]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ca2990-2fda-485c-bf41-45908f58af7c]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:13:21 user nova-compute[74850]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 (non-flash)
Nov 14 01:13:21 user nova-compute[74850]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca (non-flash)
Nov 14 01:13:21 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:13:21 user nova-compute[74850]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 (non-flash)
Nov 14 01:13:21 user nova-compute[74850]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca (non-flash)
Nov 14 01:13:21 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77 -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a4128d-228f-4871-bdfe-34047eb0d7c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77, portal: 172.16.0.220,3260]
Nov 14 01:13:21 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77, portal: 172.16.0.220,3260] successful.
Nov 14 01:13:21 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe224f6-8287-42e0-b093-06a98eb093fb]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[03853d24-a881-4ae1-993a-758d4f5d5d67]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:13:21 user nova-compute[74850]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 (non-flash)
Nov 14 01:13:21 user nova-compute[74850]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca (non-flash)
Nov 14 01:13:21 user nova-compute[74850]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77 (non-flash)
Nov 14 01:13:21 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:13:21 user nova-compute[74850]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 (non-flash)
Nov 14 01:13:21 user nova-compute[74850]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca (non-flash)
Nov 14 01:13:21 user nova-compute[74850]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77 (non-flash)
Nov 14 01:13:21 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] HCTL ('36', '-', '-', 0) found on session 55 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e85c59d-94be-473e-9763-515f87e2418b]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Searching for a device in session 55 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:13:21 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HcgpAbUx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 01:13:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:13:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] <== connect_volume: return (1405ms) {'type': 'block', 'scsi_wwn': '26230363739646461', 'path': '/dev/sde'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:13:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230363739646461', 'path': '/dev/sde'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 01:13:22 user nova-compute[74850]: DEBUG nova.objects.instance [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lazy-loading 'flavor' on Instance uuid ebed89ae-c110-4bf3-94e2-af76b19c2a52 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:13:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 01:13:22 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:13:22 user nova-compute[74850]:   <source dev="/dev/sde"/>
Nov 14 01:13:22 user nova-compute[74850]:   <target dev="vdc" bus="virtio"/>
Nov 14 01:13:22 user nova-compute[74850]:   <serial>32d3329a-38b2-4536-b46f-b9240911fe77</serial>
Nov 14 01:13:22 user nova-compute[74850]: </disk>
Nov 14 01:13:22 user nova-compute[74850]:  {{(pid=74850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 01:13:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:13:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:13:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:13:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] No VIF found with MAC fa:16:3e:b9:08:c7, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:13:23 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-9ec5e400-205c-479b-81e1-d3257a411038 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.544s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:13:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b806e6be-fe0b-4ff2-8926-63724b986002 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Acquiring lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:13:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b806e6be-fe0b-4ff2-8926-63724b986002 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:13:24 user nova-compute[74850]: INFO nova.compute.manager [None req-b806e6be-fe0b-4ff2-8926-63724b986002 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Detaching volume 32d3329a-38b2-4536-b46f-b9240911fe77
Nov 14 01:13:24 user nova-compute[74850]: INFO nova.virt.block_device [None req-b806e6be-fe0b-4ff2-8926-63724b986002 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Attempting to driver detach volume 32d3329a-38b2-4536-b46f-b9240911fe77 from mountpoint /dev/vdc
Nov 14 01:13:24 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b806e6be-fe0b-4ff2-8926-63724b986002 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Attempting to detach device vdc from instance ebed89ae-c110-4bf3-94e2-af76b19c2a52 from the persistent domain config. {{(pid=74850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 01:13:24 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-b806e6be-fe0b-4ff2-8926-63724b986002 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:13:24 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:13:24 user nova-compute[74850]:   <source dev="/dev/sde"/>
Nov 14 01:13:24 user nova-compute[74850]:   <target dev="vdc" bus="virtio"/>
Nov 14 01:13:24 user nova-compute[74850]:   <serial>32d3329a-38b2-4536-b46f-b9240911fe77</serial>
Nov 14 01:13:24 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 01:13:24 user nova-compute[74850]: </disk>
Nov 14 01:13:24 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:13:24 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-b806e6be-fe0b-4ff2-8926-63724b986002 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Successfully detached device vdc from instance ebed89ae-c110-4bf3-94e2-af76b19c2a52 from the persistent domain config.
Nov 14 01:13:24 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b806e6be-fe0b-4ff2-8926-63724b986002 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance ebed89ae-c110-4bf3-94e2-af76b19c2a52 from the live domain config. {{(pid=74850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 01:13:24 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-b806e6be-fe0b-4ff2-8926-63724b986002 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:13:24 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:13:24 user nova-compute[74850]:   <source dev="/dev/sde"/>
Nov 14 01:13:24 user nova-compute[74850]:   <target dev="vdc" bus="virtio"/>
Nov 14 01:13:24 user nova-compute[74850]:   <serial>32d3329a-38b2-4536-b46f-b9240911fe77</serial>
Nov 14 01:13:24 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 01:13:24 user nova-compute[74850]: </disk>
Nov 14 01:13:24 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:13:24 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-b806e6be-fe0b-4ff2-8926-63724b986002 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance ebed89ae-c110-4bf3-94e2-af76b19c2a52 {{(pid=74850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 01:13:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:13:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:13:30 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:13:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:13:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:13:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:13:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:13:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:13:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:13:44 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-b806e6be-fe0b-4ff2-8926-63724b986002 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance ebed89ae-c110-4bf3-94e2-af76b19c2a52 is timed out.
Nov 14 01:13:44 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-b806e6be-fe0b-4ff2-8926-63724b986002 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Successfully detached device vdc from instance ebed89ae-c110-4bf3-94e2-af76b19c2a52 from the live domain config.
Nov 14 01:13:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b806e6be-fe0b-4ff2-8926-63724b986002 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 01:13:44 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b806e6be-fe0b-4ff2-8926-63724b986002 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HcgpAbUx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:13:44 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-b806e6be-fe0b-4ff2-8926-63724b986002 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:13:44 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-b806e6be-fe0b-4ff2-8926-63724b986002 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:13:44 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-b806e6be-fe0b-4ff2-8926-63724b986002 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:13:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:44 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[081cabd1-445b-4ae1-a067-0b1ab59d62e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:44 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b806e6be-fe0b-4ff2-8926-63724b986002 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 01:13:44 user nova-compute[74850]: No targets found.
Nov 14 01:13:44 user nova-compute[74850]: iSNS:
Nov 14 01:13:44 user nova-compute[74850]: No targets found.
Nov 14 01:13:44 user nova-compute[74850]: STATIC:
Nov 14 01:13:44 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca
Nov 14 01:13:44 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:13:44 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:13:44 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77
Nov 14 01:13:44 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:13:44 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:13:44 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755
Nov 14 01:13:44 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:13:44 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:13:44 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8
Nov 14 01:13:44 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:13:44 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:13:44 user nova-compute[74850]: FIRMWARE:
Nov 14 01:13:44 user nova-compute[74850]: No targets found.
Nov 14 01:13:44 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:13:44 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b806e6be-fe0b-4ff2-8926-63724b986002 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 01:13:44 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 01:13:44 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 01:13:44 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b806e6be-fe0b-4ff2-8926-63724b986002 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 01:13:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:44 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b4fa62-db0e-4a25-abac-fbd8a0f3e322]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:44 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd6f1fc-ac47-40e7-962d-a73ae3d2e0e7]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:44 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b806e6be-fe0b-4ff2-8926-63724b986002 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:13:44 user nova-compute[74850]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 (non-flash)
Nov 14 01:13:44 user nova-compute[74850]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca (non-flash)
Nov 14 01:13:44 user nova-compute[74850]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77 (non-flash)
Nov 14 01:13:44 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:13:44 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b806e6be-fe0b-4ff2-8926-63724b986002 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:13:44 user nova-compute[74850]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 (non-flash)
Nov 14 01:13:44 user nova-compute[74850]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca (non-flash)
Nov 14 01:13:44 user nova-compute[74850]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77 (non-flash)
Nov 14 01:13:44 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:13:44 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b806e6be-fe0b-4ff2-8926-63724b986002 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a3c336ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77'): ({'sde'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 01:13:44 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-b806e6be-fe0b-4ff2-8926-63724b986002 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Removing single pathed devices sde {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 01:13:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f172fe3-745a-4be7-b967-14ca7a52dcc0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd78691-9126-4456-b3d7-4904409df1e7]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:45 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-b806e6be-fe0b-4ff2-8926-63724b986002 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Flushing IO for device /dev/sde {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 01:13:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fc7fb7-c1af-4b83-860c-3f2cf2a56705]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:45 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-b806e6be-fe0b-4ff2-8926-63724b986002 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 01:13:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[511f7549-7948-4309-ab41-b0f80cb0f3b4]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:45 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-b806e6be-fe0b-4ff2-8926-63724b986002 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 01:13:45 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-b806e6be-fe0b-4ff2-8926-63724b986002 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] SCSI volumes sde have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 01:13:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b806e6be-fe0b-4ff2-8926-63724b986002 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 01:13:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[705f7f25-d845-41a6-845e-8ced3d55031c]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b806e6be-fe0b-4ff2-8926-63724b986002 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:13:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77 -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f91829-a252-4d62-8c0c-13413449a90e]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b806e6be-fe0b-4ff2-8926-63724b986002 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77, portal: 172.16.0.220,3260]
Nov 14 01:13:45 user nova-compute[74850]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77, portal: 172.16.0.220,3260] successful.
Nov 14 01:13:45 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:13:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77 -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:13:45 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32d3329a-38b2-4536-b46f-b9240911fe77 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:13:45 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbef44f-edd6-4499-bad3-00e7ea6a192d]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:13:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b806e6be-fe0b-4ff2-8926-63724b986002 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:13:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-b806e6be-fe0b-4ff2-8926-63724b986002 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:13:45 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b806e6be-fe0b-4ff2-8926-63724b986002 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] <== disconnect_volume: return (298ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:13:45 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b806e6be-fe0b-4ff2-8926-63724b986002 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 01:13:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:13:45 user nova-compute[74850]: DEBUG nova.objects.instance [None req-b806e6be-fe0b-4ff2-8926-63724b986002 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lazy-loading 'flavor' on Instance uuid ebed89ae-c110-4bf3-94e2-af76b19c2a52 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:13:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-b806e6be-fe0b-4ff2-8926-63724b986002 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.583s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:13:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:13:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:14:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:14:01 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:14:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:14:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:14:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:14:01 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 01:14:02 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:14:02 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:14:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebed89ae-c110-4bf3-94e2-af76b19c2a52/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebed89ae-c110-4bf3-94e2-af76b19c2a52/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebed89ae-c110-4bf3-94e2-af76b19c2a52/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebed89ae-c110-4bf3-94e2-af76b19c2a52/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:02 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:14:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:02 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c18a949-25d9-4db9-bac5-b0b75d9a5751/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c18a949-25d9-4db9-bac5-b0b75d9a5751/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c18a949-25d9-4db9-bac5-b0b75d9a5751/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:03 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c18a949-25d9-4db9-bac5-b0b75d9a5751/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:14:03 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:14:03 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:14:03 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=8302MB free_disk=24.957576751708984GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 01:14:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:14:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:14:03 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 6ac6355d-eb05-4d1a-94c5-8ca630e926f4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:14:03 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance ebed89ae-c110-4bf3-94e2-af76b19c2a52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:14:03 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 2c18a949-25d9-4db9-bac5-b0b75d9a5751 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:14:03 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 5416dd03-4161-4411-a74b-8d6a6e2e9f54 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:14:03 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance e9b11ad8-52e3-4fd7-9300-80ce830964ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:14:03 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 01:14:03 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 01:14:04 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:14:04 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:14:04 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 01:14:04 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.374s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:14:05 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:14:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:14:05 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:14:10 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:14:11 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:14:11 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:14:12 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:14:12 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:14:12 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 01:14:13 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:14:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-0bcbe97d-c4f5-4f21-892d-d2b4e433eeb6 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Acquiring lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:14:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-0bcbe97d-c4f5-4f21-892d-d2b4e433eeb6 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:14:14 user nova-compute[74850]: INFO nova.compute.manager [None req-0bcbe97d-c4f5-4f21-892d-d2b4e433eeb6 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Detaching volume e31d0be8-ab13-4032-8649-d56cd2b2dcca
Nov 14 01:14:14 user nova-compute[74850]: INFO nova.virt.block_device [None req-0bcbe97d-c4f5-4f21-892d-d2b4e433eeb6 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Attempting to driver detach volume e31d0be8-ab13-4032-8649-d56cd2b2dcca from mountpoint /dev/vdb
Nov 14 01:14:14 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-0bcbe97d-c4f5-4f21-892d-d2b4e433eeb6 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Attempting to detach device vdb from instance ebed89ae-c110-4bf3-94e2-af76b19c2a52 from the persistent domain config. {{(pid=74850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 01:14:14 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-0bcbe97d-c4f5-4f21-892d-d2b4e433eeb6 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:14:14 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:14:14 user nova-compute[74850]:   <source dev="/dev/sdd"/>
Nov 14 01:14:14 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:14:14 user nova-compute[74850]:   <serial>e31d0be8-ab13-4032-8649-d56cd2b2dcca</serial>
Nov 14 01:14:14 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 01:14:14 user nova-compute[74850]: </disk>
Nov 14 01:14:14 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:14:14 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-0bcbe97d-c4f5-4f21-892d-d2b4e433eeb6 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Successfully detached device vdb from instance ebed89ae-c110-4bf3-94e2-af76b19c2a52 from the persistent domain config.
Nov 14 01:14:14 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-0bcbe97d-c4f5-4f21-892d-d2b4e433eeb6 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ebed89ae-c110-4bf3-94e2-af76b19c2a52 from the live domain config. {{(pid=74850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 01:14:14 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-0bcbe97d-c4f5-4f21-892d-d2b4e433eeb6 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:14:14 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:14:14 user nova-compute[74850]:   <source dev="/dev/sdd"/>
Nov 14 01:14:14 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:14:14 user nova-compute[74850]:   <serial>e31d0be8-ab13-4032-8649-d56cd2b2dcca</serial>
Nov 14 01:14:14 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 01:14:14 user nova-compute[74850]: </disk>
Nov 14 01:14:14 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:14:15 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-0bcbe97d-c4f5-4f21-892d-d2b4e433eeb6 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ebed89ae-c110-4bf3-94e2-af76b19c2a52 {{(pid=74850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 01:14:15 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:14:15 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:14:15 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 01:14:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "refresh_cache-ebed89ae-c110-4bf3-94e2-af76b19c2a52" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:14:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquired lock "refresh_cache-ebed89ae-c110-4bf3-94e2-af76b19c2a52" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:14:16 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Forcefully refreshing network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 01:14:16 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Updating instance_info_cache with network_info: [{"id": "73c210c0-59f3-4551-be32-77168edd3996", "address": "fa:16:3e:b9:08:c7", "network": {"id": "9ddeb146-c3d9-4d05-b46c-7fab63c8dfc2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1027315340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6c2226993ed451286826a667f802a76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c210c0-59", "ovs_interfaceid": "73c210c0-59f3-4551-be32-77168edd3996", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:14:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Releasing lock "refresh_cache-ebed89ae-c110-4bf3-94e2-af76b19c2a52" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:14:16 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Updated the network info_cache for instance {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 01:14:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:14:22 user nova-compute[74850]: DEBUG nova.compute.manager [req-59dc1716-fd4a-4f25-b690-94f6af3b2a20 req-af3192ae-2cb6-4c62-82ed-5f4350eb3f5f service nova] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Received event network-changed-a4ec3961-14e9-4085-8eca-c16a32d436f0 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:14:22 user nova-compute[74850]: DEBUG nova.compute.manager [req-59dc1716-fd4a-4f25-b690-94f6af3b2a20 req-af3192ae-2cb6-4c62-82ed-5f4350eb3f5f service nova] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Refreshing instance network info cache due to event network-changed-a4ec3961-14e9-4085-8eca-c16a32d436f0. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:14:22 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-59dc1716-fd4a-4f25-b690-94f6af3b2a20 req-af3192ae-2cb6-4c62-82ed-5f4350eb3f5f service nova] Acquiring lock "refresh_cache-2c18a949-25d9-4db9-bac5-b0b75d9a5751" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:14:22 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-59dc1716-fd4a-4f25-b690-94f6af3b2a20 req-af3192ae-2cb6-4c62-82ed-5f4350eb3f5f service nova] Acquired lock "refresh_cache-2c18a949-25d9-4db9-bac5-b0b75d9a5751" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:14:22 user nova-compute[74850]: DEBUG nova.network.neutron [req-59dc1716-fd4a-4f25-b690-94f6af3b2a20 req-af3192ae-2cb6-4c62-82ed-5f4350eb3f5f service nova] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Refreshing network info cache for port a4ec3961-14e9-4085-8eca-c16a32d436f0 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:14:22 user nova-compute[74850]: DEBUG nova.network.neutron [req-59dc1716-fd4a-4f25-b690-94f6af3b2a20 req-af3192ae-2cb6-4c62-82ed-5f4350eb3f5f service nova] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Updated VIF entry in instance network info cache for port a4ec3961-14e9-4085-8eca-c16a32d436f0. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:14:22 user nova-compute[74850]: DEBUG nova.network.neutron [req-59dc1716-fd4a-4f25-b690-94f6af3b2a20 req-af3192ae-2cb6-4c62-82ed-5f4350eb3f5f service nova] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Updating instance_info_cache with network_info: [{"id": "a4ec3961-14e9-4085-8eca-c16a32d436f0", "address": "fa:16:3e:92:61:d5", "network": {"id": "40ed88df-3a5a-4029-a9b5-4c73221823fa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1084755377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b811df14b33a498db8a1a7eb95c5bb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ec3961-14", "ovs_interfaceid": "a4ec3961-14e9-4085-8eca-c16a32d436f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:14:22 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-59dc1716-fd4a-4f25-b690-94f6af3b2a20 req-af3192ae-2cb6-4c62-82ed-5f4350eb3f5f service nova] Releasing lock "refresh_cache-2c18a949-25d9-4db9-bac5-b0b75d9a5751" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:14:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Acquiring lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:14:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:14:24 user nova-compute[74850]: DEBUG nova.objects.instance [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lazy-loading 'flavor' on Instance uuid 2c18a949-25d9-4db9-bac5-b0b75d9a5751 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:14:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:14:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Acquiring lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:14:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:14:24 user nova-compute[74850]: INFO nova.compute.manager [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Attaching volume 315819e8-313f-444b-bd39-01d373a4a919 to /dev/vdb
Nov 14 01:14:24 user nova-compute[74850]: DEBUG os_brick.utils [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:14:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:24 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fca350a-2a72-4fcc-841e-cc086acae9cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:24 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[85659503-5cd8-4f92-b829-10aa3b8469dd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:24 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1569247-c3f2-416b-964a-5ff46928fdc5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:24 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ce55f0-3714-44ad-bee1-2e00c7307b2c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:14:24 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 01:14:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:24 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:14:24 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 01:14:24 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6664d198-4b4b-40e7-af8b-3b95c48e7d0e]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:24 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 01:14:24 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 01:14:24 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 01:14:24 user nova-compute[74850]: DEBUG os_brick.utils [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:14:24 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Updating existing volume attachment record: 6f54b97b-ff66-44cd-874c-4fe702aa9521 {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 01:14:25 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:14:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BCEYlnQU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:14:29 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:14:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:14:29 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:14:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:14:29 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 01:14:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fd2dc5-571c-437e-84da-81306e28ee09]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 01:14:29 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d910e3d9-bfb9-48cd-b5be-f6fa01516f22]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919] added
Nov 14 01:14:29 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f868aff-f47b-4392-87ef-de68cb2748ac]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a796e8-5b15-4587-a3a6-06ec127fb60c]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BCEYlnQU {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BCEYlnQU" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6041ff1-1b85-4f74-a5ed-01031fd08556]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BCEYlnQU'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35bdb01-9a5f-464c-b8fa-3bfe7cf83c71]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d9f00f-cb08-4d2c-96e3-a2c9be446f95]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:14:29 user nova-compute[74850]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 (non-flash)
Nov 14 01:14:29 user nova-compute[74850]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca (non-flash)
Nov 14 01:14:29 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:14:29 user nova-compute[74850]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 (non-flash)
Nov 14 01:14:29 user nova-compute[74850]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca (non-flash)
Nov 14 01:14:29 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[828dc8d1-4622-4b4e-9a73-e9195e33f29f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919, portal: 172.16.0.220,3260]
Nov 14 01:14:29 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919, portal: 172.16.0.220,3260] successful.
Nov 14 01:14:29 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fccc32-7214-467f-9ea7-29b004bef63e]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c6bf6f-98a7-4143-ad13-4fe956ce0260]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:14:29 user nova-compute[74850]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 (non-flash)
Nov 14 01:14:29 user nova-compute[74850]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca (non-flash)
Nov 14 01:14:29 user nova-compute[74850]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 (non-flash)
Nov 14 01:14:29 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:14:29 user nova-compute[74850]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 (non-flash)
Nov 14 01:14:29 user nova-compute[74850]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca (non-flash)
Nov 14 01:14:29 user nova-compute[74850]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 (non-flash)
Nov 14 01:14:29 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] HCTL ('36', '-', '-', 0) found on session 56 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b43bb9b-41ff-425c-8db6-e8251f7ca747]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Searching for a device in session 56 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:14:29 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BCEYlnQU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 01:14:30 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:14:30 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23638336239643036', 'path': '/dev/sde'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:14:30 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638336239643036', 'path': '/dev/sde'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 01:14:30 user nova-compute[74850]: DEBUG nova.objects.instance [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lazy-loading 'flavor' on Instance uuid 2c18a949-25d9-4db9-bac5-b0b75d9a5751 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:14:30 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 01:14:30 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:14:30 user nova-compute[74850]:   <source dev="/dev/sde"/>
Nov 14 01:14:30 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:14:30 user nova-compute[74850]:   <serial>315819e8-313f-444b-bd39-01d373a4a919</serial>
Nov 14 01:14:30 user nova-compute[74850]: </disk>
Nov 14 01:14:30 user nova-compute[74850]:  {{(pid=74850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 01:14:30 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:14:30 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:14:30 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:14:30 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] No VIF found with MAC fa:16:3e:92:61:d5, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:14:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-85eda7ce-2630-4dfa-b6e7-b4ffdab9a832 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.226s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:14:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:14:35 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-0bcbe97d-c4f5-4f21-892d-d2b4e433eeb6 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ebed89ae-c110-4bf3-94e2-af76b19c2a52 is timed out.
Nov 14 01:14:35 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-0bcbe97d-c4f5-4f21-892d-d2b4e433eeb6 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Successfully detached device vdb from instance ebed89ae-c110-4bf3-94e2-af76b19c2a52 from the live domain config.
Nov 14 01:14:35 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bcbe97d-c4f5-4f21-892d-d2b4e433eeb6 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bcbe97d-c4f5-4f21-892d-d2b4e433eeb6 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UFwRkTMs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:14:35 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-0bcbe97d-c4f5-4f21-892d-d2b4e433eeb6 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:14:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-0bcbe97d-c4f5-4f21-892d-d2b4e433eeb6 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-0bcbe97d-c4f5-4f21-892d-d2b4e433eeb6 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d02d755-99a4-4276-9c55-ed214bdaa29d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bcbe97d-c4f5-4f21-892d-d2b4e433eeb6 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 01:14:35 user nova-compute[74850]: No targets found.
Nov 14 01:14:35 user nova-compute[74850]: iSNS:
Nov 14 01:14:35 user nova-compute[74850]: No targets found.
Nov 14 01:14:35 user nova-compute[74850]: STATIC:
Nov 14 01:14:35 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca
Nov 14 01:14:35 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:14:35 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:14:35 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919
Nov 14 01:14:35 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:14:35 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:14:35 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755
Nov 14 01:14:35 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:14:35 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:14:35 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8
Nov 14 01:14:35 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:14:35 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:14:35 user nova-compute[74850]: FIRMWARE:
Nov 14 01:14:35 user nova-compute[74850]: No targets found.
Nov 14 01:14:35 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bcbe97d-c4f5-4f21-892d-d2b4e433eeb6 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 01:14:35 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 01:14:35 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bcbe97d-c4f5-4f21-892d-d2b4e433eeb6 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07b028c-0d12-4697-8621-b35d2cbdecc4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb6a70b-7655-49cc-b210-014d293f50b0]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bcbe97d-c4f5-4f21-892d-d2b4e433eeb6 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:14:35 user nova-compute[74850]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 (non-flash)
Nov 14 01:14:35 user nova-compute[74850]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca (non-flash)
Nov 14 01:14:35 user nova-compute[74850]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 (non-flash)
Nov 14 01:14:35 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bcbe97d-c4f5-4f21-892d-d2b4e433eeb6 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:14:35 user nova-compute[74850]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 (non-flash)
Nov 14 01:14:35 user nova-compute[74850]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca (non-flash)
Nov 14 01:14:35 user nova-compute[74850]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 (non-flash)
Nov 14 01:14:35 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bcbe97d-c4f5-4f21-892d-d2b4e433eeb6 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a3c38b250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca'): ({'sdd'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-0bcbe97d-c4f5-4f21-892d-d2b4e433eeb6 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Removing single pathed devices sdd {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac015d39-79ea-492a-aacd-4b6afbfde618]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17ace7a-9319-42c3-b6ae-3e48f35f613d]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-0bcbe97d-c4f5-4f21-892d-d2b4e433eeb6 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Flushing IO for device /dev/sdd {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4f6662-84bf-4bca-8113-ec578d061520]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-0bcbe97d-c4f5-4f21-892d-d2b4e433eeb6 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb58044-d812-42a8-8fc1-a8f953051884]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-0bcbe97d-c4f5-4f21-892d-d2b4e433eeb6 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-0bcbe97d-c4f5-4f21-892d-d2b4e433eeb6 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] SCSI volumes sdd have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bcbe97d-c4f5-4f21-892d-d2b4e433eeb6 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef45bec-deda-42b0-8548-3b6235686598]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bcbe97d-c4f5-4f21-892d-d2b4e433eeb6 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[342c1916-18ed-4029-a920-0a862419bf9c]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bcbe97d-c4f5-4f21-892d-d2b4e433eeb6 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca, portal: 172.16.0.220,3260]
Nov 14 01:14:35 user nova-compute[74850]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca, portal: 172.16.0.220,3260] successful.
Nov 14 01:14:35 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31d0be8-ab13-4032-8649-d56cd2b2dcca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c615002-944c-4433-85d3-20b6fb725d44]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bcbe97d-c4f5-4f21-892d-d2b4e433eeb6 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-0bcbe97d-c4f5-4f21-892d-d2b4e433eeb6 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bcbe97d-c4f5-4f21-892d-d2b4e433eeb6 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] <== disconnect_volume: return (313ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bcbe97d-c4f5-4f21-892d-d2b4e433eeb6 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 01:14:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:14:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:14:36 user nova-compute[74850]: DEBUG nova.objects.instance [None req-0bcbe97d-c4f5-4f21-892d-d2b4e433eeb6 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lazy-loading 'flavor' on Instance uuid ebed89ae-c110-4bf3-94e2-af76b19c2a52 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:14:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-0bcbe97d-c4f5-4f21-892d-d2b4e433eeb6 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.615s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:14:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5c53cda7-36ee-4d04-8e9a-ddd34ef44662 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Acquiring lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:14:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5c53cda7-36ee-4d04-8e9a-ddd34ef44662 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:14:38 user nova-compute[74850]: INFO nova.compute.manager [None req-5c53cda7-36ee-4d04-8e9a-ddd34ef44662 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Detaching volume 315819e8-313f-444b-bd39-01d373a4a919
Nov 14 01:14:38 user nova-compute[74850]: INFO nova.virt.block_device [None req-5c53cda7-36ee-4d04-8e9a-ddd34ef44662 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Attempting to driver detach volume 315819e8-313f-444b-bd39-01d373a4a919 from mountpoint /dev/vdb
Nov 14 01:14:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5c53cda7-36ee-4d04-8e9a-ddd34ef44662 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Attempting to detach device vdb from instance 2c18a949-25d9-4db9-bac5-b0b75d9a5751 from the persistent domain config. {{(pid=74850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 01:14:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-5c53cda7-36ee-4d04-8e9a-ddd34ef44662 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:14:38 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:14:38 user nova-compute[74850]:   <source dev="/dev/sde"/>
Nov 14 01:14:38 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:14:38 user nova-compute[74850]:   <serial>315819e8-313f-444b-bd39-01d373a4a919</serial>
Nov 14 01:14:38 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 01:14:38 user nova-compute[74850]: </disk>
Nov 14 01:14:38 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:14:38 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-5c53cda7-36ee-4d04-8e9a-ddd34ef44662 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Successfully detached device vdb from instance 2c18a949-25d9-4db9-bac5-b0b75d9a5751 from the persistent domain config.
Nov 14 01:14:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5c53cda7-36ee-4d04-8e9a-ddd34ef44662 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2c18a949-25d9-4db9-bac5-b0b75d9a5751 from the live domain config. {{(pid=74850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 01:14:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-5c53cda7-36ee-4d04-8e9a-ddd34ef44662 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:14:38 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:14:38 user nova-compute[74850]:   <source dev="/dev/sde"/>
Nov 14 01:14:38 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:14:38 user nova-compute[74850]:   <serial>315819e8-313f-444b-bd39-01d373a4a919</serial>
Nov 14 01:14:38 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 01:14:38 user nova-compute[74850]: </disk>
Nov 14 01:14:38 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:14:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5c53cda7-36ee-4d04-8e9a-ddd34ef44662 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2c18a949-25d9-4db9-bac5-b0b75d9a5751 {{(pid=74850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 01:14:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:14:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:14:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:14:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquiring lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:14:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:14:48 user nova-compute[74850]: DEBUG nova.objects.instance [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lazy-loading 'flavor' on Instance uuid 5416dd03-4161-4411-a74b-8d6a6e2e9f54 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:14:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:14:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquiring lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:14:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:14:48 user nova-compute[74850]: INFO nova.compute.manager [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Attaching volume eb6eb571-042a-4079-a0ee-31fff297435e to /dev/vdb
Nov 14 01:14:48 user nova-compute[74850]: DEBUG os_brick.utils [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:14:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0c0773-724f-4452-9c3e-426a086f98cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[decf3306-01f7-43a1-a93a-c666ac403346]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a217239-42d0-48b0-b2d3-e5fff2fc09eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1266833f-1d29-4e2c-ac6f-6b786b09db71]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:14:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 01:14:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:14:48 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 01:14:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[300b9bf9-b23c-48d6-9e26-9f2a12f826ef]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 01:14:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 01:14:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 01:14:48 user nova-compute[74850]: DEBUG os_brick.utils [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:14:48 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Updating existing volume attachment record: 974cdbc9-bddb-4847-939e-c1a3f90e0278 {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 01:14:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:14:50 user nova-compute[74850]: DEBUG nova.compute.manager [req-a4183e65-dc87-4480-8ee8-46e1bc03517e req-d37b4b78-09b1-4dda-93fe-78680d516007 service nova] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Received event network-changed-0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:14:50 user nova-compute[74850]: DEBUG nova.compute.manager [req-a4183e65-dc87-4480-8ee8-46e1bc03517e req-d37b4b78-09b1-4dda-93fe-78680d516007 service nova] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Refreshing instance network info cache due to event network-changed-0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:14:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a4183e65-dc87-4480-8ee8-46e1bc03517e req-d37b4b78-09b1-4dda-93fe-78680d516007 service nova] Acquiring lock "refresh_cache-e9b11ad8-52e3-4fd7-9300-80ce830964ec" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:14:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a4183e65-dc87-4480-8ee8-46e1bc03517e req-d37b4b78-09b1-4dda-93fe-78680d516007 service nova] Acquired lock "refresh_cache-e9b11ad8-52e3-4fd7-9300-80ce830964ec" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:14:50 user nova-compute[74850]: DEBUG nova.network.neutron [req-a4183e65-dc87-4480-8ee8-46e1bc03517e req-d37b4b78-09b1-4dda-93fe-78680d516007 service nova] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Refreshing network info cache for port 0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:14:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:14:51 user nova-compute[74850]: DEBUG nova.network.neutron [req-a4183e65-dc87-4480-8ee8-46e1bc03517e req-d37b4b78-09b1-4dda-93fe-78680d516007 service nova] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Updated VIF entry in instance network info cache for port 0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:14:51 user nova-compute[74850]: DEBUG nova.network.neutron [req-a4183e65-dc87-4480-8ee8-46e1bc03517e req-d37b4b78-09b1-4dda-93fe-78680d516007 service nova] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Updating instance_info_cache with network_info: [{"id": "0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b", "address": "fa:16:3e:d3:f2:a5", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f3488f7-dd", "ovs_interfaceid": "0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:14:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a4183e65-dc87-4480-8ee8-46e1bc03517e req-d37b4b78-09b1-4dda-93fe-78680d516007 service nova] Releasing lock "refresh_cache-e9b11ad8-52e3-4fd7-9300-80ce830964ec" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:14:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:14:51 user nova-compute[74850]: DEBUG nova.compute.manager [req-4b146f93-3aa9-4d31-995c-0baf65bb653c req-2df48fa1-3fde-45af-8dfb-8d3261896263 service nova] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Received event network-changed-0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:14:51 user nova-compute[74850]: DEBUG nova.compute.manager [req-4b146f93-3aa9-4d31-995c-0baf65bb653c req-2df48fa1-3fde-45af-8dfb-8d3261896263 service nova] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Refreshing instance network info cache due to event network-changed-0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:14:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-4b146f93-3aa9-4d31-995c-0baf65bb653c req-2df48fa1-3fde-45af-8dfb-8d3261896263 service nova] Acquiring lock "refresh_cache-e9b11ad8-52e3-4fd7-9300-80ce830964ec" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:14:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-4b146f93-3aa9-4d31-995c-0baf65bb653c req-2df48fa1-3fde-45af-8dfb-8d3261896263 service nova] Acquired lock "refresh_cache-e9b11ad8-52e3-4fd7-9300-80ce830964ec" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:14:51 user nova-compute[74850]: DEBUG nova.network.neutron [req-4b146f93-3aa9-4d31-995c-0baf65bb653c req-2df48fa1-3fde-45af-8dfb-8d3261896263 service nova] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Refreshing network info cache for port 0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:14:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "e9b11ad8-52e3-4fd7-9300-80ce830964ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:14:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "e9b11ad8-52e3-4fd7-9300-80ce830964ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:14:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "e9b11ad8-52e3-4fd7-9300-80ce830964ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:14:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "e9b11ad8-52e3-4fd7-9300-80ce830964ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:14:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "e9b11ad8-52e3-4fd7-9300-80ce830964ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:14:51 user nova-compute[74850]: INFO nova.compute.manager [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Terminating instance
Nov 14 01:14:51 user nova-compute[74850]: DEBUG nova.compute.manager [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 01:14:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:14:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:14:51 user nova-compute[74850]: DEBUG nova.compute.manager [req-a398fe39-9e64-4308-b6a6-10d70dea56fd req-e4c0326f-abe2-47cd-811a-4cb87100fa7b service nova] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Received event network-vif-unplugged-0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:14:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a398fe39-9e64-4308-b6a6-10d70dea56fd req-e4c0326f-abe2-47cd-811a-4cb87100fa7b service nova] Acquiring lock "e9b11ad8-52e3-4fd7-9300-80ce830964ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:14:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a398fe39-9e64-4308-b6a6-10d70dea56fd req-e4c0326f-abe2-47cd-811a-4cb87100fa7b service nova] Lock "e9b11ad8-52e3-4fd7-9300-80ce830964ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:14:51 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a398fe39-9e64-4308-b6a6-10d70dea56fd req-e4c0326f-abe2-47cd-811a-4cb87100fa7b service nova] Lock "e9b11ad8-52e3-4fd7-9300-80ce830964ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:14:51 user nova-compute[74850]: DEBUG nova.compute.manager [req-a398fe39-9e64-4308-b6a6-10d70dea56fd req-e4c0326f-abe2-47cd-811a-4cb87100fa7b service nova] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] No waiting events found dispatching network-vif-unplugged-0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:14:51 user nova-compute[74850]: DEBUG nova.compute.manager [req-a398fe39-9e64-4308-b6a6-10d70dea56fd req-e4c0326f-abe2-47cd-811a-4cb87100fa7b service nova] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Received event network-vif-unplugged-0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 01:14:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:14:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:14:52 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Instance destroyed successfully.
Nov 14 01:14:52 user nova-compute[74850]: DEBUG nova.objects.instance [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lazy-loading 'resources' on Instance uuid e9b11ad8-52e3-4fd7-9300-80ce830964ec {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:12:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-919979771',display_name='tempest-TestVolumeBootPattern-server-919979771',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-919979771',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA94n5zD/7RpobhW+jYq5sAS9UK4izFU1jEjxsSgfhAiBUC2oNIUdSW107BwtkqMZ7Uku+sA2LquAPtuZM0gk2nZsUp6hWLP86Pz4tdmgGXQVoyyrGsrxeP25l2IFQWByQ==',key_name='tempest-TestVolumeBootPattern-543311029',keypairs=<?>,launch_index=0,launched_at=2023-11-14T01:13:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fdb1eb4b5fc841d1952b8db9ae05e446',ramdisk_id='',reservation_id='r-70mlhk5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1536334624',owner_user_name='tempest-TestVolumeBootPattern-1536334624-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T01:13:10Z,user_data=None,user_id='6c91ddcee4e54a769eb626c816596bed',uuid=e9b11ad8-52e3-4fd7-9300-80ce830964ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b", "address": "fa:16:3e:d3:f2:a5", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f3488f7-dd", "ovs_interfaceid": "0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Converting VIF {"id": "0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b", "address": "fa:16:3e:d3:f2:a5", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f3488f7-dd", "ovs_interfaceid": "0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:f2:a5,bridge_name='br-int',has_traffic_filtering=True,id=0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f3488f7-dd') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG os_vif [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:f2:a5,bridge_name='br-int',has_traffic_filtering=True,id=0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f3488f7-dd') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f3488f7-dd, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8d6f7623-565c-4c79-a225-7487c5fc9bc5) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:14:52 user nova-compute[74850]: INFO os_vif [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:f2:a5,bridge_name='br-int',has_traffic_filtering=True,id=0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f3488f7-dd')
Nov 14 01:14:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wRZimIVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:14:52 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:14:52 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG nova.network.neutron [req-4b146f93-3aa9-4d31-995c-0baf65bb653c req-2df48fa1-3fde-45af-8dfb-8d3261896263 service nova] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Updated VIF entry in instance network info cache for port 0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG nova.network.neutron [req-4b146f93-3aa9-4d31-995c-0baf65bb653c req-2df48fa1-3fde-45af-8dfb-8d3261896263 service nova] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Updating instance_info_cache with network_info: [{"id": "0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b", "address": "fa:16:3e:d3:f2:a5", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f3488f7-dd", "ovs_interfaceid": "0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03bc9e9-fa12-4868-ac91-a806df43d76d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 01:14:52 user nova-compute[74850]: No targets found.
Nov 14 01:14:52 user nova-compute[74850]: iSNS:
Nov 14 01:14:52 user nova-compute[74850]: No targets found.
Nov 14 01:14:52 user nova-compute[74850]: STATIC:
Nov 14 01:14:52 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919
Nov 14 01:14:52 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:14:52 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:14:52 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755
Nov 14 01:14:52 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:14:52 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:14:52 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8
Nov 14 01:14:52 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:14:52 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:14:52 user nova-compute[74850]: FIRMWARE:
Nov 14 01:14:52 user nova-compute[74850]: No targets found.
Nov 14 01:14:52 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 01:14:52 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 01:14:52 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-4b146f93-3aa9-4d31-995c-0baf65bb653c req-2df48fa1-3fde-45af-8dfb-8d3261896263 service nova] Releasing lock "refresh_cache-e9b11ad8-52e3-4fd7-9300-80ce830964ec" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3422575-833e-403e-bd1a-14bfeeb07ff2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[da84aebb-ab66-40a2-b2ee-c5f253ff82a7]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:14:52 user nova-compute[74850]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 (non-flash)
Nov 14 01:14:52 user nova-compute[74850]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 (non-flash)
Nov 14 01:14:52 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:14:52 user nova-compute[74850]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 (non-flash)
Nov 14 01:14:52 user nova-compute[74850]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 (non-flash)
Nov 14 01:14:52 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a5c160dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755'): ({'sdb'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Removing single pathed devices sdb {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1717064-a5c9-43dd-9f01-61e488515a92]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c021cc63-36be-4a15-b994-3820b4040762]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Flushing IO for device /dev/sdb {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5b20b3-5be0-4cbf-bd35-fe41f41806c2]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[faaf1df4-158d-4e35-81fc-3872930bc814]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_b9a13745', '/dev/disk/by-id/scsi-1SCST_BIOb9a13745-3ecf4dd8e7a6f849', '/dev/disk/by-id/scsi-23365636634646438') {{(pid=84948) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffc28e2-5572-4720-8abd-4e208253b621]: (4, None) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca08a98-01d5-4b6e-b930-cbec38f641bc]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6499e408-b3d4-47f5-8e5b-bad45275290a]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755, portal: 172.16.0.220,3260]
Nov 14 01:14:52 user nova-compute[74850]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755, portal: 172.16.0.220,3260] successful.
Nov 14 01:14:52 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5f61623-a91d-46a3-9c5c-7b87d34c9755 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d2a082-afcb-4b07-9f9b-e322cedadef7]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] <== disconnect_volume: return (358ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 01:14:52 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Deleting instance files /opt/stack/data/nova/instances/e9b11ad8-52e3-4fd7-9300-80ce830964ec_del
Nov 14 01:14:52 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Deletion of /opt/stack/data/nova/instances/e9b11ad8-52e3-4fd7-9300-80ce830964ec_del complete
Nov 14 01:14:52 user nova-compute[74850]: INFO nova.compute.manager [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 14 01:14:52 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 01:14:52 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:14:53 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Took 0.56 seconds to deallocate network for instance.
Nov 14 01:14:53 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hOUruvdN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:14:53 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:14:53 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:14:53 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:14:53 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:14:53 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 01:14:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cdd823-5cfc-4d97-9bda-b17607648b92]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 01:14:53 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c467f36e-cc12-46f8-aac9-6b82177bb91a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e] added
Nov 14 01:14:53 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cdceb8-094e-406f-8797-01d3ac139499]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6980bea1-af56-4c96-9133-809baa90fffd]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hOUruvdN {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hOUruvdN" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b89d233-696d-421d-a3aa-a445ab0253fd]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hOUruvdN'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[842c806e-1961-46ba-a8d5-143e1cb8e010]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c41c75c-815d-4f28-b7e2-5d40443738b6]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:14:53 user nova-compute[74850]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 (non-flash)
Nov 14 01:14:53 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:14:53 user nova-compute[74850]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 (non-flash)
Nov 14 01:14:53 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc18cafe-c2bf-43d3-9a33-2a8db583a0db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e, portal: 172.16.0.220,3260]
Nov 14 01:14:53 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e, portal: 172.16.0.220,3260] successful.
Nov 14 01:14:53 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b87c395-ea31-4304-a2c4-a035b1fd2c66]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG nova.compute.manager [req-62f14e8c-fd1f-4edc-b751-aedc2b3a754a req-6c13ff2a-9f0b-49d9-a277-8513ba4cded6 service nova] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Received event network-vif-plugged-0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-62f14e8c-fd1f-4edc-b751-aedc2b3a754a req-6c13ff2a-9f0b-49d9-a277-8513ba4cded6 service nova] Acquiring lock "e9b11ad8-52e3-4fd7-9300-80ce830964ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-62f14e8c-fd1f-4edc-b751-aedc2b3a754a req-6c13ff2a-9f0b-49d9-a277-8513ba4cded6 service nova] Lock "e9b11ad8-52e3-4fd7-9300-80ce830964ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-62f14e8c-fd1f-4edc-b751-aedc2b3a754a req-6c13ff2a-9f0b-49d9-a277-8513ba4cded6 service nova] Lock "e9b11ad8-52e3-4fd7-9300-80ce830964ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG nova.compute.manager [req-62f14e8c-fd1f-4edc-b751-aedc2b3a754a req-6c13ff2a-9f0b-49d9-a277-8513ba4cded6 service nova] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] No waiting events found dispatching network-vif-plugged-0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:14:53 user nova-compute[74850]: WARNING nova.compute.manager [req-62f14e8c-fd1f-4edc-b751-aedc2b3a754a req-6c13ff2a-9f0b-49d9-a277-8513ba4cded6 service nova] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Received unexpected event network-vif-plugged-0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b for instance with vm_state active and task_state deleting.
Nov 14 01:14:53 user nova-compute[74850]: DEBUG nova.compute.manager [req-62f14e8c-fd1f-4edc-b751-aedc2b3a754a req-6c13ff2a-9f0b-49d9-a277-8513ba4cded6 service nova] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Received event network-vif-deleted-0f3488f7-dd9a-4c88-a2fc-556c5b7f6a4b {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[74122946-34df-467e-be92-dd16bbeed157]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:14:53 user nova-compute[74850]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 (non-flash)
Nov 14 01:14:53 user nova-compute[74850]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e (non-flash)
Nov 14 01:14:53 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:14:53 user nova-compute[74850]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 (non-flash)
Nov 14 01:14:53 user nova-compute[74850]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e (non-flash)
Nov 14 01:14:53 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[477ff924-382c-4f27-bc94-889e345fd7e4]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:14:53 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hOUruvdN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 01:14:54 user nova-compute[74850]: INFO nova.compute.manager [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: e9b11ad8-52e3-4fd7-9300-80ce830964ec] Took 0.79 seconds to detach 1 volumes for instance.
Nov 14 01:14:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:14:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:14:54 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:14:54 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:14:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.216s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:14:54 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Deleted allocations for instance e9b11ad8-52e3-4fd7-9300-80ce830964ec
Nov 14 01:14:54 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-160acf1c-31eb-4f99-9314-7cc11404fdec tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "e9b11ad8-52e3-4fd7-9300-80ce830964ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.954s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:14:54 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:14:54 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23035623838613436', 'path': '/dev/sdb'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:14:54 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035623838613436', 'path': '/dev/sdb'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 01:14:54 user nova-compute[74850]: DEBUG nova.objects.instance [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lazy-loading 'flavor' on Instance uuid 5416dd03-4161-4411-a74b-8d6a6e2e9f54 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:14:54 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 01:14:54 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:14:54 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 01:14:54 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:14:54 user nova-compute[74850]:   <serial>eb6eb571-042a-4079-a0ee-31fff297435e</serial>
Nov 14 01:14:54 user nova-compute[74850]: </disk>
Nov 14 01:14:54 user nova-compute[74850]:  {{(pid=74850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 01:14:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:14:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:14:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] No VIF found with MAC fa:16:3e:d5:a5:65, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:14:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-184218ce-39af-4b73-9c7e-0c3a4287c2f0 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.271s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:14:56 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:14:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:14:58 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-5c53cda7-36ee-4d04-8e9a-ddd34ef44662 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2c18a949-25d9-4db9-bac5-b0b75d9a5751 is timed out.
Nov 14 01:14:58 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-5c53cda7-36ee-4d04-8e9a-ddd34ef44662 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Successfully detached device vdb from instance 2c18a949-25d9-4db9-bac5-b0b75d9a5751 from the live domain config.
Nov 14 01:14:58 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c53cda7-36ee-4d04-8e9a-ddd34ef44662 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 01:14:58 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c53cda7-36ee-4d04-8e9a-ddd34ef44662 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BCEYlnQU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:14:58 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-5c53cda7-36ee-4d04-8e9a-ddd34ef44662 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:14:58 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-5c53cda7-36ee-4d04-8e9a-ddd34ef44662 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:14:58 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-5c53cda7-36ee-4d04-8e9a-ddd34ef44662 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:14:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:58 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c5e22c-c821-4645-9101-bdd5e519aeba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:58 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c53cda7-36ee-4d04-8e9a-ddd34ef44662 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 01:14:58 user nova-compute[74850]: No targets found.
Nov 14 01:14:58 user nova-compute[74850]: iSNS:
Nov 14 01:14:58 user nova-compute[74850]: No targets found.
Nov 14 01:14:58 user nova-compute[74850]: STATIC:
Nov 14 01:14:58 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919
Nov 14 01:14:58 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:14:58 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:14:58 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8
Nov 14 01:14:58 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:14:58 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:14:58 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e
Nov 14 01:14:58 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:14:58 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:14:58 user nova-compute[74850]: FIRMWARE:
Nov 14 01:14:58 user nova-compute[74850]: No targets found.
Nov 14 01:14:58 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:14:58 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c53cda7-36ee-4d04-8e9a-ddd34ef44662 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 01:14:58 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 01:14:58 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 01:14:58 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c53cda7-36ee-4d04-8e9a-ddd34ef44662 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 01:14:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:58 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce230e76-6372-4f8d-ae9e-15a2c1c23b5b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:58 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdaa4dd6-4286-46e3-814f-16408a1e0583]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:58 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c53cda7-36ee-4d04-8e9a-ddd34ef44662 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:14:58 user nova-compute[74850]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 (non-flash)
Nov 14 01:14:58 user nova-compute[74850]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e (non-flash)
Nov 14 01:14:58 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:14:58 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c53cda7-36ee-4d04-8e9a-ddd34ef44662 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:14:58 user nova-compute[74850]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 (non-flash)
Nov 14 01:14:58 user nova-compute[74850]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e (non-flash)
Nov 14 01:14:58 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:14:58 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c53cda7-36ee-4d04-8e9a-ddd34ef44662 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a5c566cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919'): ({'sde'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 01:14:58 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-5c53cda7-36ee-4d04-8e9a-ddd34ef44662 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Removing single pathed devices sde {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 01:14:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:58 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdcbcea-1187-47c1-ab45-fcbe256f39eb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:58 user nova-compute[74850]: DEBUG nova.compute.manager [req-03d49471-6385-419b-9c5d-7d9f70b44337 req-97d28d1c-133e-4dcc-8724-2d9d8d245fe8 service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Received event network-changed-08667be8-256e-4d3c-b3a1-e65917c9c2c8 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:14:58 user nova-compute[74850]: DEBUG nova.compute.manager [req-03d49471-6385-419b-9c5d-7d9f70b44337 req-97d28d1c-133e-4dcc-8724-2d9d8d245fe8 service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Refreshing instance network info cache due to event network-changed-08667be8-256e-4d3c-b3a1-e65917c9c2c8. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:14:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-03d49471-6385-419b-9c5d-7d9f70b44337 req-97d28d1c-133e-4dcc-8724-2d9d8d245fe8 service nova] Acquiring lock "refresh_cache-5416dd03-4161-4411-a74b-8d6a6e2e9f54" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:14:58 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-03d49471-6385-419b-9c5d-7d9f70b44337 req-97d28d1c-133e-4dcc-8724-2d9d8d245fe8 service nova] Acquired lock "refresh_cache-5416dd03-4161-4411-a74b-8d6a6e2e9f54" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:14:58 user nova-compute[74850]: DEBUG nova.network.neutron [req-03d49471-6385-419b-9c5d-7d9f70b44337 req-97d28d1c-133e-4dcc-8724-2d9d8d245fe8 service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Refreshing network info cache for port 08667be8-256e-4d3c-b3a1-e65917c9c2c8 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:14:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:58 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[550fc34e-a509-4450-848c-3412a5be09fc]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:58 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-5c53cda7-36ee-4d04-8e9a-ddd34ef44662 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Flushing IO for device /dev/sde {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 01:14:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:58 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c60fe9-e356-4b96-a469-0871fcca7527]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:58 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-5c53cda7-36ee-4d04-8e9a-ddd34ef44662 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 01:14:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[777028ed-7b64-4fe7-9ebe-96479940c95e]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:59 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-5c53cda7-36ee-4d04-8e9a-ddd34ef44662 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 01:14:59 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-5c53cda7-36ee-4d04-8e9a-ddd34ef44662 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] SCSI volumes sde have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 01:14:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c53cda7-36ee-4d04-8e9a-ddd34ef44662 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 01:14:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6116e3-c704-4af0-a790-b6e5e61a9be2]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c53cda7-36ee-4d04-8e9a-ddd34ef44662 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:14:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a5fe6c-df7d-4d03-ae98-a02820de0551]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c53cda7-36ee-4d04-8e9a-ddd34ef44662 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919, portal: 172.16.0.220,3260]
Nov 14 01:14:59 user nova-compute[74850]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919, portal: 172.16.0.220,3260] successful.
Nov 14 01:14:59 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:14:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:14:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:315819e8-313f-444b-bd39-01d373a4a919 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:14:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa62567a-cddb-4f0a-9129-7c4600445240]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:14:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c53cda7-36ee-4d04-8e9a-ddd34ef44662 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:14:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-5c53cda7-36ee-4d04-8e9a-ddd34ef44662 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:14:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c53cda7-36ee-4d04-8e9a-ddd34ef44662 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] <== disconnect_volume: return (304ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:14:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c53cda7-36ee-4d04-8e9a-ddd34ef44662 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 01:14:59 user nova-compute[74850]: DEBUG nova.network.neutron [req-03d49471-6385-419b-9c5d-7d9f70b44337 req-97d28d1c-133e-4dcc-8724-2d9d8d245fe8 service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Updated VIF entry in instance network info cache for port 08667be8-256e-4d3c-b3a1-e65917c9c2c8. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:14:59 user nova-compute[74850]: DEBUG nova.network.neutron [req-03d49471-6385-419b-9c5d-7d9f70b44337 req-97d28d1c-133e-4dcc-8724-2d9d8d245fe8 service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Updating instance_info_cache with network_info: [{"id": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "address": "fa:16:3e:d5:a5:65", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08667be8-25", "ovs_interfaceid": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:14:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-03d49471-6385-419b-9c5d-7d9f70b44337 req-97d28d1c-133e-4dcc-8724-2d9d8d245fe8 service nova] Releasing lock "refresh_cache-5416dd03-4161-4411-a74b-8d6a6e2e9f54" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:14:59 user nova-compute[74850]: DEBUG nova.objects.instance [None req-5c53cda7-36ee-4d04-8e9a-ddd34ef44662 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lazy-loading 'flavor' on Instance uuid 2c18a949-25d9-4db9-bac5-b0b75d9a5751 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:14:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5c53cda7-36ee-4d04-8e9a-ddd34ef44662 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.601s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:15:01 user nova-compute[74850]: DEBUG nova.compute.manager [req-f53832ef-9181-4ecc-abf6-65bec3b66e30 req-ee7f95ba-19ed-4843-b820-f89b12fa907a service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Received event network-changed-08667be8-256e-4d3c-b3a1-e65917c9c2c8 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:15:01 user nova-compute[74850]: DEBUG nova.compute.manager [req-f53832ef-9181-4ecc-abf6-65bec3b66e30 req-ee7f95ba-19ed-4843-b820-f89b12fa907a service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Refreshing instance network info cache due to event network-changed-08667be8-256e-4d3c-b3a1-e65917c9c2c8. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:15:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f53832ef-9181-4ecc-abf6-65bec3b66e30 req-ee7f95ba-19ed-4843-b820-f89b12fa907a service nova] Acquiring lock "refresh_cache-5416dd03-4161-4411-a74b-8d6a6e2e9f54" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:15:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f53832ef-9181-4ecc-abf6-65bec3b66e30 req-ee7f95ba-19ed-4843-b820-f89b12fa907a service nova] Acquired lock "refresh_cache-5416dd03-4161-4411-a74b-8d6a6e2e9f54" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:15:01 user nova-compute[74850]: DEBUG nova.network.neutron [req-f53832ef-9181-4ecc-abf6-65bec3b66e30 req-ee7f95ba-19ed-4843-b820-f89b12fa907a service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Refreshing network info cache for port 08667be8-256e-4d3c-b3a1-e65917c9c2c8 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:15:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:01 user nova-compute[74850]: DEBUG nova.network.neutron [req-f53832ef-9181-4ecc-abf6-65bec3b66e30 req-ee7f95ba-19ed-4843-b820-f89b12fa907a service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Updated VIF entry in instance network info cache for port 08667be8-256e-4d3c-b3a1-e65917c9c2c8. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:15:01 user nova-compute[74850]: DEBUG nova.network.neutron [req-f53832ef-9181-4ecc-abf6-65bec3b66e30 req-ee7f95ba-19ed-4843-b820-f89b12fa907a service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Updating instance_info_cache with network_info: [{"id": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "address": "fa:16:3e:d5:a5:65", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08667be8-25", "ovs_interfaceid": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:15:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-f53832ef-9181-4ecc-abf6-65bec3b66e30 req-ee7f95ba-19ed-4843-b820-f89b12fa907a service nova] Releasing lock "refresh_cache-5416dd03-4161-4411-a74b-8d6a6e2e9f54" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:15:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:02 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:15:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquiring lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:15:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:15:03 user nova-compute[74850]: INFO nova.compute.manager [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Rebooting instance
Nov 14 01:15:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquiring lock "refresh_cache-5416dd03-4161-4411-a74b-8d6a6e2e9f54" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:15:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquired lock "refresh_cache-5416dd03-4161-4411-a74b-8d6a6e2e9f54" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:15:03 user nova-compute[74850]: DEBUG nova.network.neutron [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 01:15:03 user nova-compute[74850]: DEBUG nova.network.neutron [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Updating instance_info_cache with network_info: [{"id": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "address": "fa:16:3e:d5:a5:65", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08667be8-25", "ovs_interfaceid": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:15:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Releasing lock "refresh_cache-5416dd03-4161-4411-a74b-8d6a6e2e9f54" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:15:03 user nova-compute[74850]: DEBUG nova.compute.manager [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 01:15:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:03 user nova-compute[74850]: DEBUG nova.compute.manager [req-c9f98cf0-f464-44d8-9c7a-83f839878f9e req-1c3a4eed-f67e-4f69-b412-8169b848dc16 service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Received event network-vif-unplugged-08667be8-256e-4d3c-b3a1-e65917c9c2c8 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:15:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c9f98cf0-f464-44d8-9c7a-83f839878f9e req-1c3a4eed-f67e-4f69-b412-8169b848dc16 service nova] Acquiring lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:15:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c9f98cf0-f464-44d8-9c7a-83f839878f9e req-1c3a4eed-f67e-4f69-b412-8169b848dc16 service nova] Lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:15:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c9f98cf0-f464-44d8-9c7a-83f839878f9e req-1c3a4eed-f67e-4f69-b412-8169b848dc16 service nova] Lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:15:03 user nova-compute[74850]: DEBUG nova.compute.manager [req-c9f98cf0-f464-44d8-9c7a-83f839878f9e req-1c3a4eed-f67e-4f69-b412-8169b848dc16 service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] No waiting events found dispatching network-vif-unplugged-08667be8-256e-4d3c-b3a1-e65917c9c2c8 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:15:03 user nova-compute[74850]: WARNING nova.compute.manager [req-c9f98cf0-f464-44d8-9c7a-83f839878f9e req-1c3a4eed-f67e-4f69-b412-8169b848dc16 service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Received unexpected event network-vif-unplugged-08667be8-256e-4d3c-b3a1-e65917c9c2c8 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 01:15:03 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:15:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:15:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:15:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:15:03 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 01:15:04 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Instance destroyed successfully.
Nov 14 01:15:04 user nova-compute[74850]: DEBUG nova.objects.instance [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lazy-loading 'resources' on Instance uuid 5416dd03-4161-4411-a74b-8d6a6e2e9f54 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1246065015',display_name='tempest-TestMinimumBasicScenario-server-1246065015',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1246065015',id=50,image_ref='8ba8bd50-9091-4da9-9f92-78c3d236b684',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCle3EU/m/g9NKR8n+0V6pqHrWP89VQbKtrtNAoI/KQMQsZllveB7EoYMhQdEgVXwVfsjyPlHxXAhJrn14OjYkLuq3H0x9kXgNYXCap00oAFcwtZTMn2iW22mWyQxNulQA==',key_name='tempest-TestMinimumBasicScenario-1702432917',keypairs=<?>,launch_index=0,launched_at=2023-11-14T01:13:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0ae3f5d3814451c9c7d7264707c8334',ramdisk_id='',reservation_id='r-2c6xm05p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8ba8bd50-9091-4da9-9f92-78c3d236b684',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2056291063',owner_user_name='tempest-TestMinimumBasicScenario-2056291063-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T01:15:04Z,user_data=None,user_id='534b22e8e0c7495f8d2f89dec7e9a66c',uuid=5416dd03-4161-4411-a74b-8d6a6e2e9f54,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "address": "fa:16:3e:d5:a5:65", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08667be8-25", "ovs_interfaceid": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Converting VIF {"id": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "address": "fa:16:3e:d5:a5:65", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08667be8-25", "ovs_interfaceid": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:a5:65,bridge_name='br-int',has_traffic_filtering=True,id=08667be8-256e-4d3c-b3a1-e65917c9c2c8,network=Network(7a6e0781-a6cd-4125-bdaf-9b9d53c4d254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08667be8-25') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG os_vif [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:a5:65,bridge_name='br-int',has_traffic_filtering=True,id=08667be8-256e-4d3c-b3a1-e65917c9c2c8,network=Network(7a6e0781-a6cd-4125-bdaf-9b9d53c4d254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08667be8-25') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08667be8-25, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=84d7c643-d974-4485-9068-50ca2c5f6ad9) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:15:04 user nova-compute[74850]: INFO os_vif [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:a5:65,bridge_name='br-int',has_traffic_filtering=True,id=08667be8-256e-4d3c-b3a1-e65917c9c2c8,network=Network(7a6e0781-a6cd-4125-bdaf-9b9d53c4d254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08667be8-25')
Nov 14 01:15:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hOUruvdN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:15:04 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:15:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c8a0ab-a519-405e-bd58-aae87354faf1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 01:15:04 user nova-compute[74850]: No targets found.
Nov 14 01:15:04 user nova-compute[74850]: iSNS:
Nov 14 01:15:04 user nova-compute[74850]: No targets found.
Nov 14 01:15:04 user nova-compute[74850]: STATIC:
Nov 14 01:15:04 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8
Nov 14 01:15:04 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:15:04 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:15:04 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e
Nov 14 01:15:04 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:15:04 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:15:04 user nova-compute[74850]: FIRMWARE:
Nov 14 01:15:04 user nova-compute[74850]: No targets found.
Nov 14 01:15:04 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 01:15:04 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 01:15:04 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7190b6-87f1-4576-96e1-71adbe601034]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebed89ae-c110-4bf3-94e2-af76b19c2a52/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51755e6-65c0-4009-9489-f8591d57a742]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:15:04 user nova-compute[74850]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e (non-flash)
Nov 14 01:15:04 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:15:04 user nova-compute[74850]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e (non-flash)
Nov 14 01:15:04 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a3c737640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e'): ({'sdb'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Removing single pathed devices sdb {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[480504db-f01c-4292-a2fe-2af7cec00da1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b0ea88-0f11-45e3-88a8-4742401ef13c]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Flushing IO for device /dev/sdb {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[888ed899-95d9-41e2-9ee3-449b866ea2af]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55fe80a-7af8-4fe2-a9ca-84f481163769]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[feece64b-d484-4997-92f0-9c58851ecae4]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebed89ae-c110-4bf3-94e2-af76b19c2a52/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebed89ae-c110-4bf3-94e2-af76b19c2a52/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf58dc1-2621-4b27-ba30-863a3577bd13]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e, portal: 172.16.0.220,3260]
Nov 14 01:15:04 user nova-compute[74850]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e, portal: 172.16.0.220,3260] successful.
Nov 14 01:15:04 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d154d65-3006-4493-8c72-e0542466eb42]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] <== disconnect_volume: return (319ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Start _get_guest_xml network_info=[{"id": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "address": "fa:16:3e:d5:a5:65", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08667be8-25", "ovs_interfaceid": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8ba8bd50-9091-4da9-9f92-78c3d236b684,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '8ba8bd50-9091-4da9-9f92-78c3d236b684'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '974cdbc9-bddb-4847-939e-c1a3f90e0278', 'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hOUruvdN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '5416dd03-4161-4411-a74b-8d6a6e2e9f54', 'attached_at': '', 'detached_at': '', 'volume_id': 'eb6eb571-042a-4079-a0ee-31fff297435e', 'serial': 'eb6eb571-042a-4079-a0ee-31fff297435e'}, 'volume_type': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 01:15:04 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:15:04 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:15:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8ba8bd50-9091-4da9-9f92-78c3d236b684,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG nova.objects.instance [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5416dd03-4161-4411-a74b-8d6a6e2e9f54 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG nova.objects.base [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Object Instance<5416dd03-4161-4411-a74b-8d6a6e2e9f54> lazy-loaded attributes: resources,vcpu_model {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hOUruvdN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:15:04 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:15:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:15:04 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:15:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:15:04 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebed89ae-c110-4bf3-94e2-af76b19c2a52/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:04 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Error from libvirt while getting description of instance-00000032: [Error Code 42] Domain not found: no domain with matching uuid '5416dd03-4161-4411-a74b-8d6a6e2e9f54' (instance-00000032): libvirt.libvirtError: Domain not found: no domain with matching uuid '5416dd03-4161-4411-a74b-8d6a6e2e9f54' (instance-00000032)
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c18a949-25d9-4db9-bac5-b0b75d9a5751/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b860d1d-e4dd-4396-a02a-05993c71d140]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 01:15:04 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8140cfca-b452-4b8a-888e-e581b9e6ee11]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e] added
Nov 14 01:15:04 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:15:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.045s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a499dc-7ed7-4ea5-b85c-05246a736052]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[be696abe-0abb-41c8-80a4-131c4bc099ee]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hOUruvdN {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hOUruvdN" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5800c89-e44e-439f-bb27-96de6aa120b5]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hOUruvdN'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9acde4f9-3e71-466e-809f-21124bdc8646]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[708bf8ef-86cd-46d9-bfbc-de6ebfdcd429]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:15:05 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:15:05 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c18a949-25d9-4db9-bac5-b0b75d9a5751/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c18a949-25d9-4db9-bac5-b0b75d9a5751/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4423964e-03f9-4402-bd2f-610d4dcb3ac4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e, portal: 172.16.0.220,3260]
Nov 14 01:15:05 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e, portal: 172.16.0.220,3260] successful.
Nov 14 01:15:05 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[91602889-7705-4a81-81d3-178d71b6c99a]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb951b6-d89a-4493-ab35-cc6288d85589]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:15:05 user nova-compute[74850]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e (non-flash)
Nov 14 01:15:05 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:15:05 user nova-compute[74850]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e (non-flash)
Nov 14 01:15:05 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b083c1-b0ca-4c50-91d2-52298394147d]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hOUruvdN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-78f8801f-bf88-46ca-ae79-00b2de36aac9 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Acquiring lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-78f8801f-bf88-46ca-ae79-00b2de36aac9 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-78f8801f-bf88-46ca-ae79-00b2de36aac9 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Acquiring lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-78f8801f-bf88-46ca-ae79-00b2de36aac9 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-78f8801f-bf88-46ca-ae79-00b2de36aac9 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:15:05 user nova-compute[74850]: INFO nova.compute.manager [None req-78f8801f-bf88-46ca-ae79-00b2de36aac9 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Terminating instance
Nov 14 01:15:05 user nova-compute[74850]: DEBUG nova.compute.manager [None req-78f8801f-bf88-46ca-ae79-00b2de36aac9 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 01:15:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c18a949-25d9-4db9-bac5-b0b75d9a5751/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.460s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] <== connect_volume: return (1462ms) {'type': 'block', 'scsi_wwn': '23035623838613436', 'path': '/dev/sdb'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035623838613436', 'path': '/dev/sdb'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG nova.compute.manager [req-b73dbf7b-8d4f-464e-89f8-e81c562dd13a req-a19ffbb7-5ee6-4408-a329-03124fbd4eae service nova] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Received event network-vif-unplugged-73c210c0-59f3-4551-be32-77168edd3996 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b73dbf7b-8d4f-464e-89f8-e81c562dd13a req-a19ffbb7-5ee6-4408-a329-03124fbd4eae service nova] Acquiring lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b73dbf7b-8d4f-464e-89f8-e81c562dd13a req-a19ffbb7-5ee6-4408-a329-03124fbd4eae service nova] Lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b73dbf7b-8d4f-464e-89f8-e81c562dd13a req-a19ffbb7-5ee6-4408-a329-03124fbd4eae service nova] Lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG nova.compute.manager [req-b73dbf7b-8d4f-464e-89f8-e81c562dd13a req-a19ffbb7-5ee6-4408-a329-03124fbd4eae service nova] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] No waiting events found dispatching network-vif-unplugged-73c210c0-59f3-4551-be32-77168edd3996 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG nova.compute.manager [req-b73dbf7b-8d4f-464e-89f8-e81c562dd13a req-a19ffbb7-5ee6-4408-a329-03124fbd4eae service nova] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Received event network-vif-unplugged-73c210c0-59f3-4551-be32-77168edd3996 for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG nova.compute.manager [req-0fd4a4fb-cba0-482d-83cc-7954b3fa40ed req-f7d49457-261e-4d53-af3e-c0cc58bc1e8e service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Received event network-vif-plugged-08667be8-256e-4d3c-b3a1-e65917c9c2c8 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-0fd4a4fb-cba0-482d-83cc-7954b3fa40ed req-f7d49457-261e-4d53-af3e-c0cc58bc1e8e service nova] Acquiring lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-0fd4a4fb-cba0-482d-83cc-7954b3fa40ed req-f7d49457-261e-4d53-af3e-c0cc58bc1e8e service nova] Lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-0fd4a4fb-cba0-482d-83cc-7954b3fa40ed req-f7d49457-261e-4d53-af3e-c0cc58bc1e8e service nova] Lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG nova.compute.manager [req-0fd4a4fb-cba0-482d-83cc-7954b3fa40ed req-f7d49457-261e-4d53-af3e-c0cc58bc1e8e service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] No waiting events found dispatching network-vif-plugged-08667be8-256e-4d3c-b3a1-e65917c9c2c8 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:15:06 user nova-compute[74850]: WARNING nova.compute.manager [req-0fd4a4fb-cba0-482d-83cc-7954b3fa40ed req-f7d49457-261e-4d53-af3e-c0cc58bc1e8e service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Received unexpected event network-vif-plugged-08667be8-256e-4d3c-b3a1-e65917c9c2c8 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 01:15:06 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:15:06 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:15:06 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=8666MB free_disk=24.95257568359375GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:15:06 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Instance destroyed successfully.
Nov 14 01:15:06 user nova-compute[74850]: DEBUG nova.objects.instance [None req-78f8801f-bf88-46ca-ae79-00b2de36aac9 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lazy-loading 'resources' on Instance uuid ebed89ae-c110-4bf3-94e2-af76b19c2a52 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-78f8801f-bf88-46ca-ae79-00b2de36aac9 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:11:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-686842452',display_name='tempest-TestServerVolumeAttachmentScenario-server-686842452',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-686842452',id=48,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+ucdFGczkYtx3l5wA4WPIPUKBYvh+6AoM1IQM3aGxHuIaZqBCQ9BhMKH86+hVcdH3fcohZhEQ01mSt4Bpa332vfs5lrBt/MN9RuoVwKL4OgXvOD0FtpIy5fFQ22U6Rjg==',key_name='tempest-keypair-281209694',keypairs=<?>,launch_index=0,launched_at=2023-11-14T01:11:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6c2226993ed451286826a667f802a76',ramdisk_id='',reservation_id='r-h986oxot',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1207940089',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1207940089-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T01:11:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82838be39f3c4e829121d45993ad5531',uuid=ebed89ae-c110-4bf3-94e2-af76b19c2a52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73c210c0-59f3-4551-be32-77168edd3996", "address": "fa:16:3e:b9:08:c7", "network": {"id": "9ddeb146-c3d9-4d05-b46c-7fab63c8dfc2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1027315340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6c2226993ed451286826a667f802a76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c210c0-59", "ovs_interfaceid": "73c210c0-59f3-4551-be32-77168edd3996", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-78f8801f-bf88-46ca-ae79-00b2de36aac9 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Converting VIF {"id": "73c210c0-59f3-4551-be32-77168edd3996", "address": "fa:16:3e:b9:08:c7", "network": {"id": "9ddeb146-c3d9-4d05-b46c-7fab63c8dfc2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1027315340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6c2226993ed451286826a667f802a76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c210c0-59", "ovs_interfaceid": "73c210c0-59f3-4551-be32-77168edd3996", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-78f8801f-bf88-46ca-ae79-00b2de36aac9 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:08:c7,bridge_name='br-int',has_traffic_filtering=True,id=73c210c0-59f3-4551-be32-77168edd3996,network=Network(9ddeb146-c3d9-4d05-b46c-7fab63c8dfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73c210c0-59') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG os_vif [None req-78f8801f-bf88-46ca-ae79-00b2de36aac9 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:08:c7,bridge_name='br-int',has_traffic_filtering=True,id=73c210c0-59f3-4551-be32-77168edd3996,network=Network(9ddeb146-c3d9-4d05-b46c-7fab63c8dfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73c210c0-59') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1246065015',display_name='tempest-TestMinimumBasicScenario-server-1246065015',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1246065015',id=50,image_ref='8ba8bd50-9091-4da9-9f92-78c3d236b684',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCle3EU/m/g9NKR8n+0V6pqHrWP89VQbKtrtNAoI/KQMQsZllveB7EoYMhQdEgVXwVfsjyPlHxXAhJrn14OjYkLuq3H0x9kXgNYXCap00oAFcwtZTMn2iW22mWyQxNulQA==',key_name='tempest-TestMinimumBasicScenario-1702432917',keypairs=<?>,launch_index=0,launched_at=2023-11-14T01:13:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0ae3f5d3814451c9c7d7264707c8334',ramdisk_id='',reservation_id='r-2c6xm05p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8ba8bd50-9091-4da9-9f92-78c3d236b684',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2056291063',owner_user_name='tempest-TestMinimumBasicScenario-2056291063-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T01:15:04Z,user_data=None,user_id='534b22e8e0c7495f8d2f89dec7e9a66c',uuid=5416dd03-4161-4411-a74b-8d6a6e2e9f54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "address": "fa:16:3e:d5:a5:65", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08667be8-25", "ovs_interfaceid": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Converting VIF {"id": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "address": "fa:16:3e:d5:a5:65", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08667be8-25", "ovs_interfaceid": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:a5:65,bridge_name='br-int',has_traffic_filtering=True,id=08667be8-256e-4d3c-b3a1-e65917c9c2c8,network=Network(7a6e0781-a6cd-4125-bdaf-9b9d53c4d254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08667be8-25') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG nova.objects.instance [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lazy-loading 'pci_devices' on Instance uuid 5416dd03-4161-4411-a74b-8d6a6e2e9f54 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73c210c0-59, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2bd93e82-637b-46e1-b02e-988283ac68bc) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG nova.objects.base [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Object Instance<5416dd03-4161-4411-a74b-8d6a6e2e9f54> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] End _get_guest_xml xml=<domain type="kvm">
Nov 14 01:15:06 user nova-compute[74850]:   <uuid>5416dd03-4161-4411-a74b-8d6a6e2e9f54</uuid>
Nov 14 01:15:06 user nova-compute[74850]:   <name>instance-00000032</name>
Nov 14 01:15:06 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 01:15:06 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 01:15:06 user nova-compute[74850]:   <metadata>
Nov 14 01:15:06 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 01:15:06 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 01:15:06 user nova-compute[74850]:       <nova:name>tempest-TestMinimumBasicScenario-server-1246065015</nova:name>
Nov 14 01:15:06 user nova-compute[74850]:       <nova:creationTime>2023-11-14 01:15:04</nova:creationTime>
Nov 14 01:15:06 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 01:15:06 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 01:15:06 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 01:15:06 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 01:15:06 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 01:15:06 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 01:15:06 user nova-compute[74850]:       </nova:flavor>
Nov 14 01:15:06 user nova-compute[74850]:       <nova:owner>
Nov 14 01:15:06 user nova-compute[74850]:         <nova:user uuid="534b22e8e0c7495f8d2f89dec7e9a66c">tempest-TestMinimumBasicScenario-2056291063-project-member</nova:user>
Nov 14 01:15:06 user nova-compute[74850]:         <nova:project uuid="e0ae3f5d3814451c9c7d7264707c8334">tempest-TestMinimumBasicScenario-2056291063</nova:project>
Nov 14 01:15:06 user nova-compute[74850]:       </nova:owner>
Nov 14 01:15:06 user nova-compute[74850]:       <nova:root type="image" uuid="8ba8bd50-9091-4da9-9f92-78c3d236b684"/>
Nov 14 01:15:06 user nova-compute[74850]:       <nova:ports>
Nov 14 01:15:06 user nova-compute[74850]:         <nova:port uuid="08667be8-256e-4d3c-b3a1-e65917c9c2c8">
Nov 14 01:15:06 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 01:15:06 user nova-compute[74850]:         </nova:port>
Nov 14 01:15:06 user nova-compute[74850]:       </nova:ports>
Nov 14 01:15:06 user nova-compute[74850]:     </nova:instance>
Nov 14 01:15:06 user nova-compute[74850]:   </metadata>
Nov 14 01:15:06 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 01:15:06 user nova-compute[74850]:     <system>
Nov 14 01:15:06 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 01:15:06 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 01:15:06 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 01:15:06 user nova-compute[74850]:       <entry name="serial">5416dd03-4161-4411-a74b-8d6a6e2e9f54</entry>
Nov 14 01:15:06 user nova-compute[74850]:       <entry name="uuid">5416dd03-4161-4411-a74b-8d6a6e2e9f54</entry>
Nov 14 01:15:06 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 01:15:06 user nova-compute[74850]:     </system>
Nov 14 01:15:06 user nova-compute[74850]:   </sysinfo>
Nov 14 01:15:06 user nova-compute[74850]:   <os>
Nov 14 01:15:06 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 01:15:06 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 01:15:06 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 01:15:06 user nova-compute[74850]:   </os>
Nov 14 01:15:06 user nova-compute[74850]:   <features>
Nov 14 01:15:06 user nova-compute[74850]:     <acpi/>
Nov 14 01:15:06 user nova-compute[74850]:     <apic/>
Nov 14 01:15:06 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 01:15:06 user nova-compute[74850]:   </features>
Nov 14 01:15:06 user nova-compute[74850]:   <clock offset="utc">
Nov 14 01:15:06 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 01:15:06 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 01:15:06 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 01:15:06 user nova-compute[74850]:   </clock>
Nov 14 01:15:06 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 01:15:06 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 01:15:06 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 01:15:06 user nova-compute[74850]:   </cpu>
Nov 14 01:15:06 user nova-compute[74850]:   <devices>
Nov 14 01:15:06 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 01:15:06 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 01:15:06 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54/disk"/>
Nov 14 01:15:06 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 01:15:06 user nova-compute[74850]:     </disk>
Nov 14 01:15:06 user nova-compute[74850]:     <disk type="block" device="disk">
Nov 14 01:15:06 user nova-compute[74850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:15:06 user nova-compute[74850]:       <source dev="/dev/sdb"/>
Nov 14 01:15:06 user nova-compute[74850]:       <target dev="vdb" bus="virtio"/>
Nov 14 01:15:06 user nova-compute[74850]:       <serial>eb6eb571-042a-4079-a0ee-31fff297435e</serial>
Nov 14 01:15:06 user nova-compute[74850]:     </disk>
Nov 14 01:15:06 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 01:15:06 user nova-compute[74850]:       <mac address="fa:16:3e:d5:a5:65"/>
Nov 14 01:15:06 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:15:06 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 01:15:06 user nova-compute[74850]:       <target dev="tap08667be8-25"/>
Nov 14 01:15:06 user nova-compute[74850]:     </interface>
Nov 14 01:15:06 user nova-compute[74850]:     <serial type="pty">
Nov 14 01:15:06 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54/console.log" append="off"/>
Nov 14 01:15:06 user nova-compute[74850]:     </serial>
Nov 14 01:15:06 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 01:15:06 user nova-compute[74850]:     <video>
Nov 14 01:15:06 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:15:06 user nova-compute[74850]:     </video>
Nov 14 01:15:06 user nova-compute[74850]:     <rng model="virtio">
Nov 14 01:15:06 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 01:15:06 user nova-compute[74850]:     </rng>
Nov 14 01:15:06 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 01:15:06 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 01:15:06 user nova-compute[74850]:       <stats period="10"/>
Nov 14 01:15:06 user nova-compute[74850]:     </memballoon>
Nov 14 01:15:06 user nova-compute[74850]:   </devices>
Nov 14 01:15:06 user nova-compute[74850]: </domain>
Nov 14 01:15:06 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:15:06 user nova-compute[74850]: INFO os_vif [None req-78f8801f-bf88-46ca-ae79-00b2de36aac9 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:08:c7,bridge_name='br-int',has_traffic_filtering=True,id=73c210c0-59f3-4551-be32-77168edd3996,network=Network(9ddeb146-c3d9-4d05-b46c-7fab63c8dfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73c210c0-59')
Nov 14 01:15:06 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-78f8801f-bf88-46ca-ae79-00b2de36aac9 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Deleting instance files /opt/stack/data/nova/instances/ebed89ae-c110-4bf3-94e2-af76b19c2a52_del
Nov 14 01:15:06 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-78f8801f-bf88-46ca-ae79-00b2de36aac9 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Deletion of /opt/stack/data/nova/instances/ebed89ae-c110-4bf3-94e2-af76b19c2a52_del complete
Nov 14 01:15:06 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 6ac6355d-eb05-4d1a-94c5-8ca630e926f4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance ebed89ae-c110-4bf3-94e2-af76b19c2a52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 2c18a949-25d9-4db9-bac5-b0b75d9a5751 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 5416dd03-4161-4411-a74b-8d6a6e2e9f54 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 01:15:06 user nova-compute[74850]: INFO nova.compute.manager [None req-78f8801f-bf88-46ca-ae79-00b2de36aac9 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 14 01:15:06 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-78f8801f-bf88-46ca-ae79-00b2de36aac9 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.378s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG nova.objects.instance [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5416dd03-4161-4411-a74b-8d6a6e2e9f54 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG nova.objects.base [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Object Instance<5416dd03-4161-4411-a74b-8d6a6e2e9f54> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fc1b7c6620c95d32023865886143582e78fc686 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fc1b7c6620c95d32023865886143582e78fc686 --force-share --output=json" returned: 0 in 0.182s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 01:15:06 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:07 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Cannot resize image /opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 01:15:07 user nova-compute[74850]: DEBUG nova.objects.instance [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lazy-loading 'migration_context' on Instance uuid 5416dd03-4161-4411-a74b-8d6a6e2e9f54 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:15:07 user nova-compute[74850]: DEBUG nova.objects.base [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Object Instance<5416dd03-4161-4411-a74b-8d6a6e2e9f54> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74850) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 01:15:07 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1246065015',display_name='tempest-TestMinimumBasicScenario-server-1246065015',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1246065015',id=50,image_ref='8ba8bd50-9091-4da9-9f92-78c3d236b684',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCle3EU/m/g9NKR8n+0V6pqHrWP89VQbKtrtNAoI/KQMQsZllveB7EoYMhQdEgVXwVfsjyPlHxXAhJrn14OjYkLuq3H0x9kXgNYXCap00oAFcwtZTMn2iW22mWyQxNulQA==',key_name='tempest-TestMinimumBasicScenario-1702432917',keypairs=<?>,launch_index=0,launched_at=2023-11-14T01:13:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='e0ae3f5d3814451c9c7d7264707c8334',ramdisk_id='',reservation_id='r-2c6xm05p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8ba8bd50-9091-4da9-9f92-78c3d236b684',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2056291063',owner_user_name='tempest-TestMinimumBasicScenario-2056291063-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:15:04Z,user_data=None,user_id='534b22e8e0c7495f8d2f89dec7e9a66c',uuid=5416dd03-4161-4411-a74b-8d6a6e2e9f54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "address": "fa:16:3e:d5:a5:65", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08667be8-25", "ovs_interfaceid": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 01:15:07 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Converting VIF {"id": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "address": "fa:16:3e:d5:a5:65", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08667be8-25", "ovs_interfaceid": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:15:07 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:a5:65,bridge_name='br-int',has_traffic_filtering=True,id=08667be8-256e-4d3c-b3a1-e65917c9c2c8,network=Network(7a6e0781-a6cd-4125-bdaf-9b9d53c4d254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08667be8-25') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:15:07 user nova-compute[74850]: DEBUG os_vif [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:a5:65,bridge_name='br-int',has_traffic_filtering=True,id=08667be8-256e-4d3c-b3a1-e65917c9c2c8,network=Network(7a6e0781-a6cd-4125-bdaf-9b9d53c4d254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08667be8-25') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 01:15:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:15:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 01:15:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c64c3842-ad90-5c25-b97f-36456187a99d', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:15:07 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:15:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:15:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08667be8-25, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:15:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap08667be8-25, col_values=(('qos', UUID('89268a52-4833-4d3a-9f78-6ef88d009343')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:15:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap08667be8-25, col_values=(('external_ids', {'iface-id': '08667be8-256e-4d3c-b3a1-e65917c9c2c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:a5:65', 'vm-uuid': '5416dd03-4161-4411-a74b-8d6a6e2e9f54'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:15:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:07 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Took 0.67 seconds to deallocate network for instance.
Nov 14 01:15:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:15:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:07 user nova-compute[74850]: INFO os_vif [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:a5:65,bridge_name='br-int',has_traffic_filtering=True,id=08667be8-256e-4d3c-b3a1-e65917c9c2c8,network=Network(7a6e0781-a6cd-4125-bdaf-9b9d53c4d254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08667be8-25')
Nov 14 01:15:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-78f8801f-bf88-46ca-ae79-00b2de36aac9 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:15:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-78f8801f-bf88-46ca-ae79-00b2de36aac9 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:15:07 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-78f8801f-bf88-46ca-ae79-00b2de36aac9 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:15:07 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-78f8801f-bf88-46ca-ae79-00b2de36aac9 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:15:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-78f8801f-bf88-46ca-ae79-00b2de36aac9 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.181s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:15:07 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-78f8801f-bf88-46ca-ae79-00b2de36aac9 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Deleted allocations for instance ebed89ae-c110-4bf3-94e2-af76b19c2a52
Nov 14 01:15:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-78f8801f-bf88-46ca-ae79-00b2de36aac9 tempest-TestServerVolumeAttachmentScenario-1207940089 tempest-TestServerVolumeAttachmentScenario-1207940089-project-member] Lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.235s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:15:07 user nova-compute[74850]: DEBUG nova.compute.manager [req-961e4804-ca2e-4c10-9f87-2a0eb7c0a21c req-f661be55-e92c-4034-9e81-a8c058b271d9 service nova] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Received event network-vif-plugged-73c210c0-59f3-4551-be32-77168edd3996 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:15:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-961e4804-ca2e-4c10-9f87-2a0eb7c0a21c req-f661be55-e92c-4034-9e81-a8c058b271d9 service nova] Acquiring lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:15:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-961e4804-ca2e-4c10-9f87-2a0eb7c0a21c req-f661be55-e92c-4034-9e81-a8c058b271d9 service nova] Lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:15:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-961e4804-ca2e-4c10-9f87-2a0eb7c0a21c req-f661be55-e92c-4034-9e81-a8c058b271d9 service nova] Lock "ebed89ae-c110-4bf3-94e2-af76b19c2a52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:15:07 user nova-compute[74850]: DEBUG nova.compute.manager [req-961e4804-ca2e-4c10-9f87-2a0eb7c0a21c req-f661be55-e92c-4034-9e81-a8c058b271d9 service nova] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] No waiting events found dispatching network-vif-plugged-73c210c0-59f3-4551-be32-77168edd3996 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:15:07 user nova-compute[74850]: WARNING nova.compute.manager [req-961e4804-ca2e-4c10-9f87-2a0eb7c0a21c req-f661be55-e92c-4034-9e81-a8c058b271d9 service nova] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Received unexpected event network-vif-plugged-73c210c0-59f3-4551-be32-77168edd3996 for instance with vm_state deleted and task_state None.
Nov 14 01:15:07 user nova-compute[74850]: DEBUG nova.compute.manager [req-961e4804-ca2e-4c10-9f87-2a0eb7c0a21c req-f661be55-e92c-4034-9e81-a8c058b271d9 service nova] [instance: ebed89ae-c110-4bf3-94e2-af76b19c2a52] Received event network-vif-deleted-73c210c0-59f3-4551-be32-77168edd3996 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:15:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:08 user nova-compute[74850]: DEBUG nova.compute.manager [req-c45c5742-a11c-45f9-b590-53452db7b521 req-077f352a-11b2-4ffe-beb8-ca83285a0ef5 service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Received event network-vif-plugged-08667be8-256e-4d3c-b3a1-e65917c9c2c8 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:15:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c45c5742-a11c-45f9-b590-53452db7b521 req-077f352a-11b2-4ffe-beb8-ca83285a0ef5 service nova] Acquiring lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:15:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c45c5742-a11c-45f9-b590-53452db7b521 req-077f352a-11b2-4ffe-beb8-ca83285a0ef5 service nova] Lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:15:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c45c5742-a11c-45f9-b590-53452db7b521 req-077f352a-11b2-4ffe-beb8-ca83285a0ef5 service nova] Lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:15:08 user nova-compute[74850]: DEBUG nova.compute.manager [req-c45c5742-a11c-45f9-b590-53452db7b521 req-077f352a-11b2-4ffe-beb8-ca83285a0ef5 service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] No waiting events found dispatching network-vif-plugged-08667be8-256e-4d3c-b3a1-e65917c9c2c8 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:15:08 user nova-compute[74850]: WARNING nova.compute.manager [req-c45c5742-a11c-45f9-b590-53452db7b521 req-077f352a-11b2-4ffe-beb8-ca83285a0ef5 service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Received unexpected event network-vif-plugged-08667be8-256e-4d3c-b3a1-e65917c9c2c8 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 01:15:08 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:15:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:10 user nova-compute[74850]: DEBUG nova.compute.manager [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 01:15:10 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Instance rebooted successfully.
Nov 14 01:15:10 user nova-compute[74850]: DEBUG nova.compute.manager [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 01:15:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a3e5e7ef-b330-49ba-ae6c-f65cdfc740c6 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.611s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:15:10 user nova-compute[74850]: DEBUG nova.compute.manager [req-a7e3783c-09f3-4355-ad0e-a2c6a81a8e2f req-8c9d8334-5d73-4d65-89d6-03eab396426b service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Received event network-vif-plugged-08667be8-256e-4d3c-b3a1-e65917c9c2c8 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:15:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a7e3783c-09f3-4355-ad0e-a2c6a81a8e2f req-8c9d8334-5d73-4d65-89d6-03eab396426b service nova] Acquiring lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:15:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a7e3783c-09f3-4355-ad0e-a2c6a81a8e2f req-8c9d8334-5d73-4d65-89d6-03eab396426b service nova] Lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:15:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a7e3783c-09f3-4355-ad0e-a2c6a81a8e2f req-8c9d8334-5d73-4d65-89d6-03eab396426b service nova] Lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:15:10 user nova-compute[74850]: DEBUG nova.compute.manager [req-a7e3783c-09f3-4355-ad0e-a2c6a81a8e2f req-8c9d8334-5d73-4d65-89d6-03eab396426b service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] No waiting events found dispatching network-vif-plugged-08667be8-256e-4d3c-b3a1-e65917c9c2c8 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:15:10 user nova-compute[74850]: WARNING nova.compute.manager [req-a7e3783c-09f3-4355-ad0e-a2c6a81a8e2f req-8c9d8334-5d73-4d65-89d6-03eab396426b service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Received unexpected event network-vif-plugged-08667be8-256e-4d3c-b3a1-e65917c9c2c8 for instance with vm_state active and task_state None.
Nov 14 01:15:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:11 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:15:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:12 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:15:13 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:15:13 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:15:13 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 01:15:14 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:15:15 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:15:15 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 01:15:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "refresh_cache-2c18a949-25d9-4db9-bac5-b0b75d9a5751" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:15:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquired lock "refresh_cache-2c18a949-25d9-4db9-bac5-b0b75d9a5751" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:15:16 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Forcefully refreshing network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 01:15:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:16 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Updating instance_info_cache with network_info: [{"id": "a4ec3961-14e9-4085-8eca-c16a32d436f0", "address": "fa:16:3e:92:61:d5", "network": {"id": "40ed88df-3a5a-4029-a9b5-4c73221823fa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1084755377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b811df14b33a498db8a1a7eb95c5bb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ec3961-14", "ovs_interfaceid": "a4ec3961-14e9-4085-8eca-c16a32d436f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:15:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Releasing lock "refresh_cache-2c18a949-25d9-4db9-bac5-b0b75d9a5751" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:15:16 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Updated the network info_cache for instance {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 01:15:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:17 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:15:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:15:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74850) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 01:15:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:15:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:15:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Acquiring lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:15:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:15:30 user nova-compute[74850]: DEBUG nova.objects.instance [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lazy-loading 'flavor' on Instance uuid 2c18a949-25d9-4db9-bac5-b0b75d9a5751 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:15:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:15:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Acquiring lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:15:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:15:30 user nova-compute[74850]: INFO nova.compute.manager [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Attaching volume d625eb6b-aff9-4ae9-a05b-b415811b6a6d to /dev/vdb
Nov 14 01:15:30 user nova-compute[74850]: DEBUG os_brick.utils [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:15:30 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:30 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:30 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47364c7-7068-41dc-be85-12723efb9ad1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:30 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:30 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:30 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[78de3790-43ae-435c-909b-33310aa924a5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:30 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:30 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:30 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f1bfbb-140d-42bf-b718-49ad14e9062e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:30 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaaa6348-8a27-4a53-a3f6-20b930ba283f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:30 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:30 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:15:30 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 01:15:30 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:30 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:15:30 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 01:15:30 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7150eb-2e5b-4630-a982-8c8292e5462d]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:30 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 01:15:30 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 01:15:30 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 01:15:30 user nova-compute[74850]: DEBUG os_brick.utils [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:15:30 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Updating existing volume attachment record: b8456052-5de4-49fd-9ddd-2b702506139e {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 01:15:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:34 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 01:15:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwNxPGuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:15:34 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:15:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:15:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:15:34 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:15:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:15:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:15:34 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 01:15:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:34 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af11c9c-8805-43d8-9ce0-12161059bdb3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 01:15:34 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:15:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:34 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd543ec-b351-4320-a983-d18b04c88214]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d] added
Nov 14 01:15:34 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:15:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:34 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[070e1d80-b0b1-4183-9060-359ea4be6842]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:15:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:34 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f5fc92-975d-45eb-b577-afdee891bcb4]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:15:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fwNxPGuR {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fwNxPGuR" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a9f269-49f5-4541-9148-7ca5fd5f6f43]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fwNxPGuR'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:15:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fce318-2494-4d42-a891-9a9bbe1f6a3e]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:15:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f1d647-1919-4caa-9b39-818e1f7c2ef3]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:15:35 user nova-compute[74850]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e (non-flash)
Nov 14 01:15:35 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:15:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:15:35 user nova-compute[74850]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e (non-flash)
Nov 14 01:15:35 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:15:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fdf8b2-c104-4ced-8d49-b9fa9a6528d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d, portal: 172.16.0.220,3260]
Nov 14 01:15:35 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d, portal: 172.16.0.220,3260] successful.
Nov 14 01:15:35 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:15:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e611ea-6fa1-4af8-962b-637845f5eec8]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:15:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dad080d-ce40-42ce-8685-2a147047096a]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:15:35 user nova-compute[74850]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e (non-flash)
Nov 14 01:15:35 user nova-compute[74850]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d (non-flash)
Nov 14 01:15:35 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:15:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:15:35 user nova-compute[74850]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e (non-flash)
Nov 14 01:15:35 user nova-compute[74850]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d (non-flash)
Nov 14 01:15:35 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:15:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:15:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 01:15:35 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] HCTL ('35', '-', '-', 0) found on session 59 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 01:15:35 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 01:15:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea25c17-0779-4ec0-bce6-af1be73f7bb3]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:35 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Searching for a device in session 59 and hctl ['35', '*', '*', 0] yield: None {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:15:36 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Searching for a device in session 59 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:15:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwNxPGuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 01:15:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:15:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26234653537336237', 'path': '/dev/sdd'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:15:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234653537336237', 'path': '/dev/sdd'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 01:15:36 user nova-compute[74850]: DEBUG nova.objects.instance [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lazy-loading 'flavor' on Instance uuid 2c18a949-25d9-4db9-bac5-b0b75d9a5751 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:15:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 01:15:36 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:15:36 user nova-compute[74850]:   <source dev="/dev/sdd"/>
Nov 14 01:15:36 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:15:36 user nova-compute[74850]:   <serial>d625eb6b-aff9-4ae9-a05b-b415811b6a6d</serial>
Nov 14 01:15:36 user nova-compute[74850]: </disk>
Nov 14 01:15:36 user nova-compute[74850]:  {{(pid=74850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 01:15:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:15:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:15:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] No VIF found with MAC fa:16:3e:92:61:d5, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:15:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e1a87d6c-3423-421e-9883-cac069e83e95 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.272s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:15:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e15aeede-e5c6-4681-a256-5d6714b93637 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Acquiring lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:15:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e15aeede-e5c6-4681-a256-5d6714b93637 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:15:38 user nova-compute[74850]: INFO nova.compute.manager [None req-e15aeede-e5c6-4681-a256-5d6714b93637 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Detaching volume d625eb6b-aff9-4ae9-a05b-b415811b6a6d
Nov 14 01:15:38 user nova-compute[74850]: INFO nova.virt.block_device [None req-e15aeede-e5c6-4681-a256-5d6714b93637 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Attempting to driver detach volume d625eb6b-aff9-4ae9-a05b-b415811b6a6d from mountpoint /dev/vdb
Nov 14 01:15:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e15aeede-e5c6-4681-a256-5d6714b93637 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Attempting to detach device vdb from instance 2c18a949-25d9-4db9-bac5-b0b75d9a5751 from the persistent domain config. {{(pid=74850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 01:15:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-e15aeede-e5c6-4681-a256-5d6714b93637 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:15:38 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:15:38 user nova-compute[74850]:   <source dev="/dev/sdd"/>
Nov 14 01:15:38 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:15:38 user nova-compute[74850]:   <serial>d625eb6b-aff9-4ae9-a05b-b415811b6a6d</serial>
Nov 14 01:15:38 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 01:15:38 user nova-compute[74850]: </disk>
Nov 14 01:15:38 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:15:38 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-e15aeede-e5c6-4681-a256-5d6714b93637 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Successfully detached device vdb from instance 2c18a949-25d9-4db9-bac5-b0b75d9a5751 from the persistent domain config.
Nov 14 01:15:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e15aeede-e5c6-4681-a256-5d6714b93637 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2c18a949-25d9-4db9-bac5-b0b75d9a5751 from the live domain config. {{(pid=74850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 01:15:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-e15aeede-e5c6-4681-a256-5d6714b93637 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:15:38 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:15:38 user nova-compute[74850]:   <source dev="/dev/sdd"/>
Nov 14 01:15:38 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:15:38 user nova-compute[74850]:   <serial>d625eb6b-aff9-4ae9-a05b-b415811b6a6d</serial>
Nov 14 01:15:38 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 01:15:38 user nova-compute[74850]: </disk>
Nov 14 01:15:38 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:15:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e15aeede-e5c6-4681-a256-5d6714b93637 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2c18a949-25d9-4db9-bac5-b0b75d9a5751 {{(pid=74850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 01:15:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:45 user nova-compute[74850]: DEBUG nova.compute.manager [req-18f80a2f-39b0-4927-903e-b6a037cb0abd req-68ac7e1a-85cc-4757-ae23-e6bb928c7671 service nova] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Received event network-changed-4f8a261a-c9f2-47b4-a0e7-ae6730ec962a {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:15:45 user nova-compute[74850]: DEBUG nova.compute.manager [req-18f80a2f-39b0-4927-903e-b6a037cb0abd req-68ac7e1a-85cc-4757-ae23-e6bb928c7671 service nova] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Refreshing instance network info cache due to event network-changed-4f8a261a-c9f2-47b4-a0e7-ae6730ec962a. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:15:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-18f80a2f-39b0-4927-903e-b6a037cb0abd req-68ac7e1a-85cc-4757-ae23-e6bb928c7671 service nova] Acquiring lock "refresh_cache-6ac6355d-eb05-4d1a-94c5-8ca630e926f4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:15:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-18f80a2f-39b0-4927-903e-b6a037cb0abd req-68ac7e1a-85cc-4757-ae23-e6bb928c7671 service nova] Acquired lock "refresh_cache-6ac6355d-eb05-4d1a-94c5-8ca630e926f4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:15:45 user nova-compute[74850]: DEBUG nova.network.neutron [req-18f80a2f-39b0-4927-903e-b6a037cb0abd req-68ac7e1a-85cc-4757-ae23-e6bb928c7671 service nova] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Refreshing network info cache for port 4f8a261a-c9f2-47b4-a0e7-ae6730ec962a {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:15:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "6ac6355d-eb05-4d1a-94c5-8ca630e926f4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:15:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "6ac6355d-eb05-4d1a-94c5-8ca630e926f4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:15:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "6ac6355d-eb05-4d1a-94c5-8ca630e926f4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:15:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "6ac6355d-eb05-4d1a-94c5-8ca630e926f4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:15:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "6ac6355d-eb05-4d1a-94c5-8ca630e926f4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:15:45 user nova-compute[74850]: INFO nova.compute.manager [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Terminating instance
Nov 14 01:15:45 user nova-compute[74850]: DEBUG nova.compute.manager [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 01:15:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG nova.compute.manager [req-29844366-bed4-479d-bfb0-391fade64dd6 req-8b49998a-4fea-4aa7-914b-a693e5a5706d service nova] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Received event network-vif-unplugged-4f8a261a-c9f2-47b4-a0e7-ae6730ec962a {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-29844366-bed4-479d-bfb0-391fade64dd6 req-8b49998a-4fea-4aa7-914b-a693e5a5706d service nova] Acquiring lock "6ac6355d-eb05-4d1a-94c5-8ca630e926f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-29844366-bed4-479d-bfb0-391fade64dd6 req-8b49998a-4fea-4aa7-914b-a693e5a5706d service nova] Lock "6ac6355d-eb05-4d1a-94c5-8ca630e926f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-29844366-bed4-479d-bfb0-391fade64dd6 req-8b49998a-4fea-4aa7-914b-a693e5a5706d service nova] Lock "6ac6355d-eb05-4d1a-94c5-8ca630e926f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG nova.compute.manager [req-29844366-bed4-479d-bfb0-391fade64dd6 req-8b49998a-4fea-4aa7-914b-a693e5a5706d service nova] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] No waiting events found dispatching network-vif-unplugged-4f8a261a-c9f2-47b4-a0e7-ae6730ec962a {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG nova.compute.manager [req-29844366-bed4-479d-bfb0-391fade64dd6 req-8b49998a-4fea-4aa7-914b-a693e5a5706d service nova] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Received event network-vif-unplugged-4f8a261a-c9f2-47b4-a0e7-ae6730ec962a for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG nova.network.neutron [req-18f80a2f-39b0-4927-903e-b6a037cb0abd req-68ac7e1a-85cc-4757-ae23-e6bb928c7671 service nova] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Updated VIF entry in instance network info cache for port 4f8a261a-c9f2-47b4-a0e7-ae6730ec962a. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG nova.network.neutron [req-18f80a2f-39b0-4927-903e-b6a037cb0abd req-68ac7e1a-85cc-4757-ae23-e6bb928c7671 service nova] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Updating instance_info_cache with network_info: [{"id": "4f8a261a-c9f2-47b4-a0e7-ae6730ec962a", "address": "fa:16:3e:78:cd:0b", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8a261a-c9", "ovs_interfaceid": "4f8a261a-c9f2-47b4-a0e7-ae6730ec962a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-18f80a2f-39b0-4927-903e-b6a037cb0abd req-68ac7e1a-85cc-4757-ae23-e6bb928c7671 service nova] Releasing lock "refresh_cache-6ac6355d-eb05-4d1a-94c5-8ca630e926f4" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:15:46 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Instance destroyed successfully.
Nov 14 01:15:46 user nova-compute[74850]: DEBUG nova.objects.instance [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lazy-loading 'resources' on Instance uuid 6ac6355d-eb05-4d1a-94c5-8ca630e926f4 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:11:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-588725013',display_name='tempest-TestVolumeBootPattern-server-588725013',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-588725013',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA94n5zD/7RpobhW+jYq5sAS9UK4izFU1jEjxsSgfhAiBUC2oNIUdSW107BwtkqMZ7Uku+sA2LquAPtuZM0gk2nZsUp6hWLP86Pz4tdmgGXQVoyyrGsrxeP25l2IFQWByQ==',key_name='tempest-TestVolumeBootPattern-543311029',keypairs=<?>,launch_index=0,launched_at=2023-11-14T01:11:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fdb1eb4b5fc841d1952b8db9ae05e446',ramdisk_id='',reservation_id='r-hwkp5g77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1536334624',owner_user_name='tempest-TestVolumeBootPattern-1536334624-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T01:11:13Z,user_data=None,user_id='6c91ddcee4e54a769eb626c816596bed',uuid=6ac6355d-eb05-4d1a-94c5-8ca630e926f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f8a261a-c9f2-47b4-a0e7-ae6730ec962a", "address": "fa:16:3e:78:cd:0b", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8a261a-c9", "ovs_interfaceid": "4f8a261a-c9f2-47b4-a0e7-ae6730ec962a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Converting VIF {"id": "4f8a261a-c9f2-47b4-a0e7-ae6730ec962a", "address": "fa:16:3e:78:cd:0b", "network": {"id": "ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1256747463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb1eb4b5fc841d1952b8db9ae05e446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8a261a-c9", "ovs_interfaceid": "4f8a261a-c9f2-47b4-a0e7-ae6730ec962a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:cd:0b,bridge_name='br-int',has_traffic_filtering=True,id=4f8a261a-c9f2-47b4-a0e7-ae6730ec962a,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f8a261a-c9') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG os_vif [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:cd:0b,bridge_name='br-int',has_traffic_filtering=True,id=4f8a261a-c9f2-47b4-a0e7-ae6730ec962a,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f8a261a-c9') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f8a261a-c9, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d88fee5b-3da2-4eac-bd02-778397cea560) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:15:46 user nova-compute[74850]: INFO os_vif [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:cd:0b,bridge_name='br-int',has_traffic_filtering=True,id=4f8a261a-c9f2-47b4-a0e7-ae6730ec962a,network=Network(ad4d4393-659d-4f0c-a80e-1aff8ffe4e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f8a261a-c9')
Nov 14 01:15:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'empAbWLq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:15:46 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:15:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[108801f3-866b-47ba-884b-dbe3ce09d9df]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 01:15:46 user nova-compute[74850]: No targets found.
Nov 14 01:15:46 user nova-compute[74850]: iSNS:
Nov 14 01:15:46 user nova-compute[74850]: No targets found.
Nov 14 01:15:46 user nova-compute[74850]: STATIC:
Nov 14 01:15:46 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d
Nov 14 01:15:46 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:15:46 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:15:46 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8
Nov 14 01:15:46 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:15:46 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:15:46 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e
Nov 14 01:15:46 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:15:46 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:15:46 user nova-compute[74850]: FIRMWARE:
Nov 14 01:15:46 user nova-compute[74850]: No targets found.
Nov 14 01:15:46 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 01:15:46 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 01:15:46 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f683eef-95b7-4e19-a3f6-fc624dcc05d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[27706913-26e1-48d6-b6e2-61ace45654ba]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:15:46 user nova-compute[74850]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e (non-flash)
Nov 14 01:15:46 user nova-compute[74850]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d (non-flash)
Nov 14 01:15:46 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 (non-flash)
Nov 14 01:15:46 user nova-compute[74850]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e (non-flash)
Nov 14 01:15:46 user nova-compute[74850]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d (non-flash)
Nov 14 01:15:46 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a1c783b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8'): ({'sdc'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Removing single pathed devices sdc {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db32a7f-6ca2-4a3c-b073-805cc8e0316d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a2c335-4b68-4073-98f1-eeadd42be92e]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Flushing IO for device /dev/sdc {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[36980930-5ef0-437d-936e-a3b29b3e436b]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c22249-7385-43af-9db0-b0b8831daaa7]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] SCSI volumes sdc have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23939376431393364', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_bdc63f27', '/dev/disk/by-id/scsi-1SCST_BIObdc63f27-997d193d7f76272d') {{(pid=84948) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[862dc9eb-dfdc-420e-8f7d-42bcca1974c4]: (4, None) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfb5278-8d25-43cb-b6ff-45eb1a42baf7]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ac1058-5fe2-4b63-b744-0b6573a7c4fc]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8, portal: 172.16.0.220,3260]
Nov 14 01:15:46 user nova-compute[74850]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8, portal: 172.16.0.220,3260] successful.
Nov 14 01:15:46 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32e7343b-b42b-4d04-9c90-8a06c1cf98b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[293f29e7-80b3-4b22-8973-56c9199a72bb]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] <== disconnect_volume: return (325ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:15:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 01:15:46 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Deleting instance files /opt/stack/data/nova/instances/6ac6355d-eb05-4d1a-94c5-8ca630e926f4_del
Nov 14 01:15:46 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Deletion of /opt/stack/data/nova/instances/6ac6355d-eb05-4d1a-94c5-8ca630e926f4_del complete
Nov 14 01:15:47 user nova-compute[74850]: INFO nova.compute.manager [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 14 01:15:47 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 01:15:47 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 01:15:47 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 01:15:47 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:15:47 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Took 0.44 seconds to deallocate network for instance.
Nov 14 01:15:48 user nova-compute[74850]: INFO nova.compute.manager [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Took 0.78 seconds to detach 1 volumes for instance.
Nov 14 01:15:48 user nova-compute[74850]: DEBUG nova.compute.manager [req-1610fbeb-049b-4412-8cdf-a0f9d33dba07 req-0147e518-dd12-4a92-b489-8b6460e9d4bf service nova] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Received event network-vif-plugged-4f8a261a-c9f2-47b4-a0e7-ae6730ec962a {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:15:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-1610fbeb-049b-4412-8cdf-a0f9d33dba07 req-0147e518-dd12-4a92-b489-8b6460e9d4bf service nova] Acquiring lock "6ac6355d-eb05-4d1a-94c5-8ca630e926f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:15:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-1610fbeb-049b-4412-8cdf-a0f9d33dba07 req-0147e518-dd12-4a92-b489-8b6460e9d4bf service nova] Lock "6ac6355d-eb05-4d1a-94c5-8ca630e926f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:15:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-1610fbeb-049b-4412-8cdf-a0f9d33dba07 req-0147e518-dd12-4a92-b489-8b6460e9d4bf service nova] Lock "6ac6355d-eb05-4d1a-94c5-8ca630e926f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:15:48 user nova-compute[74850]: DEBUG nova.compute.manager [req-1610fbeb-049b-4412-8cdf-a0f9d33dba07 req-0147e518-dd12-4a92-b489-8b6460e9d4bf service nova] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] No waiting events found dispatching network-vif-plugged-4f8a261a-c9f2-47b4-a0e7-ae6730ec962a {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:15:48 user nova-compute[74850]: WARNING nova.compute.manager [req-1610fbeb-049b-4412-8cdf-a0f9d33dba07 req-0147e518-dd12-4a92-b489-8b6460e9d4bf service nova] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Received unexpected event network-vif-plugged-4f8a261a-c9f2-47b4-a0e7-ae6730ec962a for instance with vm_state active and task_state deleting.
Nov 14 01:15:48 user nova-compute[74850]: DEBUG nova.compute.manager [req-1610fbeb-049b-4412-8cdf-a0f9d33dba07 req-0147e518-dd12-4a92-b489-8b6460e9d4bf service nova] [instance: 6ac6355d-eb05-4d1a-94c5-8ca630e926f4] Received event network-vif-deleted-4f8a261a-c9f2-47b4-a0e7-ae6730ec962a {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:15:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:15:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:15:48 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:15:48 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:15:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:15:48 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Deleted allocations for instance 6ac6355d-eb05-4d1a-94c5-8ca630e926f4
Nov 14 01:15:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-50617057-cb11-4a43-847e-4e449fe76f5a tempest-TestVolumeBootPattern-1536334624 tempest-TestVolumeBootPattern-1536334624-project-member] Lock "6ac6355d-eb05-4d1a-94c5-8ca630e926f4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.767s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:15:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:55 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:56 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:15:59 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-e15aeede-e5c6-4681-a256-5d6714b93637 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2c18a949-25d9-4db9-bac5-b0b75d9a5751 is timed out.
Nov 14 01:15:59 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-e15aeede-e5c6-4681-a256-5d6714b93637 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Successfully detached device vdb from instance 2c18a949-25d9-4db9-bac5-b0b75d9a5751 from the live domain config.
Nov 14 01:15:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e15aeede-e5c6-4681-a256-5d6714b93637 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15aeede-e5c6-4681-a256-5d6714b93637 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwNxPGuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:15:59 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-e15aeede-e5c6-4681-a256-5d6714b93637 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:15:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-e15aeede-e5c6-4681-a256-5d6714b93637 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-e15aeede-e5c6-4681-a256-5d6714b93637 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cceae1-ad58-456f-9080-e762bc3dfcc8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15aeede-e5c6-4681-a256-5d6714b93637 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 01:15:59 user nova-compute[74850]: No targets found.
Nov 14 01:15:59 user nova-compute[74850]: iSNS:
Nov 14 01:15:59 user nova-compute[74850]: No targets found.
Nov 14 01:15:59 user nova-compute[74850]: STATIC:
Nov 14 01:15:59 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d
Nov 14 01:15:59 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:15:59 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:15:59 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e
Nov 14 01:15:59 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:15:59 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:15:59 user nova-compute[74850]: FIRMWARE:
Nov 14 01:15:59 user nova-compute[74850]: No targets found.
Nov 14 01:15:59 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15aeede-e5c6-4681-a256-5d6714b93637 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 01:15:59 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 01:15:59 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15aeede-e5c6-4681-a256-5d6714b93637 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b8c71a-ae87-4cbf-b235-a71b156ace48]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f94e0a5-2dd5-45b0-a279-81dc4ee0d573]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15aeede-e5c6-4681-a256-5d6714b93637 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e (non-flash)
Nov 14 01:15:59 user nova-compute[74850]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d (non-flash)
Nov 14 01:15:59 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15aeede-e5c6-4681-a256-5d6714b93637 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e (non-flash)
Nov 14 01:15:59 user nova-compute[74850]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d (non-flash)
Nov 14 01:15:59 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15aeede-e5c6-4681-a256-5d6714b93637 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a1c7ab9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d'): ({'sdd'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-e15aeede-e5c6-4681-a256-5d6714b93637 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Removing single pathed devices sdd {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f429a558-49ad-44b1-bc52-74189ba4ff64]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[33df58f8-5197-44f3-a1dc-a5f2365e3e1b]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-e15aeede-e5c6-4681-a256-5d6714b93637 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Flushing IO for device /dev/sdd {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[305645f7-53f3-41a4-9a18-90fd10dfe2ba]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-e15aeede-e5c6-4681-a256-5d6714b93637 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a64668-47dc-4519-8ed8-81e59b031b54]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-e15aeede-e5c6-4681-a256-5d6714b93637 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-e15aeede-e5c6-4681-a256-5d6714b93637 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] SCSI volumes sdd have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15aeede-e5c6-4681-a256-5d6714b93637 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ec2233-1263-4fe0-b78a-d2291eedf68f]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15aeede-e5c6-4681-a256-5d6714b93637 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2bf5ba-21e9-4f8c-b7a7-79b9e1775143]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15aeede-e5c6-4681-a256-5d6714b93637 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d, portal: 172.16.0.220,3260]
Nov 14 01:15:59 user nova-compute[74850]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d, portal: 172.16.0.220,3260] successful.
Nov 14 01:15:59 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d625eb6b-aff9-4ae9-a05b-b415811b6a6d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d795a9b3-c27b-45d0-90b7-4e98692642a1]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15aeede-e5c6-4681-a256-5d6714b93637 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-e15aeede-e5c6-4681-a256-5d6714b93637 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15aeede-e5c6-4681-a256-5d6714b93637 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] <== disconnect_volume: return (272ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:15:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e15aeede-e5c6-4681-a256-5d6714b93637 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 01:16:00 user nova-compute[74850]: DEBUG nova.objects.instance [None req-e15aeede-e5c6-4681-a256-5d6714b93637 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lazy-loading 'flavor' on Instance uuid 2c18a949-25d9-4db9-bac5-b0b75d9a5751 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:16:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e15aeede-e5c6-4681-a256-5d6714b93637 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.569s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:16:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:16:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:16:03 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:16:03 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:16:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:16:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:16:03 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:16:03 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 01:16:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:16:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:16:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:16:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:16:04 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:16:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c18a949-25d9-4db9-bac5-b0b75d9a5751/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:16:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c18a949-25d9-4db9-bac5-b0b75d9a5751/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:16:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c18a949-25d9-4db9-bac5-b0b75d9a5751/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:16:04 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c18a949-25d9-4db9-bac5-b0b75d9a5751/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:16:05 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:16:05 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:16:05 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=8744MB free_disk=24.969924926757812GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 01:16:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:16:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:16:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:16:05 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 2c18a949-25d9-4db9-bac5-b0b75d9a5751 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:16:05 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 5416dd03-4161-4411-a74b-8d6a6e2e9f54 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:16:05 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 01:16:05 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 01:16:05 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:16:05 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:16:05 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 01:16:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.226s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:16:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:16:08 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:16:08 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:16:08 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74850) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 01:16:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:16:11 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:16:13 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:16:13 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 01:16:13 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:16:14 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:16:14 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:16:14 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:16:15 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:16:15 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 01:16:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "refresh_cache-5416dd03-4161-4411-a74b-8d6a6e2e9f54" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:16:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquired lock "refresh_cache-5416dd03-4161-4411-a74b-8d6a6e2e9f54" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:16:16 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Forcefully refreshing network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 01:16:16 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Updating instance_info_cache with network_info: [{"id": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "address": "fa:16:3e:d5:a5:65", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08667be8-25", "ovs_interfaceid": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:16:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Releasing lock "refresh_cache-5416dd03-4161-4411-a74b-8d6a6e2e9f54" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:16:16 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Updated the network info_cache for instance {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 01:16:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:16:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:16:22 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:16:22 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Cleaning up deleted instances {{(pid=74850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 01:16:22 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] There are 0 instances to clean {{(pid=74850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 01:16:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:16:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:16:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74850) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 01:16:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:16:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:16:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:16:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Acquiring lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:16:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:16:30 user nova-compute[74850]: DEBUG nova.objects.instance [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lazy-loading 'flavor' on Instance uuid 2c18a949-25d9-4db9-bac5-b0b75d9a5751 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:16:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:16:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Acquiring lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:16:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:16:31 user nova-compute[74850]: INFO nova.compute.manager [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Attaching volume 6867948a-6595-4b98-b788-4d0e00197cb8 to /dev/vdb
Nov 14 01:16:31 user nova-compute[74850]: DEBUG os_brick.utils [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:16:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:16:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:16:31 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b529ac32-8563-4809-a053-086bff9b1031]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:16:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:16:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:16:31 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0bfd94-5d42-4b61-8d8b-13a3aa98315b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:16:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:16:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:16:31 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec917fc-006f-4c2b-94d2-0464f7869f97]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:16:31 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f96344c-384e-4e23-92e3-382cd2668583]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:16:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:16:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:16:31 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 01:16:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:16:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:16:31 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 01:16:31 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f8a00b-ab16-4d58-9dae-6cc325f52b74]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:16:31 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 01:16:31 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 01:16:31 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 01:16:31 user nova-compute[74850]: DEBUG os_brick.utils [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:16:31 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Updating existing volume attachment record: fcfc706a-b9db-4e20-8ff9-9e46fa07fdee {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 01:16:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:16:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ehGiJWjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:16:35 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:16:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:16:35 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:16:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:16:35 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 01:16:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8 -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d72bcf-6ba3-4c84-a5f7-5ea109b32177]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 01:16:35 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[611ef327-57e0-4571-80a2-cc9061b1eb21]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8] added
Nov 14 01:16:35 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a488ca22-a251-4a7a-839c-c245c2e2a085]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[148b8526-c93e-412d-b4a2-4002c6387fae]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ehGiJWjx {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ehGiJWjx" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81fb2d7-d16c-4911-be67-bd06cdaf0360]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ehGiJWjx'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93bd5af-862b-4655-ab28-7b3823bee3de]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe0bc25-50e2-433e-bf98-9f87c7a559f9]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e (non-flash)
Nov 14 01:16:35 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e (non-flash)
Nov 14 01:16:35 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8 -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[076ce6fc-edf5-4b65-9842-7ba54eb57da4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8, portal: 172.16.0.220,3260]
Nov 14 01:16:35 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8, portal: 172.16.0.220,3260] successful.
Nov 14 01:16:35 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1659de16-11bf-423a-8288-222ac799b293]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[113aa098-3c5b-4bef-af93-3ead1ce2c435]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e (non-flash)
Nov 14 01:16:35 user nova-compute[74850]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8 (non-flash)
Nov 14 01:16:35 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e (non-flash)
Nov 14 01:16:35 user nova-compute[74850]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8 (non-flash)
Nov 14 01:16:35 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[db18929e-eaf6-4548-aa70-05ae98c66f48]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:16:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ehGiJWjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 01:16:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:16:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23235316434623633', 'path': '/dev/sdc'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:16:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235316434623633', 'path': '/dev/sdc'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 01:16:36 user nova-compute[74850]: DEBUG nova.objects.instance [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lazy-loading 'flavor' on Instance uuid 2c18a949-25d9-4db9-bac5-b0b75d9a5751 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:16:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 01:16:36 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:16:36 user nova-compute[74850]:   <source dev="/dev/sdc"/>
Nov 14 01:16:36 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:16:36 user nova-compute[74850]:   <serial>6867948a-6595-4b98-b788-4d0e00197cb8</serial>
Nov 14 01:16:36 user nova-compute[74850]: </disk>
Nov 14 01:16:36 user nova-compute[74850]:  {{(pid=74850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 01:16:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:16:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:16:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74850) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 01:16:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:16:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:16:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:16:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:16:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:16:36 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] No VIF found with MAC fa:16:3e:92:61:d5, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:16:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-49d674a2-1d14-43ab-8c2b-448bd901ab17 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.044s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:16:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-690d8912-27a2-4261-904a-96003c7ca99c tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Acquiring lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:16:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-690d8912-27a2-4261-904a-96003c7ca99c tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:16:39 user nova-compute[74850]: INFO nova.compute.manager [None req-690d8912-27a2-4261-904a-96003c7ca99c tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Detaching volume 6867948a-6595-4b98-b788-4d0e00197cb8
Nov 14 01:16:39 user nova-compute[74850]: INFO nova.virt.block_device [None req-690d8912-27a2-4261-904a-96003c7ca99c tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Attempting to driver detach volume 6867948a-6595-4b98-b788-4d0e00197cb8 from mountpoint /dev/vdb
Nov 14 01:16:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-690d8912-27a2-4261-904a-96003c7ca99c tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Attempting to detach device vdb from instance 2c18a949-25d9-4db9-bac5-b0b75d9a5751 from the persistent domain config. {{(pid=74850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 01:16:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-690d8912-27a2-4261-904a-96003c7ca99c tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:16:39 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:16:39 user nova-compute[74850]:   <source dev="/dev/sdc"/>
Nov 14 01:16:39 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:16:39 user nova-compute[74850]:   <serial>6867948a-6595-4b98-b788-4d0e00197cb8</serial>
Nov 14 01:16:39 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 01:16:39 user nova-compute[74850]: </disk>
Nov 14 01:16:39 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:16:39 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-690d8912-27a2-4261-904a-96003c7ca99c tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Successfully detached device vdb from instance 2c18a949-25d9-4db9-bac5-b0b75d9a5751 from the persistent domain config.
Nov 14 01:16:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-690d8912-27a2-4261-904a-96003c7ca99c tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2c18a949-25d9-4db9-bac5-b0b75d9a5751 from the live domain config. {{(pid=74850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 01:16:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-690d8912-27a2-4261-904a-96003c7ca99c tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:16:39 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:16:39 user nova-compute[74850]:   <source dev="/dev/sdc"/>
Nov 14 01:16:39 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:16:39 user nova-compute[74850]:   <serial>6867948a-6595-4b98-b788-4d0e00197cb8</serial>
Nov 14 01:16:39 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 01:16:39 user nova-compute[74850]: </disk>
Nov 14 01:16:39 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:16:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-690d8912-27a2-4261-904a-96003c7ca99c tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2c18a949-25d9-4db9-bac5-b0b75d9a5751 {{(pid=74850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 01:16:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:16:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:16:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:16:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:16:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:16:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:16:55 user nova-compute[74850]: DEBUG nova.compute.manager [req-55775e0c-9b7e-47d6-a96c-457687efe896 req-07eb7ee4-3469-436c-9769-3276ee7153a7 service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Received event network-changed-08667be8-256e-4d3c-b3a1-e65917c9c2c8 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:16:55 user nova-compute[74850]: DEBUG nova.compute.manager [req-55775e0c-9b7e-47d6-a96c-457687efe896 req-07eb7ee4-3469-436c-9769-3276ee7153a7 service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Refreshing instance network info cache due to event network-changed-08667be8-256e-4d3c-b3a1-e65917c9c2c8. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:16:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-55775e0c-9b7e-47d6-a96c-457687efe896 req-07eb7ee4-3469-436c-9769-3276ee7153a7 service nova] Acquiring lock "refresh_cache-5416dd03-4161-4411-a74b-8d6a6e2e9f54" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:16:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-55775e0c-9b7e-47d6-a96c-457687efe896 req-07eb7ee4-3469-436c-9769-3276ee7153a7 service nova] Acquired lock "refresh_cache-5416dd03-4161-4411-a74b-8d6a6e2e9f54" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:16:55 user nova-compute[74850]: DEBUG nova.network.neutron [req-55775e0c-9b7e-47d6-a96c-457687efe896 req-07eb7ee4-3469-436c-9769-3276ee7153a7 service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Refreshing network info cache for port 08667be8-256e-4d3c-b3a1-e65917c9c2c8 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:16:55 user nova-compute[74850]: DEBUG nova.network.neutron [req-55775e0c-9b7e-47d6-a96c-457687efe896 req-07eb7ee4-3469-436c-9769-3276ee7153a7 service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Updated VIF entry in instance network info cache for port 08667be8-256e-4d3c-b3a1-e65917c9c2c8. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:16:55 user nova-compute[74850]: DEBUG nova.network.neutron [req-55775e0c-9b7e-47d6-a96c-457687efe896 req-07eb7ee4-3469-436c-9769-3276ee7153a7 service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Updating instance_info_cache with network_info: [{"id": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "address": "fa:16:3e:d5:a5:65", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08667be8-25", "ovs_interfaceid": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:16:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-55775e0c-9b7e-47d6-a96c-457687efe896 req-07eb7ee4-3469-436c-9769-3276ee7153a7 service nova] Releasing lock "refresh_cache-5416dd03-4161-4411-a74b-8d6a6e2e9f54" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:16:55 user nova-compute[74850]: DEBUG nova.compute.manager [req-35106c50-1525-4b12-add5-05024d07ef12 req-5d8abad0-5577-4b65-9f35-9299e610db33 service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Received event network-changed-08667be8-256e-4d3c-b3a1-e65917c9c2c8 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:16:55 user nova-compute[74850]: DEBUG nova.compute.manager [req-35106c50-1525-4b12-add5-05024d07ef12 req-5d8abad0-5577-4b65-9f35-9299e610db33 service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Refreshing instance network info cache due to event network-changed-08667be8-256e-4d3c-b3a1-e65917c9c2c8. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:16:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-35106c50-1525-4b12-add5-05024d07ef12 req-5d8abad0-5577-4b65-9f35-9299e610db33 service nova] Acquiring lock "refresh_cache-5416dd03-4161-4411-a74b-8d6a6e2e9f54" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:16:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-35106c50-1525-4b12-add5-05024d07ef12 req-5d8abad0-5577-4b65-9f35-9299e610db33 service nova] Acquired lock "refresh_cache-5416dd03-4161-4411-a74b-8d6a6e2e9f54" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:16:55 user nova-compute[74850]: DEBUG nova.network.neutron [req-35106c50-1525-4b12-add5-05024d07ef12 req-5d8abad0-5577-4b65-9f35-9299e610db33 service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Refreshing network info cache for port 08667be8-256e-4d3c-b3a1-e65917c9c2c8 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:16:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e7ffa1c3-235b-4eda-be44-4fcf8abbea8d tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquiring lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:16:55 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e7ffa1c3-235b-4eda-be44-4fcf8abbea8d tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:16:55 user nova-compute[74850]: INFO nova.compute.manager [None req-e7ffa1c3-235b-4eda-be44-4fcf8abbea8d tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Detaching volume eb6eb571-042a-4079-a0ee-31fff297435e
Nov 14 01:16:55 user nova-compute[74850]: INFO nova.virt.block_device [None req-e7ffa1c3-235b-4eda-be44-4fcf8abbea8d tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Attempting to driver detach volume eb6eb571-042a-4079-a0ee-31fff297435e from mountpoint /dev/vdb
Nov 14 01:16:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e7ffa1c3-235b-4eda-be44-4fcf8abbea8d tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Attempting to detach device vdb from instance 5416dd03-4161-4411-a74b-8d6a6e2e9f54 from the persistent domain config. {{(pid=74850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 01:16:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-e7ffa1c3-235b-4eda-be44-4fcf8abbea8d tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:16:55 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:16:55 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 01:16:55 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:16:55 user nova-compute[74850]:   <serial>eb6eb571-042a-4079-a0ee-31fff297435e</serial>
Nov 14 01:16:55 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 01:16:55 user nova-compute[74850]: </disk>
Nov 14 01:16:55 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:16:55 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-e7ffa1c3-235b-4eda-be44-4fcf8abbea8d tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Successfully detached device vdb from instance 5416dd03-4161-4411-a74b-8d6a6e2e9f54 from the persistent domain config.
Nov 14 01:16:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e7ffa1c3-235b-4eda-be44-4fcf8abbea8d tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5416dd03-4161-4411-a74b-8d6a6e2e9f54 from the live domain config. {{(pid=74850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 01:16:55 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-e7ffa1c3-235b-4eda-be44-4fcf8abbea8d tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:16:55 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:16:55 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 01:16:55 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:16:55 user nova-compute[74850]:   <serial>eb6eb571-042a-4079-a0ee-31fff297435e</serial>
Nov 14 01:16:55 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 01:16:55 user nova-compute[74850]: </disk>
Nov 14 01:16:55 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:16:56 user nova-compute[74850]: DEBUG nova.network.neutron [req-35106c50-1525-4b12-add5-05024d07ef12 req-5d8abad0-5577-4b65-9f35-9299e610db33 service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Updated VIF entry in instance network info cache for port 08667be8-256e-4d3c-b3a1-e65917c9c2c8. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:16:56 user nova-compute[74850]: DEBUG nova.network.neutron [req-35106c50-1525-4b12-add5-05024d07ef12 req-5d8abad0-5577-4b65-9f35-9299e610db33 service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Updating instance_info_cache with network_info: [{"id": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "address": "fa:16:3e:d5:a5:65", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08667be8-25", "ovs_interfaceid": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:16:56 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-35106c50-1525-4b12-add5-05024d07ef12 req-5d8abad0-5577-4b65-9f35-9299e610db33 service nova] Releasing lock "refresh_cache-5416dd03-4161-4411-a74b-8d6a6e2e9f54" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:16:56 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:16:56 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-e7ffa1c3-235b-4eda-be44-4fcf8abbea8d tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5416dd03-4161-4411-a74b-8d6a6e2e9f54 {{(pid=74850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 01:16:56 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:16:59 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-690d8912-27a2-4261-904a-96003c7ca99c tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2c18a949-25d9-4db9-bac5-b0b75d9a5751 is timed out.
Nov 14 01:16:59 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-690d8912-27a2-4261-904a-96003c7ca99c tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Successfully detached device vdb from instance 2c18a949-25d9-4db9-bac5-b0b75d9a5751 from the live domain config.
Nov 14 01:16:59 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-690d8912-27a2-4261-904a-96003c7ca99c tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 01:16:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-690d8912-27a2-4261-904a-96003c7ca99c tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ehGiJWjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:16:59 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-690d8912-27a2-4261-904a-96003c7ca99c tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:16:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-690d8912-27a2-4261-904a-96003c7ca99c tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:16:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-690d8912-27a2-4261-904a-96003c7ca99c tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:16:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:16:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:16:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[597630a4-015a-40b2-ad48-1c5b22e62160]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c404c5e2-2c48-4ec4-890d-2be539bb0aad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:16:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-690d8912-27a2-4261-904a-96003c7ca99c tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 01:16:59 user nova-compute[74850]: No targets found.
Nov 14 01:16:59 user nova-compute[74850]: iSNS:
Nov 14 01:16:59 user nova-compute[74850]: No targets found.
Nov 14 01:16:59 user nova-compute[74850]: STATIC:
Nov 14 01:16:59 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:c404c5e2-2c48-4ec4-890d-2be539bb0aad
Nov 14 01:16:59 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:16:59 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:16:59 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e
Nov 14 01:16:59 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:16:59 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:16:59 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8
Nov 14 01:16:59 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:16:59 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:16:59 user nova-compute[74850]: FIRMWARE:
Nov 14 01:16:59 user nova-compute[74850]: No targets found.
Nov 14 01:16:59 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:16:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-690d8912-27a2-4261-904a-96003c7ca99c tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 01:16:59 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 01:16:59 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 01:16:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-690d8912-27a2-4261-904a-96003c7ca99c tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 01:16:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:16:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:16:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8a5c71-f0d9-45b3-9cd8-cf69c133877a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c404c5e2-2c48-4ec4-890d-2be539bb0aad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:16:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:16:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:16:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6a9b03-565d-420e-b32f-a79bfa216394]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404c5e2-2c48-4ec4-890d-2be539bb0aad (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:16:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-690d8912-27a2-4261-904a-96003c7ca99c tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e (non-flash)
Nov 14 01:16:59 user nova-compute[74850]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8 (non-flash)
Nov 14 01:16:59 user nova-compute[74850]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404c5e2-2c48-4ec4-890d-2be539bb0aad (non-flash)
Nov 14 01:16:59 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:16:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-690d8912-27a2-4261-904a-96003c7ca99c tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e (non-flash)
Nov 14 01:16:59 user nova-compute[74850]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8 (non-flash)
Nov 14 01:16:59 user nova-compute[74850]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404c5e2-2c48-4ec4-890d-2be539bb0aad (non-flash)
Nov 14 01:16:59 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:16:59 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-690d8912-27a2-4261-904a-96003c7ca99c tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a1c70fe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8'): ({'sdc'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 01:16:59 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-690d8912-27a2-4261-904a-96003c7ca99c tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Removing single pathed devices sdc {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 01:16:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:16:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:16:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43295fd-6159-41c7-b301-6c52a137b242]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:16:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:16:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:16:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a2d1ff-bb37-412d-9cb3-17a897c78c7a]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:16:59 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-690d8912-27a2-4261-904a-96003c7ca99c tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Flushing IO for device /dev/sdc {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 01:16:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:16:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:16:59 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4400bde1-4b6e-411d-8463-1c466192bb59]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:16:59 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-690d8912-27a2-4261-904a-96003c7ca99c tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 01:16:59 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:17:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:17:00 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e4591b-4033-4713-99ab-01e68e32132a]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:17:00 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-690d8912-27a2-4261-904a-96003c7ca99c tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 01:17:00 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-690d8912-27a2-4261-904a-96003c7ca99c tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] SCSI volumes sdc have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 01:17:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-690d8912-27a2-4261-904a-96003c7ca99c tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 01:17:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:17:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:17:00 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3d27b1-33bf-4a89-a664-e03fe7d8432c]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:17:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-690d8912-27a2-4261-904a-96003c7ca99c tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:17:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8 -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:17:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:17:00 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2845392e-74dc-424a-9320-1eaf05f03815]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:17:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-690d8912-27a2-4261-904a-96003c7ca99c tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8, portal: 172.16.0.220,3260]
Nov 14 01:17:00 user nova-compute[74850]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8, portal: 172.16.0.220,3260] successful.
Nov 14 01:17:00 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:17:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8 -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:17:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6867948a-6595-4b98-b788-4d0e00197cb8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:17:00 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[454a54ba-4cf8-4496-a132-a99bbda7e3cf]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:17:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-690d8912-27a2-4261-904a-96003c7ca99c tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:17:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-690d8912-27a2-4261-904a-96003c7ca99c tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:17:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-690d8912-27a2-4261-904a-96003c7ca99c tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] <== disconnect_volume: return (296ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:17:00 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-690d8912-27a2-4261-904a-96003c7ca99c tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 01:17:00 user nova-compute[74850]: DEBUG nova.objects.instance [None req-690d8912-27a2-4261-904a-96003c7ca99c tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lazy-loading 'flavor' on Instance uuid 2c18a949-25d9-4db9-bac5-b0b75d9a5751 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:17:00 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-690d8912-27a2-4261-904a-96003c7ca99c tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.697s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:17:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:17:04 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:17:04 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:17:04 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:17:04 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:17:04 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 01:17:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:17:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:17:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:17:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:17:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c18a949-25d9-4db9-bac5-b0b75d9a5751/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:17:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c18a949-25d9-4db9-bac5-b0b75d9a5751/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:17:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c18a949-25d9-4db9-bac5-b0b75d9a5751/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:17:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c18a949-25d9-4db9-bac5-b0b75d9a5751/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:17:06 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:17:06 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:17:06 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=8807MB free_disk=24.967323303222656GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 01:17:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:17:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:17:06 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 2c18a949-25d9-4db9-bac5-b0b75d9a5751 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:17:06 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 5416dd03-4161-4411-a74b-8d6a6e2e9f54 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:17:06 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 01:17:06 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 01:17:06 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:17:06 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:17:06 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 01:17:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.339s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:17:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:17:07 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:17:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:17:08 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:17:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:17:11 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:17:14 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:17:14 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 01:17:15 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:17:15 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 01:17:15 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Didn't find any instances for network info cache update. {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 01:17:15 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:17:16 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-e7ffa1c3-235b-4eda-be44-4fcf8abbea8d tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5416dd03-4161-4411-a74b-8d6a6e2e9f54 is timed out.
Nov 14 01:17:16 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-e7ffa1c3-235b-4eda-be44-4fcf8abbea8d tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Successfully detached device vdb from instance 5416dd03-4161-4411-a74b-8d6a6e2e9f54 from the live domain config.
Nov 14 01:17:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7ffa1c3-235b-4eda-be44-4fcf8abbea8d tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ffa1c3-235b-4eda-be44-4fcf8abbea8d tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hOUruvdN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:17:16 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-e7ffa1c3-235b-4eda-be44-4fcf8abbea8d tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:17:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-e7ffa1c3-235b-4eda-be44-4fcf8abbea8d tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-e7ffa1c3-235b-4eda-be44-4fcf8abbea8d tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59c5c2d-8693-4525-a3ed-74e0b16a0515]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ffa1c3-235b-4eda-be44-4fcf8abbea8d tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 01:17:16 user nova-compute[74850]: No targets found.
Nov 14 01:17:16 user nova-compute[74850]: iSNS:
Nov 14 01:17:16 user nova-compute[74850]: No targets found.
Nov 14 01:17:16 user nova-compute[74850]: STATIC:
Nov 14 01:17:16 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e
Nov 14 01:17:16 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:17:16 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:17:16 user nova-compute[74850]: FIRMWARE:
Nov 14 01:17:16 user nova-compute[74850]: No targets found.
Nov 14 01:17:16 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ffa1c3-235b-4eda-be44-4fcf8abbea8d tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 01:17:16 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 01:17:16 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ffa1c3-235b-4eda-be44-4fcf8abbea8d tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8769220b-9908-4e01-9948-100e6cc03236]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[683d2564-c6d1-4bb2-90f7-abe9cf287a01]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ffa1c3-235b-4eda-be44-4fcf8abbea8d tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e (non-flash)
Nov 14 01:17:16 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ffa1c3-235b-4eda-be44-4fcf8abbea8d tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e (non-flash)
Nov 14 01:17:16 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ffa1c3-235b-4eda-be44-4fcf8abbea8d tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a1c7800d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e'): ({'sdb'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-e7ffa1c3-235b-4eda-be44-4fcf8abbea8d tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Removing single pathed devices sdb {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba29824-0084-4af9-92d3-15cf2f687fe3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05aadda-9d23-433e-8d93-b8aa8835c2ce]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-e7ffa1c3-235b-4eda-be44-4fcf8abbea8d tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Flushing IO for device /dev/sdb {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[26df6622-7dd7-4e25-aa3a-564047527251]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-e7ffa1c3-235b-4eda-be44-4fcf8abbea8d tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[54496261-f53e-49bc-9ee9-bdf200218f83]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-e7ffa1c3-235b-4eda-be44-4fcf8abbea8d tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-e7ffa1c3-235b-4eda-be44-4fcf8abbea8d tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ffa1c3-235b-4eda-be44-4fcf8abbea8d tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5198ca-a112-456f-92ca-ff660a409daa]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ffa1c3-235b-4eda-be44-4fcf8abbea8d tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8acf41-5d99-4192-9d31-cb2e663fa674]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ffa1c3-235b-4eda-be44-4fcf8abbea8d tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e, portal: 172.16.0.220,3260]
Nov 14 01:17:16 user nova-compute[74850]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e, portal: 172.16.0.220,3260] successful.
Nov 14 01:17:16 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb6eb571-042a-4079-a0ee-31fff297435e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eea11c8-3f2b-4e51-91f8-a680c5f9c59d]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ffa1c3-235b-4eda-be44-4fcf8abbea8d tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-e7ffa1c3-235b-4eda-be44-4fcf8abbea8d tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ffa1c3-235b-4eda-be44-4fcf8abbea8d tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] <== disconnect_volume: return (274ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7ffa1c3-235b-4eda-be44-4fcf8abbea8d tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:17:16 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:17:17 user nova-compute[74850]: DEBUG nova.objects.instance [None req-e7ffa1c3-235b-4eda-be44-4fcf8abbea8d tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lazy-loading 'flavor' on Instance uuid 5416dd03-4161-4411-a74b-8d6a6e2e9f54 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:17:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e7ffa1c3-235b-4eda-be44-4fcf8abbea8d tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.573s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:17:19 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:17:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:17:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:17:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:17:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Acquiring lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:17:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:17:31 user nova-compute[74850]: DEBUG nova.objects.instance [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lazy-loading 'flavor' on Instance uuid 2c18a949-25d9-4db9-bac5-b0b75d9a5751 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:17:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:17:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Acquiring lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:17:31 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:17:31 user nova-compute[74850]: INFO nova.compute.manager [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Attaching volume 9c15498b-b10c-454c-813e-752ab05f0bcc to /dev/vdb
Nov 14 01:17:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:17:31 user nova-compute[74850]: DEBUG os_brick.utils [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:17:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:17:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:17:31 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[20120585-888a-4f0e-8863-c7e210e0024c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:17:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:17:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:17:31 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d0dd75-5fe0-4714-b6c9-5147a49fc2fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:17:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:17:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:17:31 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5d97d5-0500-4936-a85e-6d35604cf6a5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:17:31 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e23ca78-07b1-4ab7-b8dc-6c48b2eff453]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:17:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:17:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:17:31 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 01:17:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:17:31 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:17:31 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 01:17:31 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[353f19ea-0721-447c-a3f2-e920d5b4f8e2]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:17:31 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 01:17:31 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 01:17:31 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 01:17:31 user nova-compute[74850]: DEBUG os_brick.utils [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:17:31 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Updating existing volume attachment record: 39eace08-de8f-4c4b-b49f-b276962661f2 {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 01:17:35 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 01:17:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bzqEFeKW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:17:35 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:17:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:17:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:17:35 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:17:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:17:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:17:35 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 01:17:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:17:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:17:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff24d9f0-c778-420f-ac41-0f5ba055ea44]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:17:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 01:17:35 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:17:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:17:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.044s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:17:35 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1733342c-7e73-46d0-9e0c-4a14b1bdd95f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:17:35 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc] added
Nov 14 01:17:35 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:17:35 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.042s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efd05f5-21f3-4e33-a818-a38a0af0cbbc]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.045s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c904a0fb-4862-4d7d-bb3e-2d793d52ca06]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bzqEFeKW {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bzqEFeKW" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8f84d5-68cd-450e-b1cc-bdab55319e55]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bzqEFeKW'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef6411b-2fe5-4444-9e78-7d27dc291e7d]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6a3df2-7e1c-447d-b6f1-8a246b34f961]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 01:17:36 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 01:17:36 user nova-compute[74850]:  {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:17:36 user nova-compute[74850]: WARNING os_brick.initiator.connectors.iscsi [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 01:17:36 user nova-compute[74850]: 
Nov 14 01:17:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b193e7b-eedd-47d3-bb22-e2bd9869ef3f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc, portal: 172.16.0.220,3260]
Nov 14 01:17:36 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc, portal: 172.16.0.220,3260] successful.
Nov 14 01:17:36 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[26031985-96dd-4604-820c-b57a08a9b495]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94a1de6-da4c-4fa8-9ccd-d2f034255088]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc (non-flash)
Nov 14 01:17:36 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc (non-flash)
Nov 14 01:17:36 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fdbc41-d221-45ef-8228-a68a6b398c8f]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bzqEFeKW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 01:17:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:17:37 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:17:37 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '26233386262646533', 'path': '/dev/sdb'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:17:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233386262646533', 'path': '/dev/sdb'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 01:17:37 user nova-compute[74850]: DEBUG nova.objects.instance [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lazy-loading 'flavor' on Instance uuid 2c18a949-25d9-4db9-bac5-b0b75d9a5751 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:17:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 01:17:37 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:17:37 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 01:17:37 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:17:37 user nova-compute[74850]:   <serial>9c15498b-b10c-454c-813e-752ab05f0bcc</serial>
Nov 14 01:17:37 user nova-compute[74850]: </disk>
Nov 14 01:17:37 user nova-compute[74850]:  {{(pid=74850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 01:17:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:17:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:17:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] No VIF found with MAC fa:16:3e:92:61:d5, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:17:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-ff096309-1269-4d2d-954d-3e725e84f727 tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.252s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:17:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c23f8763-5a3d-438c-b1a0-ab1b20d71ebf tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Acquiring lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:17:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c23f8763-5a3d-438c-b1a0-ab1b20d71ebf tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:17:39 user nova-compute[74850]: INFO nova.compute.manager [None req-c23f8763-5a3d-438c-b1a0-ab1b20d71ebf tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Detaching volume 9c15498b-b10c-454c-813e-752ab05f0bcc
Nov 14 01:17:39 user nova-compute[74850]: INFO nova.virt.block_device [None req-c23f8763-5a3d-438c-b1a0-ab1b20d71ebf tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Attempting to driver detach volume 9c15498b-b10c-454c-813e-752ab05f0bcc from mountpoint /dev/vdb
Nov 14 01:17:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-c23f8763-5a3d-438c-b1a0-ab1b20d71ebf tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Attempting to detach device vdb from instance 2c18a949-25d9-4db9-bac5-b0b75d9a5751 from the persistent domain config. {{(pid=74850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 01:17:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-c23f8763-5a3d-438c-b1a0-ab1b20d71ebf tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:17:39 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:17:39 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 01:17:39 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:17:39 user nova-compute[74850]:   <serial>9c15498b-b10c-454c-813e-752ab05f0bcc</serial>
Nov 14 01:17:39 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 01:17:39 user nova-compute[74850]: </disk>
Nov 14 01:17:39 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:17:39 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-c23f8763-5a3d-438c-b1a0-ab1b20d71ebf tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Successfully detached device vdb from instance 2c18a949-25d9-4db9-bac5-b0b75d9a5751 from the persistent domain config.
Nov 14 01:17:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-c23f8763-5a3d-438c-b1a0-ab1b20d71ebf tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2c18a949-25d9-4db9-bac5-b0b75d9a5751 from the live domain config. {{(pid=74850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 01:17:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-c23f8763-5a3d-438c-b1a0-ab1b20d71ebf tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:17:39 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:17:39 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 01:17:39 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:17:39 user nova-compute[74850]:   <serial>9c15498b-b10c-454c-813e-752ab05f0bcc</serial>
Nov 14 01:17:39 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 01:17:39 user nova-compute[74850]: </disk>
Nov 14 01:17:39 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:17:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-c23f8763-5a3d-438c-b1a0-ab1b20d71ebf tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2c18a949-25d9-4db9-bac5-b0b75d9a5751 {{(pid=74850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 01:17:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:17:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:17:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:17:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-36dfccaa-c45c-47b4-aaa8-a3745fc4052e tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquiring lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:17:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-36dfccaa-c45c-47b4-aaa8-a3745fc4052e tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:17:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-36dfccaa-c45c-47b4-aaa8-a3745fc4052e tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquiring lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:17:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-36dfccaa-c45c-47b4-aaa8-a3745fc4052e tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:17:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-36dfccaa-c45c-47b4-aaa8-a3745fc4052e tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:17:47 user nova-compute[74850]: INFO nova.compute.manager [None req-36dfccaa-c45c-47b4-aaa8-a3745fc4052e tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Terminating instance
Nov 14 01:17:47 user nova-compute[74850]: DEBUG nova.compute.manager [None req-36dfccaa-c45c-47b4-aaa8-a3745fc4052e tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 01:17:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:17:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:17:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:17:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:17:47 user nova-compute[74850]: DEBUG nova.compute.manager [req-57752e23-3d08-4070-b3cf-582c0b051e91 req-7c2e7aa6-91a5-468e-919c-94cc217db780 service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Received event network-vif-unplugged-08667be8-256e-4d3c-b3a1-e65917c9c2c8 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:17:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-57752e23-3d08-4070-b3cf-582c0b051e91 req-7c2e7aa6-91a5-468e-919c-94cc217db780 service nova] Acquiring lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:17:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-57752e23-3d08-4070-b3cf-582c0b051e91 req-7c2e7aa6-91a5-468e-919c-94cc217db780 service nova] Lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:17:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-57752e23-3d08-4070-b3cf-582c0b051e91 req-7c2e7aa6-91a5-468e-919c-94cc217db780 service nova] Lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:17:47 user nova-compute[74850]: DEBUG nova.compute.manager [req-57752e23-3d08-4070-b3cf-582c0b051e91 req-7c2e7aa6-91a5-468e-919c-94cc217db780 service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] No waiting events found dispatching network-vif-unplugged-08667be8-256e-4d3c-b3a1-e65917c9c2c8 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:17:47 user nova-compute[74850]: DEBUG nova.compute.manager [req-57752e23-3d08-4070-b3cf-582c0b051e91 req-7c2e7aa6-91a5-468e-919c-94cc217db780 service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Received event network-vif-unplugged-08667be8-256e-4d3c-b3a1-e65917c9c2c8 for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 01:17:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:17:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:17:48 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Instance destroyed successfully.
Nov 14 01:17:48 user nova-compute[74850]: DEBUG nova.objects.instance [None req-36dfccaa-c45c-47b4-aaa8-a3745fc4052e tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lazy-loading 'resources' on Instance uuid 5416dd03-4161-4411-a74b-8d6a6e2e9f54 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:17:48 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-36dfccaa-c45c-47b4-aaa8-a3745fc4052e tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1246065015',display_name='tempest-TestMinimumBasicScenario-server-1246065015',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1246065015',id=50,image_ref='8ba8bd50-9091-4da9-9f92-78c3d236b684',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCle3EU/m/g9NKR8n+0V6pqHrWP89VQbKtrtNAoI/KQMQsZllveB7EoYMhQdEgVXwVfsjyPlHxXAhJrn14OjYkLuq3H0x9kXgNYXCap00oAFcwtZTMn2iW22mWyQxNulQA==',key_name='tempest-TestMinimumBasicScenario-1702432917',keypairs=<?>,launch_index=0,launched_at=2023-11-14T01:13:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0ae3f5d3814451c9c7d7264707c8334',ramdisk_id='',reservation_id='r-2c6xm05p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8ba8bd50-9091-4da9-9f92-78c3d236b684',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2056291063',owner_user_name='tempest-TestMinimumBasicScenario-2056291063-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T01:15:11Z,user_data=None,user_id='534b22e8e0c7495f8d2f89dec7e9a66c',uuid=5416dd03-4161-4411-a74b-8d6a6e2e9f54,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "address": "fa:16:3e:d5:a5:65", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08667be8-25", "ovs_interfaceid": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 01:17:48 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-36dfccaa-c45c-47b4-aaa8-a3745fc4052e tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Converting VIF {"id": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "address": "fa:16:3e:d5:a5:65", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08667be8-25", "ovs_interfaceid": "08667be8-256e-4d3c-b3a1-e65917c9c2c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:17:48 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-36dfccaa-c45c-47b4-aaa8-a3745fc4052e tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:a5:65,bridge_name='br-int',has_traffic_filtering=True,id=08667be8-256e-4d3c-b3a1-e65917c9c2c8,network=Network(7a6e0781-a6cd-4125-bdaf-9b9d53c4d254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08667be8-25') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:17:48 user nova-compute[74850]: DEBUG os_vif [None req-36dfccaa-c45c-47b4-aaa8-a3745fc4052e tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:a5:65,bridge_name='br-int',has_traffic_filtering=True,id=08667be8-256e-4d3c-b3a1-e65917c9c2c8,network=Network(7a6e0781-a6cd-4125-bdaf-9b9d53c4d254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08667be8-25') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 01:17:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:17:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08667be8-25, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:17:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:17:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:17:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:17:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=89268a52-4833-4d3a-9f78-6ef88d009343) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:17:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:17:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:17:48 user nova-compute[74850]: INFO os_vif [None req-36dfccaa-c45c-47b4-aaa8-a3745fc4052e tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:a5:65,bridge_name='br-int',has_traffic_filtering=True,id=08667be8-256e-4d3c-b3a1-e65917c9c2c8,network=Network(7a6e0781-a6cd-4125-bdaf-9b9d53c4d254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08667be8-25')
Nov 14 01:17:48 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-36dfccaa-c45c-47b4-aaa8-a3745fc4052e tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Deleting instance files /opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54_del
Nov 14 01:17:48 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-36dfccaa-c45c-47b4-aaa8-a3745fc4052e tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Deletion of /opt/stack/data/nova/instances/5416dd03-4161-4411-a74b-8d6a6e2e9f54_del complete
Nov 14 01:17:48 user nova-compute[74850]: INFO nova.compute.manager [None req-36dfccaa-c45c-47b4-aaa8-a3745fc4052e tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 14 01:17:48 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-36dfccaa-c45c-47b4-aaa8-a3745fc4052e tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 01:17:48 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 01:17:48 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 01:17:48 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:17:48 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Took 0.45 seconds to deallocate network for instance.
Nov 14 01:17:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-36dfccaa-c45c-47b4-aaa8-a3745fc4052e tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:17:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-36dfccaa-c45c-47b4-aaa8-a3745fc4052e tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:17:48 user nova-compute[74850]: DEBUG nova.compute.manager [req-eff48b99-81e5-45e8-9b6a-12a7636c9da4 req-dc5c61ed-7d39-461e-ae48-bd6c96a2ae1e service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Received event network-vif-deleted-08667be8-256e-4d3c-b3a1-e65917c9c2c8 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:17:48 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-36dfccaa-c45c-47b4-aaa8-a3745fc4052e tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Refreshing inventories for resource provider fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 01:17:48 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-36dfccaa-c45c-47b4-aaa8-a3745fc4052e tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Updating ProviderTree inventory for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 01:17:48 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-36dfccaa-c45c-47b4-aaa8-a3745fc4052e tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Updating inventory in ProviderTree for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 01:17:48 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-36dfccaa-c45c-47b4-aaa8-a3745fc4052e tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Refreshing aggregate associations for resource provider fe703abb-f68c-420d-a7f0-bf5240e23c54, aggregates: None {{(pid=74850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 01:17:48 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-36dfccaa-c45c-47b4-aaa8-a3745fc4052e tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Refreshing trait associations for resource provider fe703abb-f68c-420d-a7f0-bf5240e23c54, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 01:17:48 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-36dfccaa-c45c-47b4-aaa8-a3745fc4052e tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:17:49 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-36dfccaa-c45c-47b4-aaa8-a3745fc4052e tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:17:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-36dfccaa-c45c-47b4-aaa8-a3745fc4052e tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:17:49 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-36dfccaa-c45c-47b4-aaa8-a3745fc4052e tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Deleted allocations for instance 5416dd03-4161-4411-a74b-8d6a6e2e9f54
Nov 14 01:17:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-36dfccaa-c45c-47b4-aaa8-a3745fc4052e tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.802s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:17:49 user nova-compute[74850]: DEBUG nova.compute.manager [req-be6ed7d6-323d-44bb-9a23-a16a531d4ade req-7e76de13-7871-4f5d-a16a-f93a97d756fa service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Received event network-vif-plugged-08667be8-256e-4d3c-b3a1-e65917c9c2c8 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:17:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-be6ed7d6-323d-44bb-9a23-a16a531d4ade req-7e76de13-7871-4f5d-a16a-f93a97d756fa service nova] Acquiring lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:17:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-be6ed7d6-323d-44bb-9a23-a16a531d4ade req-7e76de13-7871-4f5d-a16a-f93a97d756fa service nova] Lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:17:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-be6ed7d6-323d-44bb-9a23-a16a531d4ade req-7e76de13-7871-4f5d-a16a-f93a97d756fa service nova] Lock "5416dd03-4161-4411-a74b-8d6a6e2e9f54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:17:49 user nova-compute[74850]: DEBUG nova.compute.manager [req-be6ed7d6-323d-44bb-9a23-a16a531d4ade req-7e76de13-7871-4f5d-a16a-f93a97d756fa service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] No waiting events found dispatching network-vif-plugged-08667be8-256e-4d3c-b3a1-e65917c9c2c8 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:17:49 user nova-compute[74850]: WARNING nova.compute.manager [req-be6ed7d6-323d-44bb-9a23-a16a531d4ade req-7e76de13-7871-4f5d-a16a-f93a97d756fa service nova] [instance: 5416dd03-4161-4411-a74b-8d6a6e2e9f54] Received unexpected event network-vif-plugged-08667be8-256e-4d3c-b3a1-e65917c9c2c8 for instance with vm_state deleted and task_state None.
Nov 14 01:17:53 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:17:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:17:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:17:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74850) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 01:17:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:17:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:17:58 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:18:00 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-c23f8763-5a3d-438c-b1a0-ab1b20d71ebf tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2c18a949-25d9-4db9-bac5-b0b75d9a5751 is timed out.
Nov 14 01:18:00 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-c23f8763-5a3d-438c-b1a0-ab1b20d71ebf tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Successfully detached device vdb from instance 2c18a949-25d9-4db9-bac5-b0b75d9a5751 from the live domain config.
Nov 14 01:18:00 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c23f8763-5a3d-438c-b1a0-ab1b20d71ebf tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23f8763-5a3d-438c-b1a0-ab1b20d71ebf tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bzqEFeKW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:18:00 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-c23f8763-5a3d-438c-b1a0-ab1b20d71ebf tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:18:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-c23f8763-5a3d-438c-b1a0-ab1b20d71ebf tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-c23f8763-5a3d-438c-b1a0-ab1b20d71ebf tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[221e013f-96fc-482e-aa97-c79d1febddc8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23f8763-5a3d-438c-b1a0-ab1b20d71ebf tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 01:18:00 user nova-compute[74850]: No targets found.
Nov 14 01:18:00 user nova-compute[74850]: iSNS:
Nov 14 01:18:00 user nova-compute[74850]: No targets found.
Nov 14 01:18:00 user nova-compute[74850]: STATIC:
Nov 14 01:18:00 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc
Nov 14 01:18:00 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:18:00 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:18:00 user nova-compute[74850]: FIRMWARE:
Nov 14 01:18:00 user nova-compute[74850]: No targets found.
Nov 14 01:18:00 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23f8763-5a3d-438c-b1a0-ab1b20d71ebf tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 01:18:00 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 01:18:00 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23f8763-5a3d-438c-b1a0-ab1b20d71ebf tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d64bb9b-7ae5-496f-8594-2f90a61721fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a77a874-86e7-4aaa-8780-23b2bcc505eb]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23f8763-5a3d-438c-b1a0-ab1b20d71ebf tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc (non-flash)
Nov 14 01:18:00 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23f8763-5a3d-438c-b1a0-ab1b20d71ebf tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc (non-flash)
Nov 14 01:18:00 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23f8763-5a3d-438c-b1a0-ab1b20d71ebf tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a1c7a8700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc'): ({'sdb'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-c23f8763-5a3d-438c-b1a0-ab1b20d71ebf tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Removing single pathed devices sdb {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1247bbc9-bc91-4138-af08-4bd2c548ff51]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f4259a-ef26-4a65-8f07-a092f43d1320]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-c23f8763-5a3d-438c-b1a0-ab1b20d71ebf tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Flushing IO for device /dev/sdb {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a13c44-8430-45d0-9d7b-5405f7e82fc0]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-c23f8763-5a3d-438c-b1a0-ab1b20d71ebf tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66ab5d8-11f2-4d11-b84c-379236be74c4]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-c23f8763-5a3d-438c-b1a0-ab1b20d71ebf tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-c23f8763-5a3d-438c-b1a0-ab1b20d71ebf tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23f8763-5a3d-438c-b1a0-ab1b20d71ebf tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78e8e25-d80e-49d6-a3de-8aac8911d16b]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23f8763-5a3d-438c-b1a0-ab1b20d71ebf tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[905caf25-af0f-4ec7-8c5c-05ef6bbd7fe8]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23f8763-5a3d-438c-b1a0-ab1b20d71ebf tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc, portal: 172.16.0.220,3260]
Nov 14 01:18:00 user nova-compute[74850]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc, portal: 172.16.0.220,3260] successful.
Nov 14 01:18:00 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c15498b-b10c-454c-813e-752ab05f0bcc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[70549914-fc9e-4f4e-aee6-0cf36bfe18f6]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23f8763-5a3d-438c-b1a0-ab1b20d71ebf tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-c23f8763-5a3d-438c-b1a0-ab1b20d71ebf tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23f8763-5a3d-438c-b1a0-ab1b20d71ebf tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] <== disconnect_volume: return (291ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:18:00 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c23f8763-5a3d-438c-b1a0-ab1b20d71ebf tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 01:18:01 user nova-compute[74850]: DEBUG nova.objects.instance [None req-c23f8763-5a3d-438c-b1a0-ab1b20d71ebf tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lazy-loading 'flavor' on Instance uuid 2c18a949-25d9-4db9-bac5-b0b75d9a5751 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:18:01 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c23f8763-5a3d-438c-b1a0-ab1b20d71ebf tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.619s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:18:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:18:04 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:18:04 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:18:04 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:18:04 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:18:04 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 01:18:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c18a949-25d9-4db9-bac5-b0b75d9a5751/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:18:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c18a949-25d9-4db9-bac5-b0b75d9a5751/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:18:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c18a949-25d9-4db9-bac5-b0b75d9a5751/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:18:05 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c18a949-25d9-4db9-bac5-b0b75d9a5751/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:18:05 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:18:05 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:18:05 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=8950MB free_disk=24.993141174316406GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 01:18:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:18:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:18:05 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 2c18a949-25d9-4db9-bac5-b0b75d9a5751 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:18:05 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 01:18:05 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 01:18:05 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:18:05 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:18:05 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 01:18:05 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:18:08 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:18:08 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:18:10 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:18:13 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:18:13 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:18:13 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74850) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 01:18:13 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:18:13 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:18:13 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:18:13 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:18:15 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:18:15 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 01:18:15 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Rebuilding the list of instances to heal {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 01:18:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "refresh_cache-2c18a949-25d9-4db9-bac5-b0b75d9a5751" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:18:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquired lock "refresh_cache-2c18a949-25d9-4db9-bac5-b0b75d9a5751" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:18:15 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Forcefully refreshing network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 01:18:15 user nova-compute[74850]: DEBUG nova.objects.instance [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lazy-loading 'info_cache' on Instance uuid 2c18a949-25d9-4db9-bac5-b0b75d9a5751 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:18:16 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Updating instance_info_cache with network_info: [{"id": "a4ec3961-14e9-4085-8eca-c16a32d436f0", "address": "fa:16:3e:92:61:d5", "network": {"id": "40ed88df-3a5a-4029-a9b5-4c73221823fa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1084755377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b811df14b33a498db8a1a7eb95c5bb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ec3961-14", "ovs_interfaceid": "a4ec3961-14e9-4085-8eca-c16a32d436f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:18:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Releasing lock "refresh_cache-2c18a949-25d9-4db9-bac5-b0b75d9a5751" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:18:16 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Updated the network info_cache for instance {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 01:18:16 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:18:16 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:18:16 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 01:18:17 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:18:17 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:18:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:18:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:18:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:18:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:18:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74850) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 01:18:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:18:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:18:28 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:18:33 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:18:38 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:18:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-0112f934-d2be-42a3-96b3-f2b2f14df04d tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Acquiring lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:18:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-0112f934-d2be-42a3-96b3-f2b2f14df04d tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.008s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:18:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-0112f934-d2be-42a3-96b3-f2b2f14df04d tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Acquiring lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:18:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-0112f934-d2be-42a3-96b3-f2b2f14df04d tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:18:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-0112f934-d2be-42a3-96b3-f2b2f14df04d tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:18:39 user nova-compute[74850]: INFO nova.compute.manager [None req-0112f934-d2be-42a3-96b3-f2b2f14df04d tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Terminating instance
Nov 14 01:18:39 user nova-compute[74850]: DEBUG nova.compute.manager [None req-0112f934-d2be-42a3-96b3-f2b2f14df04d tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 01:18:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:18:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:18:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:18:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:18:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:18:39 user nova-compute[74850]: DEBUG nova.compute.manager [req-77072d25-08be-4fe5-9c47-da330d700e75 req-7a1d42a2-de1d-4489-a113-4ed96aca8c90 service nova] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Received event network-vif-unplugged-a4ec3961-14e9-4085-8eca-c16a32d436f0 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:18:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-77072d25-08be-4fe5-9c47-da330d700e75 req-7a1d42a2-de1d-4489-a113-4ed96aca8c90 service nova] Acquiring lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:18:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-77072d25-08be-4fe5-9c47-da330d700e75 req-7a1d42a2-de1d-4489-a113-4ed96aca8c90 service nova] Lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:18:39 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-77072d25-08be-4fe5-9c47-da330d700e75 req-7a1d42a2-de1d-4489-a113-4ed96aca8c90 service nova] Lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:18:39 user nova-compute[74850]: DEBUG nova.compute.manager [req-77072d25-08be-4fe5-9c47-da330d700e75 req-7a1d42a2-de1d-4489-a113-4ed96aca8c90 service nova] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] No waiting events found dispatching network-vif-unplugged-a4ec3961-14e9-4085-8eca-c16a32d436f0 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:18:39 user nova-compute[74850]: DEBUG nova.compute.manager [req-77072d25-08be-4fe5-9c47-da330d700e75 req-7a1d42a2-de1d-4489-a113-4ed96aca8c90 service nova] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Received event network-vif-unplugged-a4ec3961-14e9-4085-8eca-c16a32d436f0 for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 01:18:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:18:40 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Instance destroyed successfully.
Nov 14 01:18:40 user nova-compute[74850]: DEBUG nova.objects.instance [None req-0112f934-d2be-42a3-96b3-f2b2f14df04d tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lazy-loading 'resources' on Instance uuid 2c18a949-25d9-4db9-bac5-b0b75d9a5751 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:18:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-0112f934-d2be-42a3-96b3-f2b2f14df04d tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:12:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1758729225',display_name='tempest-SnapshotDataIntegrityTests-server-1758729225',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1758729225',id=49,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+B6b5nZKS/9y8Mg9FkFUYeGFoLPQW6HXw0aiNEQHO6eZ6gQe0zSRx28kCZQRIkRl+9He2UywLuYEs5o716oQN/uqSnLxRVvhrY5AMwVJjcQhb/lmOIKIuOthgw8ZUslg==',key_name='tempest-keypair-1221671008',keypairs=<?>,launch_index=0,launched_at=2023-11-14T01:12:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b811df14b33a498db8a1a7eb95c5bb5a',ramdisk_id='',reservation_id='r-8wtwq0yx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-266495953',owner_user_name='tempest-SnapshotDataIntegrityTests-266495953-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T01:12:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41daaa95d5be4e4f9587ca00c14ce962',uuid=2c18a949-25d9-4db9-bac5-b0b75d9a5751,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4ec3961-14e9-4085-8eca-c16a32d436f0", "address": "fa:16:3e:92:61:d5", "network": {"id": "40ed88df-3a5a-4029-a9b5-4c73221823fa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1084755377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b811df14b33a498db8a1a7eb95c5bb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ec3961-14", "ovs_interfaceid": "a4ec3961-14e9-4085-8eca-c16a32d436f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 01:18:40 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-0112f934-d2be-42a3-96b3-f2b2f14df04d tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Converting VIF {"id": "a4ec3961-14e9-4085-8eca-c16a32d436f0", "address": "fa:16:3e:92:61:d5", "network": {"id": "40ed88df-3a5a-4029-a9b5-4c73221823fa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1084755377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b811df14b33a498db8a1a7eb95c5bb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ec3961-14", "ovs_interfaceid": "a4ec3961-14e9-4085-8eca-c16a32d436f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:18:40 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-0112f934-d2be-42a3-96b3-f2b2f14df04d tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:61:d5,bridge_name='br-int',has_traffic_filtering=True,id=a4ec3961-14e9-4085-8eca-c16a32d436f0,network=Network(40ed88df-3a5a-4029-a9b5-4c73221823fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4ec3961-14') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:18:40 user nova-compute[74850]: DEBUG os_vif [None req-0112f934-d2be-42a3-96b3-f2b2f14df04d tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:61:d5,bridge_name='br-int',has_traffic_filtering=True,id=a4ec3961-14e9-4085-8eca-c16a32d436f0,network=Network(40ed88df-3a5a-4029-a9b5-4c73221823fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4ec3961-14') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 01:18:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:18:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4ec3961-14, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:18:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:18:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:18:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:18:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ca222bec-eb55-4845-8bea-140f58570568) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:18:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:18:40 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:18:40 user nova-compute[74850]: INFO os_vif [None req-0112f934-d2be-42a3-96b3-f2b2f14df04d tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:61:d5,bridge_name='br-int',has_traffic_filtering=True,id=a4ec3961-14e9-4085-8eca-c16a32d436f0,network=Network(40ed88df-3a5a-4029-a9b5-4c73221823fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4ec3961-14')
Nov 14 01:18:40 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-0112f934-d2be-42a3-96b3-f2b2f14df04d tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Deleting instance files /opt/stack/data/nova/instances/2c18a949-25d9-4db9-bac5-b0b75d9a5751_del
Nov 14 01:18:40 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-0112f934-d2be-42a3-96b3-f2b2f14df04d tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Deletion of /opt/stack/data/nova/instances/2c18a949-25d9-4db9-bac5-b0b75d9a5751_del complete
Nov 14 01:18:40 user nova-compute[74850]: INFO nova.compute.manager [None req-0112f934-d2be-42a3-96b3-f2b2f14df04d tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 14 01:18:40 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-0112f934-d2be-42a3-96b3-f2b2f14df04d tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 01:18:40 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 01:18:40 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 01:18:41 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:18:41 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Took 1.00 seconds to deallocate network for instance.
Nov 14 01:18:41 user nova-compute[74850]: DEBUG nova.compute.manager [req-bca6d54e-992d-432c-9b91-94615b64b332 req-34d2d4e1-5eb4-4ca9-9379-549f33982b2c service nova] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Received event network-vif-deleted-a4ec3961-14e9-4085-8eca-c16a32d436f0 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:18:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-0112f934-d2be-42a3-96b3-f2b2f14df04d tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:18:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-0112f934-d2be-42a3-96b3-f2b2f14df04d tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:18:41 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-0112f934-d2be-42a3-96b3-f2b2f14df04d tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:18:41 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-0112f934-d2be-42a3-96b3-f2b2f14df04d tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:18:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-0112f934-d2be-42a3-96b3-f2b2f14df04d tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.105s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:18:41 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-0112f934-d2be-42a3-96b3-f2b2f14df04d tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Deleted allocations for instance 2c18a949-25d9-4db9-bac5-b0b75d9a5751
Nov 14 01:18:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-0112f934-d2be-42a3-96b3-f2b2f14df04d tempest-SnapshotDataIntegrityTests-266495953 tempest-SnapshotDataIntegrityTests-266495953-project-member] Lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.190s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:18:41 user nova-compute[74850]: DEBUG nova.compute.manager [req-61c79b86-ef39-42d7-83a6-e04414216d0e req-3b08c7d7-207d-4e9e-9089-b60c72802fe9 service nova] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Received event network-vif-plugged-a4ec3961-14e9-4085-8eca-c16a32d436f0 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:18:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-61c79b86-ef39-42d7-83a6-e04414216d0e req-3b08c7d7-207d-4e9e-9089-b60c72802fe9 service nova] Acquiring lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:18:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-61c79b86-ef39-42d7-83a6-e04414216d0e req-3b08c7d7-207d-4e9e-9089-b60c72802fe9 service nova] Lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:18:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-61c79b86-ef39-42d7-83a6-e04414216d0e req-3b08c7d7-207d-4e9e-9089-b60c72802fe9 service nova] Lock "2c18a949-25d9-4db9-bac5-b0b75d9a5751-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:18:41 user nova-compute[74850]: DEBUG nova.compute.manager [req-61c79b86-ef39-42d7-83a6-e04414216d0e req-3b08c7d7-207d-4e9e-9089-b60c72802fe9 service nova] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] No waiting events found dispatching network-vif-plugged-a4ec3961-14e9-4085-8eca-c16a32d436f0 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:18:41 user nova-compute[74850]: WARNING nova.compute.manager [req-61c79b86-ef39-42d7-83a6-e04414216d0e req-3b08c7d7-207d-4e9e-9089-b60c72802fe9 service nova] [instance: 2c18a949-25d9-4db9-bac5-b0b75d9a5751] Received unexpected event network-vif-plugged-a4ec3961-14e9-4085-8eca-c16a32d436f0 for instance with vm_state deleted and task_state None.
Nov 14 01:18:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquiring lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:18:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:18:41 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 01:18:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:18:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:18:41 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 01:18:41 user nova-compute[74850]: INFO nova.compute.claims [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Claim successful on node user
Nov 14 01:18:41 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:18:41 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:18:41 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.176s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:18:41 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 01:18:41 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 01:18:41 user nova-compute[74850]: DEBUG nova.network.neutron [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 01:18:41 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 01:18:41 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 01:18:42 user nova-compute[74850]: DEBUG nova.policy [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '534b22e8e0c7495f8d2f89dec7e9a66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ae3f5d3814451c9c7d7264707c8334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 01:18:42 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 01:18:42 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 01:18:42 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Creating image(s)
Nov 14 01:18:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquiring lock "/opt/stack/data/nova/instances/cae7cbe7-3337-4a3a-b93b-4a1bf61c8253/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:18:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "/opt/stack/data/nova/instances/cae7cbe7-3337-4a3a-b93b-4a1bf61c8253/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:18:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "/opt/stack/data/nova/instances/cae7cbe7-3337-4a3a-b93b-4a1bf61c8253/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:18:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquiring lock "4b2cbae98865ae56e1bf962cf7ea3f8a49af6413" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:18:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "4b2cbae98865ae56e1bf962cf7ea3f8a49af6413" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:18:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b2cbae98865ae56e1bf962cf7ea3f8a49af6413.part --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:18:42 user nova-compute[74850]: DEBUG nova.network.neutron [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Successfully created port: c9346a49-fcbf-4871-af15-5a3b10b48793 {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 01:18:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b2cbae98865ae56e1bf962cf7ea3f8a49af6413.part --force-share --output=json" returned: 0 in 0.183s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:18:42 user nova-compute[74850]: DEBUG nova.virt.images [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] 28ddc848-21fb-4671-b317-f580045c9b35 was qcow2, converting to raw {{(pid=74850) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 01:18:42 user nova-compute[74850]: DEBUG nova.privsep.utils [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74850) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 01:18:42 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4b2cbae98865ae56e1bf962cf7ea3f8a49af6413.part /opt/stack/data/nova/instances/_base/4b2cbae98865ae56e1bf962cf7ea3f8a49af6413.converted {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:18:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4b2cbae98865ae56e1bf962cf7ea3f8a49af6413.part /opt/stack/data/nova/instances/_base/4b2cbae98865ae56e1bf962cf7ea3f8a49af6413.converted" returned: 0 in 0.707s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:18:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b2cbae98865ae56e1bf962cf7ea3f8a49af6413.converted --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:18:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b2cbae98865ae56e1bf962cf7ea3f8a49af6413.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:18:43 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "4b2cbae98865ae56e1bf962cf7ea3f8a49af6413" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.639s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:18:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b2cbae98865ae56e1bf962cf7ea3f8a49af6413 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:18:43 user nova-compute[74850]: DEBUG nova.network.neutron [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Successfully updated port: c9346a49-fcbf-4871-af15-5a3b10b48793 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 01:18:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b2cbae98865ae56e1bf962cf7ea3f8a49af6413 --force-share --output=json" returned: 0 in 0.184s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:18:43 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquiring lock "4b2cbae98865ae56e1bf962cf7ea3f8a49af6413" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:18:43 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "4b2cbae98865ae56e1bf962cf7ea3f8a49af6413" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:18:43 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b2cbae98865ae56e1bf962cf7ea3f8a49af6413 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:18:43 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquiring lock "refresh_cache-cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:18:43 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquired lock "refresh_cache-cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:18:43 user nova-compute[74850]: DEBUG nova.network.neutron [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 01:18:43 user nova-compute[74850]: DEBUG nova.compute.manager [req-e7cdce43-14e6-436a-bc7a-048b37817923 req-3c8b4a06-d878-416b-8b9e-1558bb3bc71d service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Received event network-changed-c9346a49-fcbf-4871-af15-5a3b10b48793 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:18:43 user nova-compute[74850]: DEBUG nova.compute.manager [req-e7cdce43-14e6-436a-bc7a-048b37817923 req-3c8b4a06-d878-416b-8b9e-1558bb3bc71d service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Refreshing instance network info cache due to event network-changed-c9346a49-fcbf-4871-af15-5a3b10b48793. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:18:43 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e7cdce43-14e6-436a-bc7a-048b37817923 req-3c8b4a06-d878-416b-8b9e-1558bb3bc71d service nova] Acquiring lock "refresh_cache-cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG nova.network.neutron [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b2cbae98865ae56e1bf962cf7ea3f8a49af6413 --force-share --output=json" returned: 0 in 0.172s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4b2cbae98865ae56e1bf962cf7ea3f8a49af6413,backing_fmt=raw /opt/stack/data/nova/instances/cae7cbe7-3337-4a3a-b93b-4a1bf61c8253/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4b2cbae98865ae56e1bf962cf7ea3f8a49af6413,backing_fmt=raw /opt/stack/data/nova/instances/cae7cbe7-3337-4a3a-b93b-4a1bf61c8253/disk 1073741824" returned: 0 in 0.047s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "4b2cbae98865ae56e1bf962cf7ea3f8a49af6413" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b2cbae98865ae56e1bf962cf7ea3f8a49af6413 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG nova.network.neutron [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Updating instance_info_cache with network_info: [{"id": "c9346a49-fcbf-4871-af15-5a3b10b48793", "address": "fa:16:3e:de:47:f9", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9346a49-fc", "ovs_interfaceid": "c9346a49-fcbf-4871-af15-5a3b10b48793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b2cbae98865ae56e1bf962cf7ea3f8a49af6413 --force-share --output=json" returned: 0 in 0.176s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cae7cbe7-3337-4a3a-b93b-4a1bf61c8253/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae7cbe7-3337-4a3a-b93b-4a1bf61c8253/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Releasing lock "refresh_cache-cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Instance network_info: |[{"id": "c9346a49-fcbf-4871-af15-5a3b10b48793", "address": "fa:16:3e:de:47:f9", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9346a49-fc", "ovs_interfaceid": "c9346a49-fcbf-4871-af15-5a3b10b48793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e7cdce43-14e6-436a-bc7a-048b37817923 req-3c8b4a06-d878-416b-8b9e-1558bb3bc71d service nova] Acquired lock "refresh_cache-cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG nova.network.neutron [req-e7cdce43-14e6-436a-bc7a-048b37817923 req-3c8b4a06-d878-416b-8b9e-1558bb3bc71d service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Refreshing network info cache for port c9346a49-fcbf-4871-af15-5a3b10b48793 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae7cbe7-3337-4a3a-b93b-4a1bf61c8253/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Cannot resize image /opt/stack/data/nova/instances/cae7cbe7-3337-4a3a-b93b-4a1bf61c8253/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Ensure instance console log exists: /opt/stack/data/nova/instances/cae7cbe7-3337-4a3a-b93b-4a1bf61c8253/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Start _get_guest_xml network_info=[{"id": "c9346a49-fcbf-4871-af15-5a3b10b48793", "address": "fa:16:3e:de:47:f9", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9346a49-fc", "ovs_interfaceid": "c9346a49-fcbf-4871-af15-5a3b10b48793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T01:18:39Z,direct_url=<?>,disk_format='qcow2',id=28ddc848-21fb-4671-b317-f580045c9b35,min_disk=0,min_ram=0,name='tempest-scenario-img--1480370178',owner='e0ae3f5d3814451c9c7d7264707c8334',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T01:18:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '28ddc848-21fb-4671-b317-f580045c9b35'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 01:18:44 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:18:44 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:18:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T01:18:39Z,direct_url=<?>,disk_format='qcow2',id=28ddc848-21fb-4671-b317-f580045c9b35,min_disk=0,min_ram=0,name='tempest-scenario-img--1480370178',owner='e0ae3f5d3814451c9c7d7264707c8334',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T01:18:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:18:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-53983429',display_name='tempest-TestMinimumBasicScenario-server-53983429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-53983429',id=52,image_ref='28ddc848-21fb-4671-b317-f580045c9b35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCccf422bLKzQeIR6K/v485zTwgeFOktQIP4/VxAjzOZhyWA6TyJ9it1cdukEz1KdSOMWp86fuaBzrcqkz9V6adFuHZxPvlzawfZIIDRoy0l0FeHGNlDoqtP4EgTIzAGlA==',key_name='tempest-TestMinimumBasicScenario-1922317015',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0ae3f5d3814451c9c7d7264707c8334',ramdisk_id='',reservation_id='r-3s1kktvq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='28ddc848-21fb-4671-b317-f580045c9b35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2056291063',owner_user_name='tempest-TestMinimumBasicScenario-2056291063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:18:42Z,user_data=None,user_id='534b22e8e0c7495f8d2f89dec7e9a66c',uuid=cae7cbe7-3337-4a3a-b93b-4a1bf61c8253,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9346a49-fcbf-4871-af15-5a3b10b48793", "address": "fa:16:3e:de:47:f9", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9346a49-fc", "ovs_interfaceid": "c9346a49-fcbf-4871-af15-5a3b10b48793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Converting VIF {"id": "c9346a49-fcbf-4871-af15-5a3b10b48793", "address": "fa:16:3e:de:47:f9", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9346a49-fc", "ovs_interfaceid": "c9346a49-fcbf-4871-af15-5a3b10b48793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:47:f9,bridge_name='br-int',has_traffic_filtering=True,id=c9346a49-fcbf-4871-af15-5a3b10b48793,network=Network(7a6e0781-a6cd-4125-bdaf-9b9d53c4d254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9346a49-fc') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG nova.objects.instance [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lazy-loading 'pci_devices' on Instance uuid cae7cbe7-3337-4a3a-b93b-4a1bf61c8253 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] End _get_guest_xml xml=<domain type="kvm">
Nov 14 01:18:44 user nova-compute[74850]:   <uuid>cae7cbe7-3337-4a3a-b93b-4a1bf61c8253</uuid>
Nov 14 01:18:44 user nova-compute[74850]:   <name>instance-00000034</name>
Nov 14 01:18:44 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 01:18:44 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 01:18:44 user nova-compute[74850]:   <metadata>
Nov 14 01:18:44 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 01:18:44 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 01:18:44 user nova-compute[74850]:       <nova:name>tempest-TestMinimumBasicScenario-server-53983429</nova:name>
Nov 14 01:18:44 user nova-compute[74850]:       <nova:creationTime>2023-11-14 01:18:44</nova:creationTime>
Nov 14 01:18:44 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 01:18:44 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 01:18:44 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 01:18:44 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 01:18:44 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 01:18:44 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 01:18:44 user nova-compute[74850]:       </nova:flavor>
Nov 14 01:18:44 user nova-compute[74850]:       <nova:owner>
Nov 14 01:18:44 user nova-compute[74850]:         <nova:user uuid="534b22e8e0c7495f8d2f89dec7e9a66c">tempest-TestMinimumBasicScenario-2056291063-project-member</nova:user>
Nov 14 01:18:44 user nova-compute[74850]:         <nova:project uuid="e0ae3f5d3814451c9c7d7264707c8334">tempest-TestMinimumBasicScenario-2056291063</nova:project>
Nov 14 01:18:44 user nova-compute[74850]:       </nova:owner>
Nov 14 01:18:44 user nova-compute[74850]:       <nova:root type="image" uuid="28ddc848-21fb-4671-b317-f580045c9b35"/>
Nov 14 01:18:44 user nova-compute[74850]:       <nova:ports>
Nov 14 01:18:44 user nova-compute[74850]:         <nova:port uuid="c9346a49-fcbf-4871-af15-5a3b10b48793">
Nov 14 01:18:44 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 01:18:44 user nova-compute[74850]:         </nova:port>
Nov 14 01:18:44 user nova-compute[74850]:       </nova:ports>
Nov 14 01:18:44 user nova-compute[74850]:     </nova:instance>
Nov 14 01:18:44 user nova-compute[74850]:   </metadata>
Nov 14 01:18:44 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 01:18:44 user nova-compute[74850]:     <system>
Nov 14 01:18:44 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 01:18:44 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 01:18:44 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 01:18:44 user nova-compute[74850]:       <entry name="serial">cae7cbe7-3337-4a3a-b93b-4a1bf61c8253</entry>
Nov 14 01:18:44 user nova-compute[74850]:       <entry name="uuid">cae7cbe7-3337-4a3a-b93b-4a1bf61c8253</entry>
Nov 14 01:18:44 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 01:18:44 user nova-compute[74850]:     </system>
Nov 14 01:18:44 user nova-compute[74850]:   </sysinfo>
Nov 14 01:18:44 user nova-compute[74850]:   <os>
Nov 14 01:18:44 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 01:18:44 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 01:18:44 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 01:18:44 user nova-compute[74850]:   </os>
Nov 14 01:18:44 user nova-compute[74850]:   <features>
Nov 14 01:18:44 user nova-compute[74850]:     <acpi/>
Nov 14 01:18:44 user nova-compute[74850]:     <apic/>
Nov 14 01:18:44 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 01:18:44 user nova-compute[74850]:   </features>
Nov 14 01:18:44 user nova-compute[74850]:   <clock offset="utc">
Nov 14 01:18:44 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 01:18:44 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 01:18:44 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 01:18:44 user nova-compute[74850]:   </clock>
Nov 14 01:18:44 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 01:18:44 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 01:18:44 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 01:18:44 user nova-compute[74850]:   </cpu>
Nov 14 01:18:44 user nova-compute[74850]:   <devices>
Nov 14 01:18:44 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 01:18:44 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 01:18:44 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/cae7cbe7-3337-4a3a-b93b-4a1bf61c8253/disk"/>
Nov 14 01:18:44 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 01:18:44 user nova-compute[74850]:     </disk>
Nov 14 01:18:44 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 01:18:44 user nova-compute[74850]:       <mac address="fa:16:3e:de:47:f9"/>
Nov 14 01:18:44 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:18:44 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 01:18:44 user nova-compute[74850]:       <target dev="tapc9346a49-fc"/>
Nov 14 01:18:44 user nova-compute[74850]:     </interface>
Nov 14 01:18:44 user nova-compute[74850]:     <serial type="pty">
Nov 14 01:18:44 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/cae7cbe7-3337-4a3a-b93b-4a1bf61c8253/console.log" append="off"/>
Nov 14 01:18:44 user nova-compute[74850]:     </serial>
Nov 14 01:18:44 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 01:18:44 user nova-compute[74850]:     <video>
Nov 14 01:18:44 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:18:44 user nova-compute[74850]:     </video>
Nov 14 01:18:44 user nova-compute[74850]:     <rng model="virtio">
Nov 14 01:18:44 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 01:18:44 user nova-compute[74850]:     </rng>
Nov 14 01:18:44 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 01:18:44 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 01:18:44 user nova-compute[74850]:       <stats period="10"/>
Nov 14 01:18:44 user nova-compute[74850]:     </memballoon>
Nov 14 01:18:44 user nova-compute[74850]:   </devices>
Nov 14 01:18:44 user nova-compute[74850]: </domain>
Nov 14 01:18:44 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:18:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-53983429',display_name='tempest-TestMinimumBasicScenario-server-53983429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-53983429',id=52,image_ref='28ddc848-21fb-4671-b317-f580045c9b35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCccf422bLKzQeIR6K/v485zTwgeFOktQIP4/VxAjzOZhyWA6TyJ9it1cdukEz1KdSOMWp86fuaBzrcqkz9V6adFuHZxPvlzawfZIIDRoy0l0FeHGNlDoqtP4EgTIzAGlA==',key_name='tempest-TestMinimumBasicScenario-1922317015',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0ae3f5d3814451c9c7d7264707c8334',ramdisk_id='',reservation_id='r-3s1kktvq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='28ddc848-21fb-4671-b317-f580045c9b35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2056291063',owner_user_name='tempest-TestMinimumBasicScenario-2056291063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:18:42Z,user_data=None,user_id='534b22e8e0c7495f8d2f89dec7e9a66c',uuid=cae7cbe7-3337-4a3a-b93b-4a1bf61c8253,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9346a49-fcbf-4871-af15-5a3b10b48793", "address": "fa:16:3e:de:47:f9", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9346a49-fc", "ovs_interfaceid": "c9346a49-fcbf-4871-af15-5a3b10b48793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Converting VIF {"id": "c9346a49-fcbf-4871-af15-5a3b10b48793", "address": "fa:16:3e:de:47:f9", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9346a49-fc", "ovs_interfaceid": "c9346a49-fcbf-4871-af15-5a3b10b48793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:47:f9,bridge_name='br-int',has_traffic_filtering=True,id=c9346a49-fcbf-4871-af15-5a3b10b48793,network=Network(7a6e0781-a6cd-4125-bdaf-9b9d53c4d254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9346a49-fc') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG os_vif [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:47:f9,bridge_name='br-int',has_traffic_filtering=True,id=c9346a49-fcbf-4871-af15-5a3b10b48793,network=Network(7a6e0781-a6cd-4125-bdaf-9b9d53c4d254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9346a49-fc') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ff22fda2-b213-5eef-8356-cb405265d06d', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9346a49-fc, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc9346a49-fc, col_values=(('qos', UUID('653cf82b-4a80-4527-b1b8-1bb1bda7a8e0')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc9346a49-fc, col_values=(('external_ids', {'iface-id': 'c9346a49-fcbf-4871-af15-5a3b10b48793', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:47:f9', 'vm-uuid': 'cae7cbe7-3337-4a3a-b93b-4a1bf61c8253'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:18:44 user nova-compute[74850]: INFO os_vif [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:47:f9,bridge_name='br-int',has_traffic_filtering=True,id=c9346a49-fcbf-4871-af15-5a3b10b48793,network=Network(7a6e0781-a6cd-4125-bdaf-9b9d53c4d254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9346a49-fc')
Nov 14 01:18:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] No VIF found with MAC fa:16:3e:de:47:f9, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG nova.network.neutron [req-e7cdce43-14e6-436a-bc7a-048b37817923 req-3c8b4a06-d878-416b-8b9e-1558bb3bc71d service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Updated VIF entry in instance network info cache for port c9346a49-fcbf-4871-af15-5a3b10b48793. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG nova.network.neutron [req-e7cdce43-14e6-436a-bc7a-048b37817923 req-3c8b4a06-d878-416b-8b9e-1558bb3bc71d service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Updating instance_info_cache with network_info: [{"id": "c9346a49-fcbf-4871-af15-5a3b10b48793", "address": "fa:16:3e:de:47:f9", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9346a49-fc", "ovs_interfaceid": "c9346a49-fcbf-4871-af15-5a3b10b48793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:18:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-e7cdce43-14e6-436a-bc7a-048b37817923 req-3c8b4a06-d878-416b-8b9e-1558bb3bc71d service nova] Releasing lock "refresh_cache-cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:18:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:18:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:18:45 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:18:46 user nova-compute[74850]: DEBUG nova.compute.manager [req-4f9fd5f5-1861-4d73-b69a-dc2001fb67fb req-49c291da-3a49-436d-9b1d-63f9e2fa98bc service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Received event network-vif-plugged-c9346a49-fcbf-4871-af15-5a3b10b48793 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:18:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-4f9fd5f5-1861-4d73-b69a-dc2001fb67fb req-49c291da-3a49-436d-9b1d-63f9e2fa98bc service nova] Acquiring lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:18:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-4f9fd5f5-1861-4d73-b69a-dc2001fb67fb req-49c291da-3a49-436d-9b1d-63f9e2fa98bc service nova] Lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:18:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-4f9fd5f5-1861-4d73-b69a-dc2001fb67fb req-49c291da-3a49-436d-9b1d-63f9e2fa98bc service nova] Lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:18:46 user nova-compute[74850]: DEBUG nova.compute.manager [req-4f9fd5f5-1861-4d73-b69a-dc2001fb67fb req-49c291da-3a49-436d-9b1d-63f9e2fa98bc service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] No waiting events found dispatching network-vif-plugged-c9346a49-fcbf-4871-af15-5a3b10b48793 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:18:46 user nova-compute[74850]: WARNING nova.compute.manager [req-4f9fd5f5-1861-4d73-b69a-dc2001fb67fb req-49c291da-3a49-436d-9b1d-63f9e2fa98bc service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Received unexpected event network-vif-plugged-c9346a49-fcbf-4871-af15-5a3b10b48793 for instance with vm_state building and task_state spawning.
Nov 14 01:18:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:18:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:18:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:18:47 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 01:18:47 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 01:18:47 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Instance spawned successfully.
Nov 14 01:18:47 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 01:18:47 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:18:47 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:18:47 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:18:47 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:18:47 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:18:47 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:18:48 user nova-compute[74850]: INFO nova.compute.manager [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Took 5.96 seconds to spawn the instance on the hypervisor.
Nov 14 01:18:48 user nova-compute[74850]: DEBUG nova.compute.manager [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 01:18:48 user nova-compute[74850]: DEBUG nova.compute.manager [req-00f870c5-8019-4019-93ba-92fdc7f80c4c req-91d4a8a9-8d7a-47d0-8a3d-7fb6cc4801e1 service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Received event network-vif-plugged-c9346a49-fcbf-4871-af15-5a3b10b48793 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:18:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-00f870c5-8019-4019-93ba-92fdc7f80c4c req-91d4a8a9-8d7a-47d0-8a3d-7fb6cc4801e1 service nova] Acquiring lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:18:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-00f870c5-8019-4019-93ba-92fdc7f80c4c req-91d4a8a9-8d7a-47d0-8a3d-7fb6cc4801e1 service nova] Lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:18:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-00f870c5-8019-4019-93ba-92fdc7f80c4c req-91d4a8a9-8d7a-47d0-8a3d-7fb6cc4801e1 service nova] Lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:18:48 user nova-compute[74850]: DEBUG nova.compute.manager [req-00f870c5-8019-4019-93ba-92fdc7f80c4c req-91d4a8a9-8d7a-47d0-8a3d-7fb6cc4801e1 service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] No waiting events found dispatching network-vif-plugged-c9346a49-fcbf-4871-af15-5a3b10b48793 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:18:48 user nova-compute[74850]: WARNING nova.compute.manager [req-00f870c5-8019-4019-93ba-92fdc7f80c4c req-91d4a8a9-8d7a-47d0-8a3d-7fb6cc4801e1 service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Received unexpected event network-vif-plugged-c9346a49-fcbf-4871-af15-5a3b10b48793 for instance with vm_state building and task_state spawning.
Nov 14 01:18:48 user nova-compute[74850]: INFO nova.compute.manager [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Took 6.44 seconds to build instance.
Nov 14 01:18:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-6afc5a9b-64aa-4c34-8675-a57200820a3c tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.540s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:18:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:18:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:18:54 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:18:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:19:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:19:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:19:06 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:19:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:19:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:19:06 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:19:06 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 01:19:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae7cbe7-3337-4a3a-b93b-4a1bf61c8253/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:19:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae7cbe7-3337-4a3a-b93b-4a1bf61c8253/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:19:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae7cbe7-3337-4a3a-b93b-4a1bf61c8253/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:19:07 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae7cbe7-3337-4a3a-b93b-4a1bf61c8253/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:19:07 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:19:07 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:19:07 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=8969MB free_disk=24.96405792236328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 01:19:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:19:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:19:07 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance cae7cbe7-3337-4a3a-b93b-4a1bf61c8253 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:19:07 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 01:19:07 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 01:19:07 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:19:07 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:19:07 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 01:19:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:19:08 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:19:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:19:10 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:19:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:19:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:19:15 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:19:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:19:16 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:19:16 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 01:19:17 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:19:17 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:19:17 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 01:19:17 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Rebuilding the list of instances to heal {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 01:19:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "refresh_cache-cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:19:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquired lock "refresh_cache-cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:19:17 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Forcefully refreshing network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 01:19:17 user nova-compute[74850]: DEBUG nova.objects.instance [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lazy-loading 'info_cache' on Instance uuid cae7cbe7-3337-4a3a-b93b-4a1bf61c8253 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:19:18 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Updating instance_info_cache with network_info: [{"id": "c9346a49-fcbf-4871-af15-5a3b10b48793", "address": "fa:16:3e:de:47:f9", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9346a49-fc", "ovs_interfaceid": "c9346a49-fcbf-4871-af15-5a3b10b48793", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:19:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Releasing lock "refresh_cache-cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:19:18 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Updated the network info_cache for instance {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 01:19:18 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:19:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:19:19 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:19:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:19:23 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:19:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:19:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:19:30 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:19:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:19:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:19:35 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:19:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:19:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:19:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:19:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74850) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 01:19:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:19:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:19:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:19:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:19:54 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:19:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:20:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:20:07 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:20:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:20:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:20:07 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:20:07 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 01:20:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae7cbe7-3337-4a3a-b93b-4a1bf61c8253/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:20:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae7cbe7-3337-4a3a-b93b-4a1bf61c8253/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:20:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae7cbe7-3337-4a3a-b93b-4a1bf61c8253/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:20:08 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae7cbe7-3337-4a3a-b93b-4a1bf61c8253/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:20:08 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:20:08 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:20:08 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=9045MB free_disk=24.96133804321289GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 01:20:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:20:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:20:08 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance cae7cbe7-3337-4a3a-b93b-4a1bf61c8253 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:20:08 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 01:20:08 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 01:20:08 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:20:08 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:20:08 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 01:20:08 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:20:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:20:09 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:20:10 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:20:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:20:16 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:20:16 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 01:20:17 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:20:18 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:20:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:20:19 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:20:19 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:20:19 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 01:20:19 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Rebuilding the list of instances to heal {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 01:20:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "refresh_cache-cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:20:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquired lock "refresh_cache-cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:20:20 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Forcefully refreshing network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 01:20:20 user nova-compute[74850]: DEBUG nova.objects.instance [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lazy-loading 'info_cache' on Instance uuid cae7cbe7-3337-4a3a-b93b-4a1bf61c8253 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:20:20 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Updating instance_info_cache with network_info: [{"id": "c9346a49-fcbf-4871-af15-5a3b10b48793", "address": "fa:16:3e:de:47:f9", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9346a49-fc", "ovs_interfaceid": "c9346a49-fcbf-4871-af15-5a3b10b48793", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:20:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Releasing lock "refresh_cache-cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:20:20 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Updated the network info_cache for instance {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 01:20:21 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:20:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:20:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:20:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquiring lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:20:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:20:34 user nova-compute[74850]: DEBUG nova.objects.instance [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lazy-loading 'flavor' on Instance uuid cae7cbe7-3337-4a3a-b93b-4a1bf61c8253 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:20:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:20:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquiring lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:20:34 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:20:34 user nova-compute[74850]: INFO nova.compute.manager [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Attaching volume 0f30a0b7-793d-4523-a0f4-e1a3ccf911bd to /dev/vdb
Nov 14 01:20:34 user nova-compute[74850]: DEBUG os_brick.utils [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:20:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:20:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:20:34 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00d2fdb-0102-4678-a35c-9bc43a14ab10]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:20:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:20:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:20:34 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca2fe60-90d9-482d-bc5c-ad77488bd143]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:20:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:20:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:20:34 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c518ea-487a-4dc7-9330-163163f272aa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:20:34 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16ceee7-5413-489c-9f79-a4a7a25dc93d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:20:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:20:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:20:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 01:20:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:20:34 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:20:34 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 01:20:34 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[470f67e9-e0a5-4fef-9caf-a52de2df1cc6]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:20:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 01:20:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 01:20:34 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 01:20:34 user nova-compute[74850]: DEBUG os_brick.utils [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:20:34 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Updating existing volume attachment record: c746f251-8d97-46e9-9d77-19f919e85088 {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 01:20:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:20:37 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:20:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:20:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:20:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:20:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:20:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:20:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:20:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.imagecache [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Verify base images {{(pid=74850) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 14 01:20:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.imagecache [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Image id 28ddc848-21fb-4671-b317-f580045c9b35 yields fingerprint 4b2cbae98865ae56e1bf962cf7ea3f8a49af6413 {{(pid=74850) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 14 01:20:37 user nova-compute[74850]: INFO nova.virt.libvirt.imagecache [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] image 28ddc848-21fb-4671-b317-f580045c9b35 at (/opt/stack/data/nova/instances/_base/4b2cbae98865ae56e1bf962cf7ea3f8a49af6413): checking
Nov 14 01:20:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.imagecache [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] image 28ddc848-21fb-4671-b317-f580045c9b35 at (/opt/stack/data/nova/instances/_base/4b2cbae98865ae56e1bf962cf7ea3f8a49af6413): image is in use {{(pid=74850) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 14 01:20:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.imagecache [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74850) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 14 01:20:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.imagecache [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] cae7cbe7-3337-4a3a-b93b-4a1bf61c8253 is a valid instance name {{(pid=74850) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 14 01:20:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.imagecache [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] cae7cbe7-3337-4a3a-b93b-4a1bf61c8253 has a disk file {{(pid=74850) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 14 01:20:37 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae7cbe7-3337-4a3a-b93b-4a1bf61c8253/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae7cbe7-3337-4a3a-b93b-4a1bf61c8253/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.imagecache [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance cae7cbe7-3337-4a3a-b93b-4a1bf61c8253 is backed by 4b2cbae98865ae56e1bf962cf7ea3f8a49af6413 {{(pid=74850) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 14 01:20:38 user nova-compute[74850]: WARNING nova.virt.libvirt.imagecache [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/03d6354405546a094db4b497352f336030c90306
Nov 14 01:20:38 user nova-compute[74850]: WARNING nova.virt.libvirt.imagecache [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549
Nov 14 01:20:38 user nova-compute[74850]: WARNING nova.virt.libvirt.imagecache [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3c60c2c4ee861c3e92317a7996f4f8a6e80713e3
Nov 14 01:20:38 user nova-compute[74850]: WARNING nova.virt.libvirt.imagecache [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/99ddb6bc78eecd6954936ecdfb0b10003c8e13f0
Nov 14 01:20:38 user nova-compute[74850]: WARNING nova.virt.libvirt.imagecache [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1fc1b7c6620c95d32023865886143582e78fc686
Nov 14 01:20:38 user nova-compute[74850]: WARNING nova.virt.libvirt.imagecache [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4ff42bc5edc5530bc20395ebf052158a647fe2e1
Nov 14 01:20:38 user nova-compute[74850]: WARNING nova.virt.libvirt.imagecache [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/687b327c6d4447601982509dde3475b3135a2fd6
Nov 14 01:20:38 user nova-compute[74850]: WARNING nova.virt.libvirt.imagecache [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/245de3558fe3f5aa4cc5d44bc16c5598590e763e
Nov 14 01:20:38 user nova-compute[74850]: WARNING nova.virt.libvirt.imagecache [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/46d57a6f73da8e9d73a2d757d2c19a6975a416ec
Nov 14 01:20:38 user nova-compute[74850]: INFO nova.virt.libvirt.imagecache [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Active base files: /opt/stack/data/nova/instances/_base/4b2cbae98865ae56e1bf962cf7ea3f8a49af6413
Nov 14 01:20:38 user nova-compute[74850]: INFO nova.virt.libvirt.imagecache [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Removable base files: /opt/stack/data/nova/instances/_base/03d6354405546a094db4b497352f336030c90306 /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 /opt/stack/data/nova/instances/_base/3c60c2c4ee861c3e92317a7996f4f8a6e80713e3 /opt/stack/data/nova/instances/_base/99ddb6bc78eecd6954936ecdfb0b10003c8e13f0 /opt/stack/data/nova/instances/_base/1fc1b7c6620c95d32023865886143582e78fc686 /opt/stack/data/nova/instances/_base/4ff42bc5edc5530bc20395ebf052158a647fe2e1 /opt/stack/data/nova/instances/_base/687b327c6d4447601982509dde3475b3135a2fd6 /opt/stack/data/nova/instances/_base/245de3558fe3f5aa4cc5d44bc16c5598590e763e /opt/stack/data/nova/instances/_base/46d57a6f73da8e9d73a2d757d2c19a6975a416ec
Nov 14 01:20:38 user nova-compute[74850]: INFO nova.virt.libvirt.imagecache [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/03d6354405546a094db4b497352f336030c90306
Nov 14 01:20:38 user nova-compute[74850]: INFO nova.virt.libvirt.imagecache [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549
Nov 14 01:20:38 user nova-compute[74850]: INFO nova.virt.libvirt.imagecache [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3c60c2c4ee861c3e92317a7996f4f8a6e80713e3
Nov 14 01:20:38 user nova-compute[74850]: INFO nova.virt.libvirt.imagecache [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/99ddb6bc78eecd6954936ecdfb0b10003c8e13f0
Nov 14 01:20:38 user nova-compute[74850]: INFO nova.virt.libvirt.imagecache [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1fc1b7c6620c95d32023865886143582e78fc686
Nov 14 01:20:38 user nova-compute[74850]: INFO nova.virt.libvirt.imagecache [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4ff42bc5edc5530bc20395ebf052158a647fe2e1
Nov 14 01:20:38 user nova-compute[74850]: INFO nova.virt.libvirt.imagecache [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/687b327c6d4447601982509dde3475b3135a2fd6
Nov 14 01:20:38 user nova-compute[74850]: INFO nova.virt.libvirt.imagecache [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/245de3558fe3f5aa4cc5d44bc16c5598590e763e
Nov 14 01:20:38 user nova-compute[74850]: INFO nova.virt.libvirt.imagecache [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/46d57a6f73da8e9d73a2d757d2c19a6975a416ec
Nov 14 01:20:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.imagecache [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Verification complete {{(pid=74850) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.imagecache [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Verify swap images {{(pid=74850) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.imagecache [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Verify ephemeral images {{(pid=74850) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FyqXVkUS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:20:38 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:20:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:20:38 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:20:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:20:38 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 01:20:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[42faea31-3219-410f-a34f-6d25245a17bd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 01:20:38 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5775b9-b0de-4d33-bdd2-d47ad711af18]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd] added
Nov 14 01:20:38 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c619be88-890d-464a-ade8-56c9eae96e36]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a38c30-2fbe-498f-8b8a-83fa72639984]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FyqXVkUS {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FyqXVkUS" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[04939dac-52f9-4af5-b009-4e8284c9ceeb]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FyqXVkUS'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2e7d56-41dd-42da-8aff-d3592fe8b224]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7687306-ad24-4087-9794-fcdc5a3c7428]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 01:20:38 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 01:20:38 user nova-compute[74850]:  {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:20:38 user nova-compute[74850]: WARNING os_brick.initiator.connectors.iscsi [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 01:20:38 user nova-compute[74850]: 
Nov 14 01:20:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90736a3-338a-4bb1-ada6-c53b3445c115]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd, portal: 172.16.0.220,3260]
Nov 14 01:20:38 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd, portal: 172.16.0.220,3260] successful.
Nov 14 01:20:38 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[38549fab-fa80-444b-9e2b-25cd88f1ca4f]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa9a009-fe0b-41aa-ae05-e38e98772707]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd (non-flash)
Nov 14 01:20:38 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd (non-flash)
Nov 14 01:20:38 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad45cfa-54df-41ba-baa0-0a09e3497225]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:20:38 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FyqXVkUS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 01:20:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:20:39 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:20:39 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26535346161346636', 'path': '/dev/sdb'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:20:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535346161346636', 'path': '/dev/sdb'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 01:20:39 user nova-compute[74850]: DEBUG nova.objects.instance [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lazy-loading 'flavor' on Instance uuid cae7cbe7-3337-4a3a-b93b-4a1bf61c8253 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:20:39 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 01:20:39 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:20:39 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 01:20:39 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:20:39 user nova-compute[74850]:   <serial>0f30a0b7-793d-4523-a0f4-e1a3ccf911bd</serial>
Nov 14 01:20:39 user nova-compute[74850]: </disk>
Nov 14 01:20:39 user nova-compute[74850]:  {{(pid=74850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 01:20:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:20:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:20:40 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] No VIF found with MAC fa:16:3e:de:47:f9, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:20:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4f9dce51-f999-403c-bec8-5969806e2925 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.164s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:20:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:20:42 user nova-compute[74850]: DEBUG nova.compute.manager [req-9326c06d-154e-4a12-83df-670eb8d79931 req-f1a4282a-20ae-4441-a1cc-dc5b7116e1b9 service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Received event network-changed-c9346a49-fcbf-4871-af15-5a3b10b48793 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:20:42 user nova-compute[74850]: DEBUG nova.compute.manager [req-9326c06d-154e-4a12-83df-670eb8d79931 req-f1a4282a-20ae-4441-a1cc-dc5b7116e1b9 service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Refreshing instance network info cache due to event network-changed-c9346a49-fcbf-4871-af15-5a3b10b48793. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:20:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9326c06d-154e-4a12-83df-670eb8d79931 req-f1a4282a-20ae-4441-a1cc-dc5b7116e1b9 service nova] Acquiring lock "refresh_cache-cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:20:42 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9326c06d-154e-4a12-83df-670eb8d79931 req-f1a4282a-20ae-4441-a1cc-dc5b7116e1b9 service nova] Acquired lock "refresh_cache-cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:20:42 user nova-compute[74850]: DEBUG nova.network.neutron [req-9326c06d-154e-4a12-83df-670eb8d79931 req-f1a4282a-20ae-4441-a1cc-dc5b7116e1b9 service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Refreshing network info cache for port c9346a49-fcbf-4871-af15-5a3b10b48793 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:20:43 user nova-compute[74850]: DEBUG nova.network.neutron [req-9326c06d-154e-4a12-83df-670eb8d79931 req-f1a4282a-20ae-4441-a1cc-dc5b7116e1b9 service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Updated VIF entry in instance network info cache for port c9346a49-fcbf-4871-af15-5a3b10b48793. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:20:43 user nova-compute[74850]: DEBUG nova.network.neutron [req-9326c06d-154e-4a12-83df-670eb8d79931 req-f1a4282a-20ae-4441-a1cc-dc5b7116e1b9 service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Updating instance_info_cache with network_info: [{"id": "c9346a49-fcbf-4871-af15-5a3b10b48793", "address": "fa:16:3e:de:47:f9", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9346a49-fc", "ovs_interfaceid": "c9346a49-fcbf-4871-af15-5a3b10b48793", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:20:43 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-9326c06d-154e-4a12-83df-670eb8d79931 req-f1a4282a-20ae-4441-a1cc-dc5b7116e1b9 service nova] Releasing lock "refresh_cache-cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:20:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:20:44 user nova-compute[74850]: DEBUG nova.compute.manager [req-53ead744-94bc-4871-b419-a93500374acc req-feb273cd-315b-44ef-bd1b-ddc497cd2cde service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Received event network-changed-c9346a49-fcbf-4871-af15-5a3b10b48793 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:20:44 user nova-compute[74850]: DEBUG nova.compute.manager [req-53ead744-94bc-4871-b419-a93500374acc req-feb273cd-315b-44ef-bd1b-ddc497cd2cde service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Refreshing instance network info cache due to event network-changed-c9346a49-fcbf-4871-af15-5a3b10b48793. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:20:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-53ead744-94bc-4871-b419-a93500374acc req-feb273cd-315b-44ef-bd1b-ddc497cd2cde service nova] Acquiring lock "refresh_cache-cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:20:44 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-53ead744-94bc-4871-b419-a93500374acc req-feb273cd-315b-44ef-bd1b-ddc497cd2cde service nova] Acquired lock "refresh_cache-cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:20:44 user nova-compute[74850]: DEBUG nova.network.neutron [req-53ead744-94bc-4871-b419-a93500374acc req-feb273cd-315b-44ef-bd1b-ddc497cd2cde service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Refreshing network info cache for port c9346a49-fcbf-4871-af15-5a3b10b48793 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:20:45 user nova-compute[74850]: DEBUG nova.network.neutron [req-53ead744-94bc-4871-b419-a93500374acc req-feb273cd-315b-44ef-bd1b-ddc497cd2cde service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Updated VIF entry in instance network info cache for port c9346a49-fcbf-4871-af15-5a3b10b48793. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:20:45 user nova-compute[74850]: DEBUG nova.network.neutron [req-53ead744-94bc-4871-b419-a93500374acc req-feb273cd-315b-44ef-bd1b-ddc497cd2cde service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Updating instance_info_cache with network_info: [{"id": "c9346a49-fcbf-4871-af15-5a3b10b48793", "address": "fa:16:3e:de:47:f9", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9346a49-fc", "ovs_interfaceid": "c9346a49-fcbf-4871-af15-5a3b10b48793", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:20:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-53ead744-94bc-4871-b419-a93500374acc req-feb273cd-315b-44ef-bd1b-ddc497cd2cde service nova] Releasing lock "refresh_cache-cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:20:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e457f3a3-45f6-405e-a9e8-dfe906d148e4 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquiring lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:20:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e457f3a3-45f6-405e-a9e8-dfe906d148e4 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:20:45 user nova-compute[74850]: INFO nova.compute.manager [None req-e457f3a3-45f6-405e-a9e8-dfe906d148e4 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Rebooting instance
Nov 14 01:20:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e457f3a3-45f6-405e-a9e8-dfe906d148e4 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquiring lock "refresh_cache-cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:20:45 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e457f3a3-45f6-405e-a9e8-dfe906d148e4 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquired lock "refresh_cache-cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:20:45 user nova-compute[74850]: DEBUG nova.network.neutron [None req-e457f3a3-45f6-405e-a9e8-dfe906d148e4 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 01:20:46 user nova-compute[74850]: DEBUG nova.network.neutron [None req-e457f3a3-45f6-405e-a9e8-dfe906d148e4 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Updating instance_info_cache with network_info: [{"id": "c9346a49-fcbf-4871-af15-5a3b10b48793", "address": "fa:16:3e:de:47:f9", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9346a49-fc", "ovs_interfaceid": "c9346a49-fcbf-4871-af15-5a3b10b48793", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:20:46 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e457f3a3-45f6-405e-a9e8-dfe906d148e4 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Releasing lock "refresh_cache-cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:20:46 user nova-compute[74850]: DEBUG nova.compute.manager [None req-e457f3a3-45f6-405e-a9e8-dfe906d148e4 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 01:20:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:20:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:20:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:20:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:20:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:20:48 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:20:48 user nova-compute[74850]: DEBUG nova.compute.manager [req-ddee9446-e0c5-4658-ae3d-9848cf27ff2a req-b741c05e-749e-439f-9017-44aa6227ea79 service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Received event network-vif-unplugged-c9346a49-fcbf-4871-af15-5a3b10b48793 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:20:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ddee9446-e0c5-4658-ae3d-9848cf27ff2a req-b741c05e-749e-439f-9017-44aa6227ea79 service nova] Acquiring lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:20:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ddee9446-e0c5-4658-ae3d-9848cf27ff2a req-b741c05e-749e-439f-9017-44aa6227ea79 service nova] Lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:20:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ddee9446-e0c5-4658-ae3d-9848cf27ff2a req-b741c05e-749e-439f-9017-44aa6227ea79 service nova] Lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:20:48 user nova-compute[74850]: DEBUG nova.compute.manager [req-ddee9446-e0c5-4658-ae3d-9848cf27ff2a req-b741c05e-749e-439f-9017-44aa6227ea79 service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] No waiting events found dispatching network-vif-unplugged-c9346a49-fcbf-4871-af15-5a3b10b48793 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:20:48 user nova-compute[74850]: WARNING nova.compute.manager [req-ddee9446-e0c5-4658-ae3d-9848cf27ff2a req-b741c05e-749e-439f-9017-44aa6227ea79 service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Received unexpected event network-vif-unplugged-c9346a49-fcbf-4871-af15-5a3b10b48793 for instance with vm_state active and task_state reboot_started.
Nov 14 01:20:49 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-e457f3a3-45f6-405e-a9e8-dfe906d148e4 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Instance shutdown successfully.
Nov 14 01:20:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:20:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:20:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:20:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:20:50 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:20:50 user nova-compute[74850]: DEBUG nova.compute.manager [req-caed0698-6f7e-411a-99ca-0a391b14ad18 req-5a12166f-390d-4826-9672-bd2838dbd05e service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Received event network-vif-plugged-c9346a49-fcbf-4871-af15-5a3b10b48793 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:20:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-caed0698-6f7e-411a-99ca-0a391b14ad18 req-5a12166f-390d-4826-9672-bd2838dbd05e service nova] Acquiring lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:20:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-caed0698-6f7e-411a-99ca-0a391b14ad18 req-5a12166f-390d-4826-9672-bd2838dbd05e service nova] Lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:20:50 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-caed0698-6f7e-411a-99ca-0a391b14ad18 req-5a12166f-390d-4826-9672-bd2838dbd05e service nova] Lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:20:50 user nova-compute[74850]: DEBUG nova.compute.manager [req-caed0698-6f7e-411a-99ca-0a391b14ad18 req-5a12166f-390d-4826-9672-bd2838dbd05e service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] No waiting events found dispatching network-vif-plugged-c9346a49-fcbf-4871-af15-5a3b10b48793 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:20:50 user nova-compute[74850]: WARNING nova.compute.manager [req-caed0698-6f7e-411a-99ca-0a391b14ad18 req-5a12166f-390d-4826-9672-bd2838dbd05e service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Received unexpected event network-vif-plugged-c9346a49-fcbf-4871-af15-5a3b10b48793 for instance with vm_state active and task_state reboot_started.
Nov 14 01:20:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:20:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:20:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:20:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:20:52 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Instance running successfully.
Nov 14 01:20:52 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-e457f3a3-45f6-405e-a9e8-dfe906d148e4 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Instance soft rebooted successfully.
Nov 14 01:20:52 user nova-compute[74850]: DEBUG nova.compute.manager [None req-e457f3a3-45f6-405e-a9e8-dfe906d148e4 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 01:20:52 user nova-compute[74850]: DEBUG nova.compute.manager [req-60219879-87af-4486-ae1f-8c2881a17262 req-4299f75e-f2f0-4270-8ebb-558726113688 service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Received event network-vif-plugged-c9346a49-fcbf-4871-af15-5a3b10b48793 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:20:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-60219879-87af-4486-ae1f-8c2881a17262 req-4299f75e-f2f0-4270-8ebb-558726113688 service nova] Acquiring lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:20:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-60219879-87af-4486-ae1f-8c2881a17262 req-4299f75e-f2f0-4270-8ebb-558726113688 service nova] Lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:20:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-60219879-87af-4486-ae1f-8c2881a17262 req-4299f75e-f2f0-4270-8ebb-558726113688 service nova] Lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:20:52 user nova-compute[74850]: DEBUG nova.compute.manager [req-60219879-87af-4486-ae1f-8c2881a17262 req-4299f75e-f2f0-4270-8ebb-558726113688 service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] No waiting events found dispatching network-vif-plugged-c9346a49-fcbf-4871-af15-5a3b10b48793 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:20:52 user nova-compute[74850]: WARNING nova.compute.manager [req-60219879-87af-4486-ae1f-8c2881a17262 req-4299f75e-f2f0-4270-8ebb-558726113688 service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Received unexpected event network-vif-plugged-c9346a49-fcbf-4871-af15-5a3b10b48793 for instance with vm_state active and task_state reboot_started.
Nov 14 01:20:52 user nova-compute[74850]: DEBUG nova.compute.manager [req-60219879-87af-4486-ae1f-8c2881a17262 req-4299f75e-f2f0-4270-8ebb-558726113688 service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Received event network-vif-plugged-c9346a49-fcbf-4871-af15-5a3b10b48793 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:20:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-60219879-87af-4486-ae1f-8c2881a17262 req-4299f75e-f2f0-4270-8ebb-558726113688 service nova] Acquiring lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:20:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-60219879-87af-4486-ae1f-8c2881a17262 req-4299f75e-f2f0-4270-8ebb-558726113688 service nova] Lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:20:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-60219879-87af-4486-ae1f-8c2881a17262 req-4299f75e-f2f0-4270-8ebb-558726113688 service nova] Lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:20:52 user nova-compute[74850]: DEBUG nova.compute.manager [req-60219879-87af-4486-ae1f-8c2881a17262 req-4299f75e-f2f0-4270-8ebb-558726113688 service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] No waiting events found dispatching network-vif-plugged-c9346a49-fcbf-4871-af15-5a3b10b48793 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:20:52 user nova-compute[74850]: WARNING nova.compute.manager [req-60219879-87af-4486-ae1f-8c2881a17262 req-4299f75e-f2f0-4270-8ebb-558726113688 service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Received unexpected event network-vif-plugged-c9346a49-fcbf-4871-af15-5a3b10b48793 for instance with vm_state active and task_state reboot_started.
Nov 14 01:20:52 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-e457f3a3-45f6-405e-a9e8-dfe906d148e4 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.324s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:20:54 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:20:56 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:20:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:21:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:21:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:21:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:21:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:21:10 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:21:10 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:21:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:21:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:21:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:21:10 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 01:21:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae7cbe7-3337-4a3a-b93b-4a1bf61c8253/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:21:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae7cbe7-3337-4a3a-b93b-4a1bf61c8253/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:21:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae7cbe7-3337-4a3a-b93b-4a1bf61c8253/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:21:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae7cbe7-3337-4a3a-b93b-4a1bf61c8253/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:21:10 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:21:11 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:21:11 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:21:11 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=8962MB free_disk=24.959491729736328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 01:21:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:21:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:21:11 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance cae7cbe7-3337-4a3a-b93b-4a1bf61c8253 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:21:11 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 01:21:11 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 01:21:11 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:21:11 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:21:11 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 01:21:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:21:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:21:11 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:21:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:21:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:21:17 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:21:18 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:21:18 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 01:21:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:21:19 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:21:19 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:21:20 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:21:20 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 01:21:20 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Rebuilding the list of instances to heal {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 01:21:21 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "refresh_cache-cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:21:21 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquired lock "refresh_cache-cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:21:21 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Forcefully refreshing network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 01:21:21 user nova-compute[74850]: DEBUG nova.objects.instance [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lazy-loading 'info_cache' on Instance uuid cae7cbe7-3337-4a3a-b93b-4a1bf61c8253 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:21:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:21:21 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Updating instance_info_cache with network_info: [{"id": "c9346a49-fcbf-4871-af15-5a3b10b48793", "address": "fa:16:3e:de:47:f9", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9346a49-fc", "ovs_interfaceid": "c9346a49-fcbf-4871-af15-5a3b10b48793", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:21:21 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Releasing lock "refresh_cache-cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:21:21 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Updated the network info_cache for instance {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 01:21:21 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:21:21 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:21:22 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:21:22 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74850) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 01:21:23 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:21:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:21:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:21:31 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:21:31 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Cleaning up deleted instances {{(pid=74850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 01:21:31 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] There are 0 instances to clean {{(pid=74850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 01:21:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:21:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:21:40 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:21:40 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Triggering sync for uuid cae7cbe7-3337-4a3a-b93b-4a1bf61c8253 {{(pid=74850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 01:21:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:21:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:21:40 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:21:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:21:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:21:54 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:21:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:22:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:22:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:22:09 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:22:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:22:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:22:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:22:09 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 01:22:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae7cbe7-3337-4a3a-b93b-4a1bf61c8253/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:22:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae7cbe7-3337-4a3a-b93b-4a1bf61c8253/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:22:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae7cbe7-3337-4a3a-b93b-4a1bf61c8253/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:22:10 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae7cbe7-3337-4a3a-b93b-4a1bf61c8253/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:22:10 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 01:22:10 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:22:10 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:22:10 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=9011MB free_disk=24.95877456665039GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 01:22:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:22:10 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:22:10 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance cae7cbe7-3337-4a3a-b93b-4a1bf61c8253 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:22:10 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 01:22:10 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 01:22:11 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:22:11 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:22:11 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 01:22:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.319s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:22:12 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:22:12 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:22:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:22:18 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:22:18 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 01:22:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:22:19 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:22:20 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:22:21 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:22:21 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:22:21 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 01:22:21 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Rebuilding the list of instances to heal {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 01:22:22 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "refresh_cache-cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:22:22 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquired lock "refresh_cache-cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:22:22 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Forcefully refreshing network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 01:22:22 user nova-compute[74850]: DEBUG nova.objects.instance [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lazy-loading 'info_cache' on Instance uuid cae7cbe7-3337-4a3a-b93b-4a1bf61c8253 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:22:22 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Updating instance_info_cache with network_info: [{"id": "c9346a49-fcbf-4871-af15-5a3b10b48793", "address": "fa:16:3e:de:47:f9", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9346a49-fc", "ovs_interfaceid": "c9346a49-fcbf-4871-af15-5a3b10b48793", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:22:22 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Releasing lock "refresh_cache-cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:22:22 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Updated the network info_cache for instance {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 01:22:22 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:22:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:22:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:22:34 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:22:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:22:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:22:36 user nova-compute[74850]: DEBUG nova.compute.manager [req-5959f4b5-dd13-4bcb-9cb5-29f7f155d2c9 req-b4b579d5-4f8b-4ec4-b3c5-dc6410fe98be service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Received event network-changed-c9346a49-fcbf-4871-af15-5a3b10b48793 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:22:36 user nova-compute[74850]: DEBUG nova.compute.manager [req-5959f4b5-dd13-4bcb-9cb5-29f7f155d2c9 req-b4b579d5-4f8b-4ec4-b3c5-dc6410fe98be service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Refreshing instance network info cache due to event network-changed-c9346a49-fcbf-4871-af15-5a3b10b48793. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:22:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5959f4b5-dd13-4bcb-9cb5-29f7f155d2c9 req-b4b579d5-4f8b-4ec4-b3c5-dc6410fe98be service nova] Acquiring lock "refresh_cache-cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:22:36 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5959f4b5-dd13-4bcb-9cb5-29f7f155d2c9 req-b4b579d5-4f8b-4ec4-b3c5-dc6410fe98be service nova] Acquired lock "refresh_cache-cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:22:36 user nova-compute[74850]: DEBUG nova.network.neutron [req-5959f4b5-dd13-4bcb-9cb5-29f7f155d2c9 req-b4b579d5-4f8b-4ec4-b3c5-dc6410fe98be service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Refreshing network info cache for port c9346a49-fcbf-4871-af15-5a3b10b48793 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:22:37 user nova-compute[74850]: DEBUG nova.network.neutron [req-5959f4b5-dd13-4bcb-9cb5-29f7f155d2c9 req-b4b579d5-4f8b-4ec4-b3c5-dc6410fe98be service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Updated VIF entry in instance network info cache for port c9346a49-fcbf-4871-af15-5a3b10b48793. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:22:37 user nova-compute[74850]: DEBUG nova.network.neutron [req-5959f4b5-dd13-4bcb-9cb5-29f7f155d2c9 req-b4b579d5-4f8b-4ec4-b3c5-dc6410fe98be service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Updating instance_info_cache with network_info: [{"id": "c9346a49-fcbf-4871-af15-5a3b10b48793", "address": "fa:16:3e:de:47:f9", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9346a49-fc", "ovs_interfaceid": "c9346a49-fcbf-4871-af15-5a3b10b48793", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:22:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-5959f4b5-dd13-4bcb-9cb5-29f7f155d2c9 req-b4b579d5-4f8b-4ec4-b3c5-dc6410fe98be service nova] Releasing lock "refresh_cache-cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:22:37 user nova-compute[74850]: DEBUG nova.compute.manager [req-d04f6902-4c31-46c7-b390-0c0470cdd6e2 req-22adf66d-dc09-481b-b450-fbf3b9080188 service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Received event network-changed-c9346a49-fcbf-4871-af15-5a3b10b48793 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:22:37 user nova-compute[74850]: DEBUG nova.compute.manager [req-d04f6902-4c31-46c7-b390-0c0470cdd6e2 req-22adf66d-dc09-481b-b450-fbf3b9080188 service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Refreshing instance network info cache due to event network-changed-c9346a49-fcbf-4871-af15-5a3b10b48793. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:22:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d04f6902-4c31-46c7-b390-0c0470cdd6e2 req-22adf66d-dc09-481b-b450-fbf3b9080188 service nova] Acquiring lock "refresh_cache-cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:22:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d04f6902-4c31-46c7-b390-0c0470cdd6e2 req-22adf66d-dc09-481b-b450-fbf3b9080188 service nova] Acquired lock "refresh_cache-cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:22:37 user nova-compute[74850]: DEBUG nova.network.neutron [req-d04f6902-4c31-46c7-b390-0c0470cdd6e2 req-22adf66d-dc09-481b-b450-fbf3b9080188 service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Refreshing network info cache for port c9346a49-fcbf-4871-af15-5a3b10b48793 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:22:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-19d28341-96e8-4ab7-9cea-20a02f6c0d73 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquiring lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:22:37 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-19d28341-96e8-4ab7-9cea-20a02f6c0d73 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:22:37 user nova-compute[74850]: INFO nova.compute.manager [None req-19d28341-96e8-4ab7-9cea-20a02f6c0d73 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Detaching volume 0f30a0b7-793d-4523-a0f4-e1a3ccf911bd
Nov 14 01:22:37 user nova-compute[74850]: INFO nova.virt.block_device [None req-19d28341-96e8-4ab7-9cea-20a02f6c0d73 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Attempting to driver detach volume 0f30a0b7-793d-4523-a0f4-e1a3ccf911bd from mountpoint /dev/vdb
Nov 14 01:22:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-19d28341-96e8-4ab7-9cea-20a02f6c0d73 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Attempting to detach device vdb from instance cae7cbe7-3337-4a3a-b93b-4a1bf61c8253 from the persistent domain config. {{(pid=74850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 01:22:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-19d28341-96e8-4ab7-9cea-20a02f6c0d73 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:22:37 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:22:37 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 01:22:37 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:22:37 user nova-compute[74850]:   <serial>0f30a0b7-793d-4523-a0f4-e1a3ccf911bd</serial>
Nov 14 01:22:37 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 01:22:37 user nova-compute[74850]: </disk>
Nov 14 01:22:37 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:22:37 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-19d28341-96e8-4ab7-9cea-20a02f6c0d73 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Successfully detached device vdb from instance cae7cbe7-3337-4a3a-b93b-4a1bf61c8253 from the persistent domain config.
Nov 14 01:22:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-19d28341-96e8-4ab7-9cea-20a02f6c0d73 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cae7cbe7-3337-4a3a-b93b-4a1bf61c8253 from the live domain config. {{(pid=74850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 01:22:37 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-19d28341-96e8-4ab7-9cea-20a02f6c0d73 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:22:37 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:22:37 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 01:22:37 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:22:37 user nova-compute[74850]:   <serial>0f30a0b7-793d-4523-a0f4-e1a3ccf911bd</serial>
Nov 14 01:22:37 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 01:22:37 user nova-compute[74850]: </disk>
Nov 14 01:22:37 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:22:37 user nova-compute[74850]: DEBUG nova.network.neutron [req-d04f6902-4c31-46c7-b390-0c0470cdd6e2 req-22adf66d-dc09-481b-b450-fbf3b9080188 service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Updated VIF entry in instance network info cache for port c9346a49-fcbf-4871-af15-5a3b10b48793. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:22:37 user nova-compute[74850]: DEBUG nova.network.neutron [req-d04f6902-4c31-46c7-b390-0c0470cdd6e2 req-22adf66d-dc09-481b-b450-fbf3b9080188 service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Updating instance_info_cache with network_info: [{"id": "c9346a49-fcbf-4871-af15-5a3b10b48793", "address": "fa:16:3e:de:47:f9", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9346a49-fc", "ovs_interfaceid": "c9346a49-fcbf-4871-af15-5a3b10b48793", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:22:38 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-d04f6902-4c31-46c7-b390-0c0470cdd6e2 req-22adf66d-dc09-481b-b450-fbf3b9080188 service nova] Releasing lock "refresh_cache-cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:22:38 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-19d28341-96e8-4ab7-9cea-20a02f6c0d73 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cae7cbe7-3337-4a3a-b93b-4a1bf61c8253 {{(pid=74850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 01:22:39 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:22:44 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:22:49 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:22:54 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:22:58 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-19d28341-96e8-4ab7-9cea-20a02f6c0d73 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cae7cbe7-3337-4a3a-b93b-4a1bf61c8253 is timed out.
Nov 14 01:22:58 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-19d28341-96e8-4ab7-9cea-20a02f6c0d73 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Successfully detached device vdb from instance cae7cbe7-3337-4a3a-b93b-4a1bf61c8253 from the live domain config.
Nov 14 01:22:58 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19d28341-96e8-4ab7-9cea-20a02f6c0d73 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d28341-96e8-4ab7-9cea-20a02f6c0d73 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FyqXVkUS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:22:58 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-19d28341-96e8-4ab7-9cea-20a02f6c0d73 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:22:58 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-19d28341-96e8-4ab7-9cea-20a02f6c0d73 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-19d28341-96e8-4ab7-9cea-20a02f6c0d73 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[522ce592-a472-4827-b706-b6f57aa85149]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d28341-96e8-4ab7-9cea-20a02f6c0d73 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 01:22:58 user nova-compute[74850]: No targets found.
Nov 14 01:22:58 user nova-compute[74850]: iSNS:
Nov 14 01:22:58 user nova-compute[74850]: No targets found.
Nov 14 01:22:58 user nova-compute[74850]: STATIC:
Nov 14 01:22:58 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd
Nov 14 01:22:58 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:22:58 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:22:58 user nova-compute[74850]: FIRMWARE:
Nov 14 01:22:58 user nova-compute[74850]: No targets found.
Nov 14 01:22:58 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d28341-96e8-4ab7-9cea-20a02f6c0d73 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 01:22:58 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 01:22:58 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d28341-96e8-4ab7-9cea-20a02f6c0d73 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d604503f-c680-427e-b39c-0dd5efd64d2f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f301d021-f2f5-44c2-82ce-957de4e37b5c]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d28341-96e8-4ab7-9cea-20a02f6c0d73 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd (non-flash)
Nov 14 01:22:58 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d28341-96e8-4ab7-9cea-20a02f6c0d73 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd (non-flash)
Nov 14 01:22:58 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d28341-96e8-4ab7-9cea-20a02f6c0d73 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a1c6bed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd'): ({'sdb'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-19d28341-96e8-4ab7-9cea-20a02f6c0d73 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Removing single pathed devices sdb {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b17e3c9-c554-49fb-802b-733356f15934]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69af307-9264-4ed3-86eb-eee12381c779]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-19d28341-96e8-4ab7-9cea-20a02f6c0d73 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Flushing IO for device /dev/sdb {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[509ec96e-d15c-4b12-9d30-57ad21f695e2]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-19d28341-96e8-4ab7-9cea-20a02f6c0d73 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26fb92c-5f62-4f45-893a-916fb466b8a7]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-19d28341-96e8-4ab7-9cea-20a02f6c0d73 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-19d28341-96e8-4ab7-9cea-20a02f6c0d73 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d28341-96e8-4ab7-9cea-20a02f6c0d73 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2571dc15-59ea-46b1-9bc4-91978b744080]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d28341-96e8-4ab7-9cea-20a02f6c0d73 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb71619-50e8-4a05-81fc-a98d2aa03893]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d28341-96e8-4ab7-9cea-20a02f6c0d73 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd, portal: 172.16.0.220,3260]
Nov 14 01:22:58 user nova-compute[74850]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd, portal: 172.16.0.220,3260] successful.
Nov 14 01:22:58 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f30a0b7-793d-4523-a0f4-e1a3ccf911bd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[524f0241-281d-444c-b23a-aed0c147ca48]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d28341-96e8-4ab7-9cea-20a02f6c0d73 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-19d28341-96e8-4ab7-9cea-20a02f6c0d73 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d28341-96e8-4ab7-9cea-20a02f6c0d73 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] <== disconnect_volume: return (288ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:22:58 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19d28341-96e8-4ab7-9cea-20a02f6c0d73 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 01:22:59 user nova-compute[74850]: DEBUG nova.objects.instance [None req-19d28341-96e8-4ab7-9cea-20a02f6c0d73 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lazy-loading 'flavor' on Instance uuid cae7cbe7-3337-4a3a-b93b-4a1bf61c8253 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:22:59 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-19d28341-96e8-4ab7-9cea-20a02f6c0d73 tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.647s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:22:59 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:23:04 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:23:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:23:10 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:23:11 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:23:11 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:23:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:23:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:23:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:23:11 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 01:23:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae7cbe7-3337-4a3a-b93b-4a1bf61c8253/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:23:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae7cbe7-3337-4a3a-b93b-4a1bf61c8253/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:23:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae7cbe7-3337-4a3a-b93b-4a1bf61c8253/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:23:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae7cbe7-3337-4a3a-b93b-4a1bf61c8253/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:23:12 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:23:12 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:23:12 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=9027MB free_disk=24.958003997802734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 01:23:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:23:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:23:12 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance cae7cbe7-3337-4a3a-b93b-4a1bf61c8253 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:23:12 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 01:23:12 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 01:23:12 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Refreshing inventories for resource provider fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 01:23:12 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Updating ProviderTree inventory for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 01:23:12 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Updating inventory in ProviderTree for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 01:23:12 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Refreshing aggregate associations for resource provider fe703abb-f68c-420d-a7f0-bf5240e23c54, aggregates: None {{(pid=74850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 01:23:13 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Refreshing trait associations for resource provider fe703abb-f68c-420d-a7f0-bf5240e23c54, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 01:23:13 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:23:13 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:23:13 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 01:23:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.313s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:23:14 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:23:19 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:23:20 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:23:20 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 01:23:20 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:23:21 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:23:21 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:23:21 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 01:23:21 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Rebuilding the list of instances to heal {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 01:23:21 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "refresh_cache-cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:23:21 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquired lock "refresh_cache-cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:23:21 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Forcefully refreshing network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 01:23:21 user nova-compute[74850]: DEBUG nova.objects.instance [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lazy-loading 'info_cache' on Instance uuid cae7cbe7-3337-4a3a-b93b-4a1bf61c8253 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:23:22 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Updating instance_info_cache with network_info: [{"id": "c9346a49-fcbf-4871-af15-5a3b10b48793", "address": "fa:16:3e:de:47:f9", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9346a49-fc", "ovs_interfaceid": "c9346a49-fcbf-4871-af15-5a3b10b48793", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:23:22 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Releasing lock "refresh_cache-cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:23:22 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Updated the network info_cache for instance {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 01:23:22 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:23:23 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:23:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:23:28 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:23:29 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:23:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-12837154-444d-4d4a-87f7-9bf9f80176ee tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquiring lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:23:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-12837154-444d-4d4a-87f7-9bf9f80176ee tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:23:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-12837154-444d-4d4a-87f7-9bf9f80176ee tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquiring lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:23:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-12837154-444d-4d4a-87f7-9bf9f80176ee tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:23:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-12837154-444d-4d4a-87f7-9bf9f80176ee tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:23:30 user nova-compute[74850]: INFO nova.compute.manager [None req-12837154-444d-4d4a-87f7-9bf9f80176ee tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Terminating instance
Nov 14 01:23:30 user nova-compute[74850]: DEBUG nova.compute.manager [None req-12837154-444d-4d4a-87f7-9bf9f80176ee tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 01:23:30 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:23:30 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:23:30 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:23:30 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:23:30 user nova-compute[74850]: DEBUG nova.compute.manager [req-b454cfa2-758c-4288-9f8e-2c82433e505c req-fad7edf2-7022-426f-b899-3cd334492e14 service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Received event network-vif-unplugged-c9346a49-fcbf-4871-af15-5a3b10b48793 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:23:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b454cfa2-758c-4288-9f8e-2c82433e505c req-fad7edf2-7022-426f-b899-3cd334492e14 service nova] Acquiring lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:23:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b454cfa2-758c-4288-9f8e-2c82433e505c req-fad7edf2-7022-426f-b899-3cd334492e14 service nova] Lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:23:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-b454cfa2-758c-4288-9f8e-2c82433e505c req-fad7edf2-7022-426f-b899-3cd334492e14 service nova] Lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:23:30 user nova-compute[74850]: DEBUG nova.compute.manager [req-b454cfa2-758c-4288-9f8e-2c82433e505c req-fad7edf2-7022-426f-b899-3cd334492e14 service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] No waiting events found dispatching network-vif-unplugged-c9346a49-fcbf-4871-af15-5a3b10b48793 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:23:30 user nova-compute[74850]: DEBUG nova.compute.manager [req-b454cfa2-758c-4288-9f8e-2c82433e505c req-fad7edf2-7022-426f-b899-3cd334492e14 service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Received event network-vif-unplugged-c9346a49-fcbf-4871-af15-5a3b10b48793 for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 01:23:31 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Instance destroyed successfully.
Nov 14 01:23:31 user nova-compute[74850]: DEBUG nova.objects.instance [None req-12837154-444d-4d4a-87f7-9bf9f80176ee tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lazy-loading 'resources' on Instance uuid cae7cbe7-3337-4a3a-b93b-4a1bf61c8253 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:23:31 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-12837154-444d-4d4a-87f7-9bf9f80176ee tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:18:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-53983429',display_name='tempest-TestMinimumBasicScenario-server-53983429',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-53983429',id=52,image_ref='28ddc848-21fb-4671-b317-f580045c9b35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCccf422bLKzQeIR6K/v485zTwgeFOktQIP4/VxAjzOZhyWA6TyJ9it1cdukEz1KdSOMWp86fuaBzrcqkz9V6adFuHZxPvlzawfZIIDRoy0l0FeHGNlDoqtP4EgTIzAGlA==',key_name='tempest-TestMinimumBasicScenario-1922317015',keypairs=<?>,launch_index=0,launched_at=2023-11-14T01:18:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0ae3f5d3814451c9c7d7264707c8334',ramdisk_id='',reservation_id='r-3s1kktvq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='28ddc848-21fb-4671-b317-f580045c9b35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2056291063',owner_user_name='tempest-TestMinimumBasicScenario-2056291063-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T01:20:53Z,user_data=None,user_id='534b22e8e0c7495f8d2f89dec7e9a66c',uuid=cae7cbe7-3337-4a3a-b93b-4a1bf61c8253,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9346a49-fcbf-4871-af15-5a3b10b48793", "address": "fa:16:3e:de:47:f9", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9346a49-fc", "ovs_interfaceid": "c9346a49-fcbf-4871-af15-5a3b10b48793", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 01:23:31 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-12837154-444d-4d4a-87f7-9bf9f80176ee tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Converting VIF {"id": "c9346a49-fcbf-4871-af15-5a3b10b48793", "address": "fa:16:3e:de:47:f9", "network": {"id": "7a6e0781-a6cd-4125-bdaf-9b9d53c4d254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874142127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ae3f5d3814451c9c7d7264707c8334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9346a49-fc", "ovs_interfaceid": "c9346a49-fcbf-4871-af15-5a3b10b48793", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:23:31 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-12837154-444d-4d4a-87f7-9bf9f80176ee tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:47:f9,bridge_name='br-int',has_traffic_filtering=True,id=c9346a49-fcbf-4871-af15-5a3b10b48793,network=Network(7a6e0781-a6cd-4125-bdaf-9b9d53c4d254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9346a49-fc') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:23:31 user nova-compute[74850]: DEBUG os_vif [None req-12837154-444d-4d4a-87f7-9bf9f80176ee tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:47:f9,bridge_name='br-int',has_traffic_filtering=True,id=c9346a49-fcbf-4871-af15-5a3b10b48793,network=Network(7a6e0781-a6cd-4125-bdaf-9b9d53c4d254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9346a49-fc') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 01:23:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:23:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9346a49-fc, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:23:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:23:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:23:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:23:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=653cf82b-4a80-4527-b1b8-1bb1bda7a8e0) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:23:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:23:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:23:31 user nova-compute[74850]: INFO os_vif [None req-12837154-444d-4d4a-87f7-9bf9f80176ee tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:47:f9,bridge_name='br-int',has_traffic_filtering=True,id=c9346a49-fcbf-4871-af15-5a3b10b48793,network=Network(7a6e0781-a6cd-4125-bdaf-9b9d53c4d254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9346a49-fc')
Nov 14 01:23:31 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-12837154-444d-4d4a-87f7-9bf9f80176ee tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Deleting instance files /opt/stack/data/nova/instances/cae7cbe7-3337-4a3a-b93b-4a1bf61c8253_del
Nov 14 01:23:31 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-12837154-444d-4d4a-87f7-9bf9f80176ee tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Deletion of /opt/stack/data/nova/instances/cae7cbe7-3337-4a3a-b93b-4a1bf61c8253_del complete
Nov 14 01:23:31 user nova-compute[74850]: INFO nova.compute.manager [None req-12837154-444d-4d4a-87f7-9bf9f80176ee tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 01:23:31 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-12837154-444d-4d4a-87f7-9bf9f80176ee tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 01:23:31 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 01:23:31 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 01:23:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:23:31 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:23:32 user nova-compute[74850]: DEBUG nova.compute.manager [req-d12dc44a-2d0b-4f57-8787-2d7042cc984f req-2eaf048d-1f1f-44a0-a251-3895a3054d4a service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Received event network-vif-deleted-c9346a49-fcbf-4871-af15-5a3b10b48793 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:23:32 user nova-compute[74850]: INFO nova.compute.manager [req-d12dc44a-2d0b-4f57-8787-2d7042cc984f req-2eaf048d-1f1f-44a0-a251-3895a3054d4a service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Neutron deleted interface c9346a49-fcbf-4871-af15-5a3b10b48793; detaching it from the instance and deleting it from the info cache
Nov 14 01:23:32 user nova-compute[74850]: DEBUG nova.network.neutron [req-d12dc44a-2d0b-4f57-8787-2d7042cc984f req-2eaf048d-1f1f-44a0-a251-3895a3054d4a service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:23:32 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Took 0.84 seconds to deallocate network for instance.
Nov 14 01:23:32 user nova-compute[74850]: DEBUG nova.compute.manager [req-d12dc44a-2d0b-4f57-8787-2d7042cc984f req-2eaf048d-1f1f-44a0-a251-3895a3054d4a service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Detach interface failed, port_id=c9346a49-fcbf-4871-af15-5a3b10b48793, reason: Instance cae7cbe7-3337-4a3a-b93b-4a1bf61c8253 could not be found. {{(pid=74850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 01:23:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-12837154-444d-4d4a-87f7-9bf9f80176ee tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:23:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-12837154-444d-4d4a-87f7-9bf9f80176ee tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:23:32 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-12837154-444d-4d4a-87f7-9bf9f80176ee tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:23:32 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-12837154-444d-4d4a-87f7-9bf9f80176ee tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:23:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-12837154-444d-4d4a-87f7-9bf9f80176ee tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.105s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:23:32 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-12837154-444d-4d4a-87f7-9bf9f80176ee tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Deleted allocations for instance cae7cbe7-3337-4a3a-b93b-4a1bf61c8253
Nov 14 01:23:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-12837154-444d-4d4a-87f7-9bf9f80176ee tempest-TestMinimumBasicScenario-2056291063 tempest-TestMinimumBasicScenario-2056291063-project-member] Lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.999s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:23:32 user nova-compute[74850]: DEBUG nova.compute.manager [req-3262a875-31f8-400f-920a-4cba4b071679 req-bf6a6538-1074-4fe3-a98b-f94bbb572dd2 service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Received event network-vif-plugged-c9346a49-fcbf-4871-af15-5a3b10b48793 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:23:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3262a875-31f8-400f-920a-4cba4b071679 req-bf6a6538-1074-4fe3-a98b-f94bbb572dd2 service nova] Acquiring lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:23:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3262a875-31f8-400f-920a-4cba4b071679 req-bf6a6538-1074-4fe3-a98b-f94bbb572dd2 service nova] Lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:23:32 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-3262a875-31f8-400f-920a-4cba4b071679 req-bf6a6538-1074-4fe3-a98b-f94bbb572dd2 service nova] Lock "cae7cbe7-3337-4a3a-b93b-4a1bf61c8253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:23:32 user nova-compute[74850]: DEBUG nova.compute.manager [req-3262a875-31f8-400f-920a-4cba4b071679 req-bf6a6538-1074-4fe3-a98b-f94bbb572dd2 service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] No waiting events found dispatching network-vif-plugged-c9346a49-fcbf-4871-af15-5a3b10b48793 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:23:32 user nova-compute[74850]: WARNING nova.compute.manager [req-3262a875-31f8-400f-920a-4cba4b071679 req-bf6a6538-1074-4fe3-a98b-f94bbb572dd2 service nova] [instance: cae7cbe7-3337-4a3a-b93b-4a1bf61c8253] Received unexpected event network-vif-plugged-c9346a49-fcbf-4871-af15-5a3b10b48793 for instance with vm_state deleted and task_state None.
Nov 14 01:23:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:23:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:23:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:23:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74850) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 01:23:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:23:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:23:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:23:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:23:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:23:56 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:24:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:24:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:24:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:24:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:24:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74850) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 01:24:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:24:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:24:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:24:11 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:24:12 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:24:12 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:24:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:24:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:24:12 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:24:12 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 01:24:13 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:24:13 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:24:13 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=9191MB free_disk=24.977550506591797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 01:24:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:24:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:24:13 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 01:24:13 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 01:24:13 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:24:13 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:24:13 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 01:24:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.147s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:24:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:24:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:24:21 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:24:21 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:24:21 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 01:24:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:24:22 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:24:22 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:24:22 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 01:24:22 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Rebuilding the list of instances to heal {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 01:24:22 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Didn't find any instances for network info cache update. {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 01:24:22 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:24:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:24:24 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:24:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:24:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:24:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:24:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:24:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:24:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:24:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:24:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74850) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 01:24:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:24:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:24:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:24:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:24:56 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:25:00 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:25:01 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:25:03 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:25:05 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:25:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:25:06 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:25:09 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:25:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:25:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:25:12 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:25:13 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:25:13 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:25:13 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:25:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:25:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:25:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:25:13 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 01:25:14 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:25:14 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:25:14 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=8902MB free_disk=25.010662078857422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 01:25:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:25:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:25:14 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 01:25:14 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 01:25:14 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:25:14 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:25:14 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 01:25:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.117s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:25:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:25:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:25:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Acquiring lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:25:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:25:18 user nova-compute[74850]: DEBUG nova.compute.manager [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Starting instance... {{(pid=74850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 01:25:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:25:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:25:18 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 01:25:18 user nova-compute[74850]: INFO nova.compute.claims [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Claim successful on node user
Nov 14 01:25:18 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:25:18 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:25:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.236s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:25:18 user nova-compute[74850]: DEBUG nova.compute.manager [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Start building networks asynchronously for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 01:25:18 user nova-compute[74850]: DEBUG nova.compute.manager [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Allocating IP information in the background. {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 01:25:18 user nova-compute[74850]: DEBUG nova.network.neutron [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] allocate_for_instance() {{(pid=74850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 01:25:18 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 01:25:19 user nova-compute[74850]: DEBUG nova.compute.manager [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Start building block device mappings for instance. {{(pid=74850) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 01:25:19 user nova-compute[74850]: DEBUG nova.policy [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '616a68485eaa4b8a935a529065768663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e517ca63f1964c6da6cad708365a13a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74850) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 01:25:19 user nova-compute[74850]: DEBUG nova.compute.manager [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Start spawning the instance on the hypervisor. {{(pid=74850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 01:25:19 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Creating instance directory {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 01:25:19 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Creating image(s)
Nov 14 01:25:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Acquiring lock "/opt/stack/data/nova/instances/87b33bb4-3f25-4897-82c3-cb774fb0bea2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:25:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "/opt/stack/data/nova/instances/87b33bb4-3f25-4897-82c3-cb774fb0bea2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:25:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "/opt/stack/data/nova/instances/87b33bb4-3f25-4897-82c3-cb774fb0bea2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:25:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:25:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.189s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:25:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Acquiring lock "d8782796252ae3281f279cfed3e405cd898e2549" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:25:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:25:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:25:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.193s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:25:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/87b33bb4-3f25-4897-82c3-cb774fb0bea2/disk 1073741824 {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:25:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549,backing_fmt=raw /opt/stack/data/nova/instances/87b33bb4-3f25-4897-82c3-cb774fb0bea2/disk 1073741824" returned: 0 in 0.069s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:25:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "d8782796252ae3281f279cfed3e405cd898e2549" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:25:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:25:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8782796252ae3281f279cfed3e405cd898e2549 --force-share --output=json" returned: 0 in 0.210s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:25:19 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Checking if we can resize image /opt/stack/data/nova/instances/87b33bb4-3f25-4897-82c3-cb774fb0bea2/disk. size=1073741824 {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 01:25:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b33bb4-3f25-4897-82c3-cb774fb0bea2/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:25:20 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b33bb4-3f25-4897-82c3-cb774fb0bea2/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:25:20 user nova-compute[74850]: DEBUG nova.virt.disk.api [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Cannot resize image /opt/stack/data/nova/instances/87b33bb4-3f25-4897-82c3-cb774fb0bea2/disk to a smaller size. {{(pid=74850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 01:25:20 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Created local disks {{(pid=74850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 01:25:20 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Ensure instance console log exists: /opt/stack/data/nova/instances/87b33bb4-3f25-4897-82c3-cb774fb0bea2/console.log {{(pid=74850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 01:25:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:25:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:25:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:25:20 user nova-compute[74850]: DEBUG nova.network.neutron [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Successfully created port: a25e20ce-1b3d-4e5b-8f3b-5c146716a682 {{(pid=74850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 01:25:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:25:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:25:21 user nova-compute[74850]: DEBUG nova.network.neutron [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Successfully updated port: a25e20ce-1b3d-4e5b-8f3b-5c146716a682 {{(pid=74850) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 01:25:21 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Acquiring lock "refresh_cache-87b33bb4-3f25-4897-82c3-cb774fb0bea2" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:25:21 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Acquired lock "refresh_cache-87b33bb4-3f25-4897-82c3-cb774fb0bea2" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:25:21 user nova-compute[74850]: DEBUG nova.network.neutron [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Building network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 01:25:21 user nova-compute[74850]: DEBUG nova.compute.manager [req-db0232eb-8fb8-4c6a-9a05-6e0dcfc6f2e8 req-682e369e-8146-4390-94a9-9ae2cbeeb74e service nova] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Received event network-changed-a25e20ce-1b3d-4e5b-8f3b-5c146716a682 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:25:21 user nova-compute[74850]: DEBUG nova.compute.manager [req-db0232eb-8fb8-4c6a-9a05-6e0dcfc6f2e8 req-682e369e-8146-4390-94a9-9ae2cbeeb74e service nova] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Refreshing instance network info cache due to event network-changed-a25e20ce-1b3d-4e5b-8f3b-5c146716a682. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:25:21 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-db0232eb-8fb8-4c6a-9a05-6e0dcfc6f2e8 req-682e369e-8146-4390-94a9-9ae2cbeeb74e service nova] Acquiring lock "refresh_cache-87b33bb4-3f25-4897-82c3-cb774fb0bea2" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:25:21 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:25:21 user nova-compute[74850]: DEBUG nova.network.neutron [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Instance cache missing network info. {{(pid=74850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 01:25:21 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:25:21 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG nova.network.neutron [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Updating instance_info_cache with network_info: [{"id": "a25e20ce-1b3d-4e5b-8f3b-5c146716a682", "address": "fa:16:3e:d8:a2:2b", "network": {"id": "943fc504-ca87-4ae7-85c0-7d167e59aa1b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1690202443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e517ca63f1964c6da6cad708365a13a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25e20ce-1b", "ovs_interfaceid": "a25e20ce-1b3d-4e5b-8f3b-5c146716a682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Releasing lock "refresh_cache-87b33bb4-3f25-4897-82c3-cb774fb0bea2" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG nova.compute.manager [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Instance network_info: |[{"id": "a25e20ce-1b3d-4e5b-8f3b-5c146716a682", "address": "fa:16:3e:d8:a2:2b", "network": {"id": "943fc504-ca87-4ae7-85c0-7d167e59aa1b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1690202443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e517ca63f1964c6da6cad708365a13a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25e20ce-1b", "ovs_interfaceid": "a25e20ce-1b3d-4e5b-8f3b-5c146716a682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-db0232eb-8fb8-4c6a-9a05-6e0dcfc6f2e8 req-682e369e-8146-4390-94a9-9ae2cbeeb74e service nova] Acquired lock "refresh_cache-87b33bb4-3f25-4897-82c3-cb774fb0bea2" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG nova.network.neutron [req-db0232eb-8fb8-4c6a-9a05-6e0dcfc6f2e8 req-682e369e-8146-4390-94a9-9ae2cbeeb74e service nova] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Refreshing network info cache for port a25e20ce-1b3d-4e5b-8f3b-5c146716a682 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Start _get_guest_xml network_info=[{"id": "a25e20ce-1b3d-4e5b-8f3b-5c146716a682", "address": "fa:16:3e:d8:a2:2b", "network": {"id": "943fc504-ca87-4ae7-85c0-7d167e59aa1b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1690202443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e517ca63f1964c6da6cad708365a13a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25e20ce-1b", "ovs_interfaceid": "a25e20ce-1b3d-4e5b-8f3b-5c146716a682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '5ed46099-4abf-4916-8deb-e38edb515c26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 01:25:22 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:25:22 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:25:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] CPU controller missing on host. {{(pid=74850) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.host [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] CPU controller found on host. {{(pid=74850) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T00:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:41:06Z,direct_url=<?>,disk_format='qcow2',id=5ed46099-4abf-4916-8deb-e38edb515c26,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='58c870909f43417296374f1a23c8af0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Flavor limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Image limits 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Flavor pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Image pref 0:0:0 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Got 1 possible topologies {{(pid=74850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG nova.virt.hardware [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-161944321',display_name='tempest-SnapshotDataIntegrityTests-server-161944321',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-161944321',id=53,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIfcvNTD/fUHLa6TVlEjXmh15J/5EkBvriPQW1tNwh7kkj2gbJg6NXMWRT0iXpwSXgPT/p7jZh4csiJ35pOzUomNDvIg3iNUILfxQ8ef6XFVifgqJPtpc3iOfceM6cy0uw==',key_name='tempest-keypair-2111339531',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e517ca63f1964c6da6cad708365a13a7',ramdisk_id='',reservation_id='r-zontt3zb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1320156603',owner_user_name='tempest-SnapshotDataIntegrityTests-1320156603-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:25:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='616a68485eaa4b8a935a529065768663',uuid=87b33bb4-3f25-4897-82c3-cb774fb0bea2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a25e20ce-1b3d-4e5b-8f3b-5c146716a682", "address": "fa:16:3e:d8:a2:2b", "network": {"id": "943fc504-ca87-4ae7-85c0-7d167e59aa1b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1690202443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e517ca63f1964c6da6cad708365a13a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25e20ce-1b", "ovs_interfaceid": "a25e20ce-1b3d-4e5b-8f3b-5c146716a682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Converting VIF {"id": "a25e20ce-1b3d-4e5b-8f3b-5c146716a682", "address": "fa:16:3e:d8:a2:2b", "network": {"id": "943fc504-ca87-4ae7-85c0-7d167e59aa1b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1690202443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e517ca63f1964c6da6cad708365a13a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25e20ce-1b", "ovs_interfaceid": "a25e20ce-1b3d-4e5b-8f3b-5c146716a682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:a2:2b,bridge_name='br-int',has_traffic_filtering=True,id=a25e20ce-1b3d-4e5b-8f3b-5c146716a682,network=Network(943fc504-ca87-4ae7-85c0-7d167e59aa1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa25e20ce-1b') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG nova.objects.instance [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lazy-loading 'pci_devices' on Instance uuid 87b33bb4-3f25-4897-82c3-cb774fb0bea2 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] End _get_guest_xml xml=<domain type="kvm">
Nov 14 01:25:22 user nova-compute[74850]:   <uuid>87b33bb4-3f25-4897-82c3-cb774fb0bea2</uuid>
Nov 14 01:25:22 user nova-compute[74850]:   <name>instance-00000035</name>
Nov 14 01:25:22 user nova-compute[74850]:   <memory>524288</memory>
Nov 14 01:25:22 user nova-compute[74850]:   <vcpu>1</vcpu>
Nov 14 01:25:22 user nova-compute[74850]:   <metadata>
Nov 14 01:25:22 user nova-compute[74850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 01:25:22 user nova-compute[74850]:       <nova:package version="0.0.0"/>
Nov 14 01:25:22 user nova-compute[74850]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-161944321</nova:name>
Nov 14 01:25:22 user nova-compute[74850]:       <nova:creationTime>2023-11-14 01:25:22</nova:creationTime>
Nov 14 01:25:22 user nova-compute[74850]:       <nova:flavor name="m1.tiny">
Nov 14 01:25:22 user nova-compute[74850]:         <nova:memory>512</nova:memory>
Nov 14 01:25:22 user nova-compute[74850]:         <nova:disk>1</nova:disk>
Nov 14 01:25:22 user nova-compute[74850]:         <nova:swap>0</nova:swap>
Nov 14 01:25:22 user nova-compute[74850]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 01:25:22 user nova-compute[74850]:         <nova:vcpus>1</nova:vcpus>
Nov 14 01:25:22 user nova-compute[74850]:       </nova:flavor>
Nov 14 01:25:22 user nova-compute[74850]:       <nova:owner>
Nov 14 01:25:22 user nova-compute[74850]:         <nova:user uuid="616a68485eaa4b8a935a529065768663">tempest-SnapshotDataIntegrityTests-1320156603-project-member</nova:user>
Nov 14 01:25:22 user nova-compute[74850]:         <nova:project uuid="e517ca63f1964c6da6cad708365a13a7">tempest-SnapshotDataIntegrityTests-1320156603</nova:project>
Nov 14 01:25:22 user nova-compute[74850]:       </nova:owner>
Nov 14 01:25:22 user nova-compute[74850]:       <nova:root type="image" uuid="5ed46099-4abf-4916-8deb-e38edb515c26"/>
Nov 14 01:25:22 user nova-compute[74850]:       <nova:ports>
Nov 14 01:25:22 user nova-compute[74850]:         <nova:port uuid="a25e20ce-1b3d-4e5b-8f3b-5c146716a682">
Nov 14 01:25:22 user nova-compute[74850]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 01:25:22 user nova-compute[74850]:         </nova:port>
Nov 14 01:25:22 user nova-compute[74850]:       </nova:ports>
Nov 14 01:25:22 user nova-compute[74850]:     </nova:instance>
Nov 14 01:25:22 user nova-compute[74850]:   </metadata>
Nov 14 01:25:22 user nova-compute[74850]:   <sysinfo type="smbios">
Nov 14 01:25:22 user nova-compute[74850]:     <system>
Nov 14 01:25:22 user nova-compute[74850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 01:25:22 user nova-compute[74850]:       <entry name="product">OpenStack Nova</entry>
Nov 14 01:25:22 user nova-compute[74850]:       <entry name="version">0.0.0</entry>
Nov 14 01:25:22 user nova-compute[74850]:       <entry name="serial">87b33bb4-3f25-4897-82c3-cb774fb0bea2</entry>
Nov 14 01:25:22 user nova-compute[74850]:       <entry name="uuid">87b33bb4-3f25-4897-82c3-cb774fb0bea2</entry>
Nov 14 01:25:22 user nova-compute[74850]:       <entry name="family">Virtual Machine</entry>
Nov 14 01:25:22 user nova-compute[74850]:     </system>
Nov 14 01:25:22 user nova-compute[74850]:   </sysinfo>
Nov 14 01:25:22 user nova-compute[74850]:   <os>
Nov 14 01:25:22 user nova-compute[74850]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 01:25:22 user nova-compute[74850]:     <boot dev="hd"/>
Nov 14 01:25:22 user nova-compute[74850]:     <smbios mode="sysinfo"/>
Nov 14 01:25:22 user nova-compute[74850]:   </os>
Nov 14 01:25:22 user nova-compute[74850]:   <features>
Nov 14 01:25:22 user nova-compute[74850]:     <acpi/>
Nov 14 01:25:22 user nova-compute[74850]:     <apic/>
Nov 14 01:25:22 user nova-compute[74850]:     <vmcoreinfo/>
Nov 14 01:25:22 user nova-compute[74850]:   </features>
Nov 14 01:25:22 user nova-compute[74850]:   <clock offset="utc">
Nov 14 01:25:22 user nova-compute[74850]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 01:25:22 user nova-compute[74850]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 01:25:22 user nova-compute[74850]:     <timer name="hpet" present="no"/>
Nov 14 01:25:22 user nova-compute[74850]:   </clock>
Nov 14 01:25:22 user nova-compute[74850]:   <cpu mode="custom" match="exact">
Nov 14 01:25:22 user nova-compute[74850]:     <model>Nehalem</model>
Nov 14 01:25:22 user nova-compute[74850]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 01:25:22 user nova-compute[74850]:   </cpu>
Nov 14 01:25:22 user nova-compute[74850]:   <devices>
Nov 14 01:25:22 user nova-compute[74850]:     <disk type="file" device="disk">
Nov 14 01:25:22 user nova-compute[74850]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 01:25:22 user nova-compute[74850]:       <source file="/opt/stack/data/nova/instances/87b33bb4-3f25-4897-82c3-cb774fb0bea2/disk"/>
Nov 14 01:25:22 user nova-compute[74850]:       <target dev="vda" bus="virtio"/>
Nov 14 01:25:22 user nova-compute[74850]:     </disk>
Nov 14 01:25:22 user nova-compute[74850]:     <interface type="ethernet">
Nov 14 01:25:22 user nova-compute[74850]:       <mac address="fa:16:3e:d8:a2:2b"/>
Nov 14 01:25:22 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:25:22 user nova-compute[74850]:       <mtu size="1442"/>
Nov 14 01:25:22 user nova-compute[74850]:       <target dev="tapa25e20ce-1b"/>
Nov 14 01:25:22 user nova-compute[74850]:     </interface>
Nov 14 01:25:22 user nova-compute[74850]:     <serial type="pty">
Nov 14 01:25:22 user nova-compute[74850]:       <log file="/opt/stack/data/nova/instances/87b33bb4-3f25-4897-82c3-cb774fb0bea2/console.log" append="off"/>
Nov 14 01:25:22 user nova-compute[74850]:     </serial>
Nov 14 01:25:22 user nova-compute[74850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 01:25:22 user nova-compute[74850]:     <video>
Nov 14 01:25:22 user nova-compute[74850]:       <model type="virtio"/>
Nov 14 01:25:22 user nova-compute[74850]:     </video>
Nov 14 01:25:22 user nova-compute[74850]:     <rng model="virtio">
Nov 14 01:25:22 user nova-compute[74850]:       <backend model="random">/dev/urandom</backend>
Nov 14 01:25:22 user nova-compute[74850]:     </rng>
Nov 14 01:25:22 user nova-compute[74850]:     <controller type="usb" index="0" model="none"/>
Nov 14 01:25:22 user nova-compute[74850]:     <memballoon model="virtio">
Nov 14 01:25:22 user nova-compute[74850]:       <stats period="10"/>
Nov 14 01:25:22 user nova-compute[74850]:     </memballoon>
Nov 14 01:25:22 user nova-compute[74850]:   </devices>
Nov 14 01:25:22 user nova-compute[74850]: </domain>
Nov 14 01:25:22 user nova-compute[74850]:  {{(pid=74850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-161944321',display_name='tempest-SnapshotDataIntegrityTests-server-161944321',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-161944321',id=53,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIfcvNTD/fUHLa6TVlEjXmh15J/5EkBvriPQW1tNwh7kkj2gbJg6NXMWRT0iXpwSXgPT/p7jZh4csiJ35pOzUomNDvIg3iNUILfxQ8ef6XFVifgqJPtpc3iOfceM6cy0uw==',key_name='tempest-keypair-2111339531',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e517ca63f1964c6da6cad708365a13a7',ramdisk_id='',reservation_id='r-zontt3zb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1320156603',owner_user_name='tempest-SnapshotDataIntegrityTests-1320156603-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T01:25:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='616a68485eaa4b8a935a529065768663',uuid=87b33bb4-3f25-4897-82c3-cb774fb0bea2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a25e20ce-1b3d-4e5b-8f3b-5c146716a682", "address": "fa:16:3e:d8:a2:2b", "network": {"id": "943fc504-ca87-4ae7-85c0-7d167e59aa1b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1690202443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e517ca63f1964c6da6cad708365a13a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25e20ce-1b", "ovs_interfaceid": "a25e20ce-1b3d-4e5b-8f3b-5c146716a682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Converting VIF {"id": "a25e20ce-1b3d-4e5b-8f3b-5c146716a682", "address": "fa:16:3e:d8:a2:2b", "network": {"id": "943fc504-ca87-4ae7-85c0-7d167e59aa1b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1690202443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e517ca63f1964c6da6cad708365a13a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25e20ce-1b", "ovs_interfaceid": "a25e20ce-1b3d-4e5b-8f3b-5c146716a682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:a2:2b,bridge_name='br-int',has_traffic_filtering=True,id=a25e20ce-1b3d-4e5b-8f3b-5c146716a682,network=Network(943fc504-ca87-4ae7-85c0-7d167e59aa1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa25e20ce-1b') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG os_vif [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:a2:2b,bridge_name='br-int',has_traffic_filtering=True,id=a25e20ce-1b3d-4e5b-8f3b-5c146716a682,network=Network(943fc504-ca87-4ae7-85c0-7d167e59aa1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa25e20ce-1b') {{(pid=74850) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '76ef93f0-3672-5e22-ae7c-48e5a0433fa8', '_type': 'linux-noop'}}, row=False) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa25e20ce-1b, may_exist=True, interface_attrs={}) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa25e20ce-1b, col_values=(('qos', UUID('fb7bd9d0-56e0-4ba5-81c3-6ebf0520ac86')),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa25e20ce-1b, col_values=(('external_ids', {'iface-id': 'a25e20ce-1b3d-4e5b-8f3b-5c146716a682', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:a2:2b', 'vm-uuid': '87b33bb4-3f25-4897-82c3-cb774fb0bea2'}),), if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:25:22 user nova-compute[74850]: INFO os_vif [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:a2:2b,bridge_name='br-int',has_traffic_filtering=True,id=a25e20ce-1b3d-4e5b-8f3b-5c146716a682,network=Network(943fc504-ca87-4ae7-85c0-7d167e59aa1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa25e20ce-1b')
Nov 14 01:25:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] No VIF found with MAC fa:16:3e:d8:a2:2b, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG nova.network.neutron [req-db0232eb-8fb8-4c6a-9a05-6e0dcfc6f2e8 req-682e369e-8146-4390-94a9-9ae2cbeeb74e service nova] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Updated VIF entry in instance network info cache for port a25e20ce-1b3d-4e5b-8f3b-5c146716a682. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG nova.network.neutron [req-db0232eb-8fb8-4c6a-9a05-6e0dcfc6f2e8 req-682e369e-8146-4390-94a9-9ae2cbeeb74e service nova] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Updating instance_info_cache with network_info: [{"id": "a25e20ce-1b3d-4e5b-8f3b-5c146716a682", "address": "fa:16:3e:d8:a2:2b", "network": {"id": "943fc504-ca87-4ae7-85c0-7d167e59aa1b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1690202443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e517ca63f1964c6da6cad708365a13a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25e20ce-1b", "ovs_interfaceid": "a25e20ce-1b3d-4e5b-8f3b-5c146716a682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-db0232eb-8fb8-4c6a-9a05-6e0dcfc6f2e8 req-682e369e-8146-4390-94a9-9ae2cbeeb74e service nova] Releasing lock "refresh_cache-87b33bb4-3f25-4897-82c3-cb774fb0bea2" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:25:22 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:25:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:25:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:25:23 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:25:24 user nova-compute[74850]: DEBUG nova.compute.manager [req-a7060467-3954-4edb-b671-55a0e8af16e4 req-3ec27a41-ae55-498c-b2c5-d6dbdefa6147 service nova] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Received event network-vif-plugged-a25e20ce-1b3d-4e5b-8f3b-5c146716a682 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:25:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a7060467-3954-4edb-b671-55a0e8af16e4 req-3ec27a41-ae55-498c-b2c5-d6dbdefa6147 service nova] Acquiring lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:25:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a7060467-3954-4edb-b671-55a0e8af16e4 req-3ec27a41-ae55-498c-b2c5-d6dbdefa6147 service nova] Lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:25:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-a7060467-3954-4edb-b671-55a0e8af16e4 req-3ec27a41-ae55-498c-b2c5-d6dbdefa6147 service nova] Lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:25:24 user nova-compute[74850]: DEBUG nova.compute.manager [req-a7060467-3954-4edb-b671-55a0e8af16e4 req-3ec27a41-ae55-498c-b2c5-d6dbdefa6147 service nova] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] No waiting events found dispatching network-vif-plugged-a25e20ce-1b3d-4e5b-8f3b-5c146716a682 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:25:24 user nova-compute[74850]: WARNING nova.compute.manager [req-a7060467-3954-4edb-b671-55a0e8af16e4 req-3ec27a41-ae55-498c-b2c5-d6dbdefa6147 service nova] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Received unexpected event network-vif-plugged-a25e20ce-1b3d-4e5b-8f3b-5c146716a682 for instance with vm_state building and task_state spawning.
Nov 14 01:25:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:25:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:25:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:25:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:25:24 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:25:24 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 01:25:24 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Rebuilding the list of instances to heal {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 01:25:24 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Skipping network cache update for instance because it is Building. {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 01:25:24 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Didn't find any instances for network info cache update. {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 01:25:26 user nova-compute[74850]: DEBUG nova.compute.manager [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Instance event wait completed in 0 seconds for  {{(pid=74850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 01:25:26 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Guest created on hypervisor {{(pid=74850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 01:25:26 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Instance spawned successfully.
Nov 14 01:25:26 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 01:25:26 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Found default for hw_cdrom_bus of ide {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:25:26 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Found default for hw_disk_bus of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:25:26 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Found default for hw_input_bus of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:25:26 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Found default for hw_pointer_model of None {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:25:26 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Found default for hw_video_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:25:26 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Found default for hw_vif_model of virtio {{(pid=74850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 01:25:26 user nova-compute[74850]: DEBUG nova.compute.manager [req-97e9857e-e607-4e04-b7d9-7e565b5349cb req-d47106e2-01db-4ce4-a8c1-0db2a8d1ec23 service nova] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Received event network-vif-plugged-a25e20ce-1b3d-4e5b-8f3b-5c146716a682 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:25:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-97e9857e-e607-4e04-b7d9-7e565b5349cb req-d47106e2-01db-4ce4-a8c1-0db2a8d1ec23 service nova] Acquiring lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:25:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-97e9857e-e607-4e04-b7d9-7e565b5349cb req-d47106e2-01db-4ce4-a8c1-0db2a8d1ec23 service nova] Lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:25:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-97e9857e-e607-4e04-b7d9-7e565b5349cb req-d47106e2-01db-4ce4-a8c1-0db2a8d1ec23 service nova] Lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:25:26 user nova-compute[74850]: DEBUG nova.compute.manager [req-97e9857e-e607-4e04-b7d9-7e565b5349cb req-d47106e2-01db-4ce4-a8c1-0db2a8d1ec23 service nova] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] No waiting events found dispatching network-vif-plugged-a25e20ce-1b3d-4e5b-8f3b-5c146716a682 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:25:26 user nova-compute[74850]: WARNING nova.compute.manager [req-97e9857e-e607-4e04-b7d9-7e565b5349cb req-d47106e2-01db-4ce4-a8c1-0db2a8d1ec23 service nova] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Received unexpected event network-vif-plugged-a25e20ce-1b3d-4e5b-8f3b-5c146716a682 for instance with vm_state building and task_state spawning.
Nov 14 01:25:26 user nova-compute[74850]: INFO nova.compute.manager [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Took 7.08 seconds to spawn the instance on the hypervisor.
Nov 14 01:25:26 user nova-compute[74850]: DEBUG nova.compute.manager [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Checking state {{(pid=74850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 01:25:26 user nova-compute[74850]: INFO nova.compute.manager [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Took 7.68 seconds to build instance.
Nov 14 01:25:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c9e3a2f1-1911-4889-a8d6-2ec6bd2a58c9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.809s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:25:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:25:26 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:25:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:25:29 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:25:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:25:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:25:36 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:25:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:25:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:25:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:25:46 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:25:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:25:51 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:25:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:25:56 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:25:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:26:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:26:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:26:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:26:13 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:26:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:26:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:26:13 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:26:13 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 01:26:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b33bb4-3f25-4897-82c3-cb774fb0bea2/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:26:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b33bb4-3f25-4897-82c3-cb774fb0bea2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:26:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b33bb4-3f25-4897-82c3-cb774fb0bea2/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:26:14 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b33bb4-3f25-4897-82c3-cb774fb0bea2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:26:14 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:26:14 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:26:14 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=9068MB free_disk=24.971710205078125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 01:26:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:26:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:26:14 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 87b33bb4-3f25-4897-82c3-cb774fb0bea2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:26:14 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 01:26:14 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 01:26:14 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:26:14 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:26:14 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 01:26:14 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:26:15 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:26:15 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:26:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:26:21 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:26:21 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 01:26:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:26:22 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:26:23 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:26:23 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:26:24 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:26:26 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:26:26 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 01:26:26 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Rebuilding the list of instances to heal {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 01:26:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "refresh_cache-87b33bb4-3f25-4897-82c3-cb774fb0bea2" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:26:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquired lock "refresh_cache-87b33bb4-3f25-4897-82c3-cb774fb0bea2" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:26:27 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Forcefully refreshing network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 01:26:27 user nova-compute[74850]: DEBUG nova.objects.instance [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lazy-loading 'info_cache' on Instance uuid 87b33bb4-3f25-4897-82c3-cb774fb0bea2 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:26:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:26:27 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Updating instance_info_cache with network_info: [{"id": "a25e20ce-1b3d-4e5b-8f3b-5c146716a682", "address": "fa:16:3e:d8:a2:2b", "network": {"id": "943fc504-ca87-4ae7-85c0-7d167e59aa1b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1690202443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e517ca63f1964c6da6cad708365a13a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25e20ce-1b", "ovs_interfaceid": "a25e20ce-1b3d-4e5b-8f3b-5c146716a682", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:26:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Releasing lock "refresh_cache-87b33bb4-3f25-4897-82c3-cb774fb0bea2" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:26:27 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Updated the network info_cache for instance {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 01:26:27 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:26:28 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:26:28 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74850) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 01:26:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:26:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:26:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:26:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:26:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74850) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 01:26:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:26:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:26:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:26:45 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:26:45 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Cleaning up deleted instances {{(pid=74850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 01:26:45 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] There are 0 instances to clean {{(pid=74850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 01:26:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:26:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:26:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:27:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:27:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:27:09 user nova-compute[74850]: DEBUG nova.compute.manager [req-ffb7ef51-e4b2-4be9-a678-42470c2b0d55 req-0461ba96-a0da-49ec-a0ac-4226bca6f58b service nova] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Received event network-changed-a25e20ce-1b3d-4e5b-8f3b-5c146716a682 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:27:09 user nova-compute[74850]: DEBUG nova.compute.manager [req-ffb7ef51-e4b2-4be9-a678-42470c2b0d55 req-0461ba96-a0da-49ec-a0ac-4226bca6f58b service nova] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Refreshing instance network info cache due to event network-changed-a25e20ce-1b3d-4e5b-8f3b-5c146716a682. {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 01:27:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ffb7ef51-e4b2-4be9-a678-42470c2b0d55 req-0461ba96-a0da-49ec-a0ac-4226bca6f58b service nova] Acquiring lock "refresh_cache-87b33bb4-3f25-4897-82c3-cb774fb0bea2" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:27:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ffb7ef51-e4b2-4be9-a678-42470c2b0d55 req-0461ba96-a0da-49ec-a0ac-4226bca6f58b service nova] Acquired lock "refresh_cache-87b33bb4-3f25-4897-82c3-cb774fb0bea2" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:27:09 user nova-compute[74850]: DEBUG nova.network.neutron [req-ffb7ef51-e4b2-4be9-a678-42470c2b0d55 req-0461ba96-a0da-49ec-a0ac-4226bca6f58b service nova] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Refreshing network info cache for port a25e20ce-1b3d-4e5b-8f3b-5c146716a682 {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 01:27:09 user nova-compute[74850]: DEBUG nova.network.neutron [req-ffb7ef51-e4b2-4be9-a678-42470c2b0d55 req-0461ba96-a0da-49ec-a0ac-4226bca6f58b service nova] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Updated VIF entry in instance network info cache for port a25e20ce-1b3d-4e5b-8f3b-5c146716a682. {{(pid=74850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 01:27:09 user nova-compute[74850]: DEBUG nova.network.neutron [req-ffb7ef51-e4b2-4be9-a678-42470c2b0d55 req-0461ba96-a0da-49ec-a0ac-4226bca6f58b service nova] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Updating instance_info_cache with network_info: [{"id": "a25e20ce-1b3d-4e5b-8f3b-5c146716a682", "address": "fa:16:3e:d8:a2:2b", "network": {"id": "943fc504-ca87-4ae7-85c0-7d167e59aa1b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1690202443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e517ca63f1964c6da6cad708365a13a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25e20ce-1b", "ovs_interfaceid": "a25e20ce-1b3d-4e5b-8f3b-5c146716a682", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:27:09 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ffb7ef51-e4b2-4be9-a678-42470c2b0d55 req-0461ba96-a0da-49ec-a0ac-4226bca6f58b service nova] Releasing lock "refresh_cache-87b33bb4-3f25-4897-82c3-cb774fb0bea2" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:27:11 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:27:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Acquiring lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:27:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:27:11 user nova-compute[74850]: DEBUG nova.objects.instance [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lazy-loading 'flavor' on Instance uuid 87b33bb4-3f25-4897-82c3-cb774fb0bea2 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:27:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:27:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Acquiring lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:27:11 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:27:11 user nova-compute[74850]: INFO nova.compute.manager [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Attaching volume a34beb1b-f5f6-4a62-b069-7377366550c1 to /dev/vdb
Nov 14 01:27:11 user nova-compute[74850]: DEBUG os_brick.utils [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:27:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:27:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:27:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe63159-cdcb-4f39-b09a-c3585ba2fe35]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:27:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:27:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:27:11 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea51fecb-0d98-4dea-b87e-12e63065c311]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:27:11 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:27:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:27:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e2b379-707c-4de9-a447-b889da9e2c79]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:27:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0510e7-f812-40c6-991f-52897eb484c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:27:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:27:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:27:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 01:27:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:27:12 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:27:12 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 01:27:12 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[291ca33d-3c68-4d26-a446-e82f7161ba7c]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:27:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 01:27:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 01:27:12 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 01:27:12 user nova-compute[74850]: DEBUG os_brick.utils [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:27:12 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Updating existing volume attachment record: bebb6858-9b6d-42b1-ac64-a55e54b5d689 {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 01:27:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:27:15 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:27:15 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:27:15 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:27:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:27:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:27:15 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:27:15 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b33bb4-3f25-4897-82c3-cb774fb0bea2/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'scuvnWlT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:27:16 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:27:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:27:16 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:27:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:27:16 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 01:27:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1 -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[07aef279-1fe0-45c2-b572-fbb8d74ea9db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 01:27:16 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d146108c-d6cc-491d-bcea-eff9880c26b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1] added
Nov 14 01:27:16 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab1ae9a-9f7d-4229-9bc7-29d3a78f6670]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[17424157-ac00-4b11-b4ed-133f3bfa394e]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v scuvnWlT {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v scuvnWlT" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1c1d50-abb0-4eb9-bbac-b6f4e9ae068b]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'scuvnWlT'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a65744-d9bb-4d9a-b661-9d6a91b7963b]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b33bb4-3f25-4897-82c3-cb774fb0bea2/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b33bb4-3f25-4897-82c3-cb774fb0bea2/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6f4d9d-66d2-4e8e-a4b5-655ea71c6ee9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 01:27:16 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 01:27:16 user nova-compute[74850]:  {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:27:16 user nova-compute[74850]: WARNING os_brick.initiator.connectors.iscsi [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 01:27:16 user nova-compute[74850]: 
Nov 14 01:27:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1 -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca69e74c-dd37-46c2-9be6-541a8a4bd4b7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1, portal: 172.16.0.220,3260]
Nov 14 01:27:16 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1, portal: 172.16.0.220,3260] successful.
Nov 14 01:27:16 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e534499c-d98a-4b47-a148-035d4969b116]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ca577f-9c5b-4cf4-8aca-9233d1813544]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1 (non-flash)
Nov 14 01:27:16 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1 (non-flash)
Nov 14 01:27:16 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[726c569e-8076-4dc5-95da-8e201c9d76b1]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'scuvnWlT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b33bb4-3f25-4897-82c3-cb774fb0bea2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:27:16 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:27:16 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:27:16 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=9029MB free_disk=24.970882415771484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:27:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:27:17 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 87b33bb4-3f25-4897-82c3-cb774fb0bea2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:27:17 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 01:27:17 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 01:27:17 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:27:17 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:27:17 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 01:27:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.280s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:27:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:27:17 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:27:17 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23964393438343334', 'path': '/dev/sdb'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:27:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964393438343334', 'path': '/dev/sdb'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 01:27:17 user nova-compute[74850]: DEBUG nova.objects.instance [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lazy-loading 'flavor' on Instance uuid 87b33bb4-3f25-4897-82c3-cb774fb0bea2 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:27:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 01:27:17 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:27:17 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 01:27:17 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:27:17 user nova-compute[74850]:   <serial>a34beb1b-f5f6-4a62-b069-7377366550c1</serial>
Nov 14 01:27:17 user nova-compute[74850]: </disk>
Nov 14 01:27:17 user nova-compute[74850]:  {{(pid=74850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 01:27:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:27:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:27:17 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] No VIF found with MAC fa:16:3e:d8:a2:2b, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:27:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-498d2a41-1574-4cb8-9229-628c08527ce9 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.102s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:27:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:27:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:27:23 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:27:23 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:27:23 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 01:27:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2bcefdc0-507c-45a9-8233-7d862c1268ec tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Acquiring lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:27:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2bcefdc0-507c-45a9-8233-7d862c1268ec tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:27:25 user nova-compute[74850]: INFO nova.compute.manager [None req-2bcefdc0-507c-45a9-8233-7d862c1268ec tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Detaching volume a34beb1b-f5f6-4a62-b069-7377366550c1
Nov 14 01:27:25 user nova-compute[74850]: INFO nova.virt.block_device [None req-2bcefdc0-507c-45a9-8233-7d862c1268ec tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Attempting to driver detach volume a34beb1b-f5f6-4a62-b069-7377366550c1 from mountpoint /dev/vdb
Nov 14 01:27:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2bcefdc0-507c-45a9-8233-7d862c1268ec tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Attempting to detach device vdb from instance 87b33bb4-3f25-4897-82c3-cb774fb0bea2 from the persistent domain config. {{(pid=74850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 01:27:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-2bcefdc0-507c-45a9-8233-7d862c1268ec tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:27:25 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:27:25 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 01:27:25 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:27:25 user nova-compute[74850]:   <serial>a34beb1b-f5f6-4a62-b069-7377366550c1</serial>
Nov 14 01:27:25 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 01:27:25 user nova-compute[74850]: </disk>
Nov 14 01:27:25 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:27:25 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-2bcefdc0-507c-45a9-8233-7d862c1268ec tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Successfully detached device vdb from instance 87b33bb4-3f25-4897-82c3-cb774fb0bea2 from the persistent domain config.
Nov 14 01:27:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2bcefdc0-507c-45a9-8233-7d862c1268ec tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 87b33bb4-3f25-4897-82c3-cb774fb0bea2 from the live domain config. {{(pid=74850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 01:27:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-2bcefdc0-507c-45a9-8233-7d862c1268ec tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:27:25 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:27:25 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 01:27:25 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:27:25 user nova-compute[74850]:   <serial>a34beb1b-f5f6-4a62-b069-7377366550c1</serial>
Nov 14 01:27:25 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 01:27:25 user nova-compute[74850]: </disk>
Nov 14 01:27:25 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:27:25 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:27:26 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-2bcefdc0-507c-45a9-8233-7d862c1268ec tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 87b33bb4-3f25-4897-82c3-cb774fb0bea2 {{(pid=74850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 01:27:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:27:26 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:27:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:27:27 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:27:27 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 01:27:27 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Rebuilding the list of instances to heal {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 01:27:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "refresh_cache-87b33bb4-3f25-4897-82c3-cb774fb0bea2" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:27:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquired lock "refresh_cache-87b33bb4-3f25-4897-82c3-cb774fb0bea2" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:27:27 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Forcefully refreshing network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 01:27:27 user nova-compute[74850]: DEBUG nova.objects.instance [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lazy-loading 'info_cache' on Instance uuid 87b33bb4-3f25-4897-82c3-cb774fb0bea2 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:27:28 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Updating instance_info_cache with network_info: [{"id": "a25e20ce-1b3d-4e5b-8f3b-5c146716a682", "address": "fa:16:3e:d8:a2:2b", "network": {"id": "943fc504-ca87-4ae7-85c0-7d167e59aa1b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1690202443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e517ca63f1964c6da6cad708365a13a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25e20ce-1b", "ovs_interfaceid": "a25e20ce-1b3d-4e5b-8f3b-5c146716a682", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:27:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Releasing lock "refresh_cache-87b33bb4-3f25-4897-82c3-cb774fb0bea2" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:27:28 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Updated the network info_cache for instance {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 01:27:28 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:27:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:27:33 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:27:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:27:41 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:27:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:27:46 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-2bcefdc0-507c-45a9-8233-7d862c1268ec tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 87b33bb4-3f25-4897-82c3-cb774fb0bea2 is timed out.
Nov 14 01:27:46 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-2bcefdc0-507c-45a9-8233-7d862c1268ec tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Successfully detached device vdb from instance 87b33bb4-3f25-4897-82c3-cb774fb0bea2 from the live domain config.
Nov 14 01:27:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bcefdc0-507c-45a9-8233-7d862c1268ec tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcefdc0-507c-45a9-8233-7d862c1268ec tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'scuvnWlT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:27:46 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-2bcefdc0-507c-45a9-8233-7d862c1268ec tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:27:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-2bcefdc0-507c-45a9-8233-7d862c1268ec tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-2bcefdc0-507c-45a9-8233-7d862c1268ec tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c433417b-9fdd-4ad9-98f6-7bba0a62bc17]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcefdc0-507c-45a9-8233-7d862c1268ec tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 01:27:46 user nova-compute[74850]: No targets found.
Nov 14 01:27:46 user nova-compute[74850]: iSNS:
Nov 14 01:27:46 user nova-compute[74850]: No targets found.
Nov 14 01:27:46 user nova-compute[74850]: STATIC:
Nov 14 01:27:46 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1
Nov 14 01:27:46 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:27:46 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:27:46 user nova-compute[74850]: FIRMWARE:
Nov 14 01:27:46 user nova-compute[74850]: No targets found.
Nov 14 01:27:46 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcefdc0-507c-45a9-8233-7d862c1268ec tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 01:27:46 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 01:27:46 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcefdc0-507c-45a9-8233-7d862c1268ec tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd67778-7b29-4ca7-bb17-e15646d3d131]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd88976-0160-47bd-a70d-6a893ddedf14]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcefdc0-507c-45a9-8233-7d862c1268ec tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1 (non-flash)
Nov 14 01:27:46 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcefdc0-507c-45a9-8233-7d862c1268ec tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1 (non-flash)
Nov 14 01:27:46 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcefdc0-507c-45a9-8233-7d862c1268ec tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a1c6ad120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1'): ({'sdb'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-2bcefdc0-507c-45a9-8233-7d862c1268ec tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Removing single pathed devices sdb {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f52bcf6-3722-4377-b20d-0e1c2eff9500]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3f35c0-5f79-438d-be60-06b654ec15b3]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-2bcefdc0-507c-45a9-8233-7d862c1268ec tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Flushing IO for device /dev/sdb {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a6979c-a18d-4c88-a28b-3e1c00c3b69f]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-2bcefdc0-507c-45a9-8233-7d862c1268ec tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b869fa5f-b6dc-4642-b52e-561208a861a6]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-2bcefdc0-507c-45a9-8233-7d862c1268ec tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-2bcefdc0-507c-45a9-8233-7d862c1268ec tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcefdc0-507c-45a9-8233-7d862c1268ec tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc4158e-800f-4694-8f1b-3b6157e55929]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcefdc0-507c-45a9-8233-7d862c1268ec tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1 -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d318024-d6be-4900-845f-17abb54a463e]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcefdc0-507c-45a9-8233-7d862c1268ec tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1, portal: 172.16.0.220,3260]
Nov 14 01:27:46 user nova-compute[74850]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1, portal: 172.16.0.220,3260] successful.
Nov 14 01:27:46 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1 -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a34beb1b-f5f6-4a62-b069-7377366550c1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ab504a-9ffe-4194-82da-37f3c3ba004c]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcefdc0-507c-45a9-8233-7d862c1268ec tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-2bcefdc0-507c-45a9-8233-7d862c1268ec tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcefdc0-507c-45a9-8233-7d862c1268ec tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] <== disconnect_volume: return (321ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:27:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bcefdc0-507c-45a9-8233-7d862c1268ec tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 01:27:47 user nova-compute[74850]: DEBUG nova.objects.instance [None req-2bcefdc0-507c-45a9-8233-7d862c1268ec tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lazy-loading 'flavor' on Instance uuid 87b33bb4-3f25-4897-82c3-cb774fb0bea2 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:27:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-2bcefdc0-507c-45a9-8233-7d862c1268ec tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.696s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:27:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:27:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:27:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74850) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 01:27:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:27:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:27:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:27:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:27:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:28:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:28:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:28:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:28:15 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:28:16 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:28:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:28:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:28:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:28:16 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 01:28:17 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b33bb4-3f25-4897-82c3-cb774fb0bea2/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:28:17 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b33bb4-3f25-4897-82c3-cb774fb0bea2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:28:17 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b33bb4-3f25-4897-82c3-cb774fb0bea2/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:28:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:28:17 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b33bb4-3f25-4897-82c3-cb774fb0bea2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:28:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Acquiring lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:28:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:28:17 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:28:17 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:28:17 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=9006MB free_disk=24.96981430053711GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 01:28:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:28:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:28:17 user nova-compute[74850]: DEBUG nova.objects.instance [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lazy-loading 'flavor' on Instance uuid 87b33bb4-3f25-4897-82c3-cb774fb0bea2 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:28:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:28:17 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 87b33bb4-3f25-4897-82c3-cb774fb0bea2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:28:17 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 01:28:17 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 01:28:17 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Refreshing inventories for resource provider fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 01:28:17 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Updating ProviderTree inventory for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 01:28:17 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Updating inventory in ProviderTree for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 01:28:17 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Refreshing aggregate associations for resource provider fe703abb-f68c-420d-a7f0-bf5240e23c54, aggregates: None {{(pid=74850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 01:28:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Acquiring lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:28:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:28:17 user nova-compute[74850]: INFO nova.compute.manager [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Attaching volume dbcef94f-eaa9-445a-a6f4-89f6b6890965 to /dev/vdb
Nov 14 01:28:17 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Refreshing trait associations for resource provider fe703abb-f68c-420d-a7f0-bf5240e23c54, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 01:28:18 user nova-compute[74850]: DEBUG os_brick.utils [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:28:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:28:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:28:18 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c722a0a-4d7a-4a18-97e8-02ec60034012]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:28:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:28:18 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:28:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:28:18 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d4c500-5751-4f3f-8e24-29b6c63b7b89]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:28:18 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:28:18 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 01:28:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.298s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:28:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:28:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:28:18 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3f4519-2d42-4a71-9fa8-f60aa9ba0d3d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:28:18 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45e7479-5b43-49fc-8399-d68a96be16a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:28:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:28:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:28:18 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 01:28:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:28:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:28:18 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 01:28:18 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aeb4a8c-c666-47f2-814c-d22a66dd31bd]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:28:18 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 01:28:18 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 01:28:18 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 01:28:18 user nova-compute[74850]: DEBUG os_brick.utils [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:28:18 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Updating existing volume attachment record: 41d7476e-9f6c-4eef-a5e4-bd0d9b1c77f3 {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 01:28:19 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:28:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UqNSelkC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:28:22 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:28:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:28:22 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:28:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:28:22 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 01:28:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965 -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbeee73-f499-4d0c-a295-ef24b9a467e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 01:28:22 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965 -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc25c5d-cfd5-4a24-a46f-0ee120d2f590]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965] added
Nov 14 01:28:22 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6405db1d-d4ec-42ad-88c3-623cac5d5de2]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe8c273-eb16-4f32-9f4f-03af10fd0edd]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UqNSelkC {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UqNSelkC" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdac56a-c1e3-42d5-9e31-e96986a6fd01]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UqNSelkC'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7da1a66-10c7-4c05-8694-9e5011ccc812]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa93801-53c7-4f34-83eb-1c38e65d6c21]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 01:28:22 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 01:28:22 user nova-compute[74850]:  {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:28:22 user nova-compute[74850]: WARNING os_brick.initiator.connectors.iscsi [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 01:28:22 user nova-compute[74850]: 
Nov 14 01:28:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965 -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8d8530-123f-481f-adfe-34ccb230b279]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965, portal: 172.16.0.220,3260]
Nov 14 01:28:22 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965, portal: 172.16.0.220,3260] successful.
Nov 14 01:28:22 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2ecfd6-f516-4401-ad4e-41d508583c41]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9373800-3fc7-41c8-b672-55143af77aff]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965 (non-flash)
Nov 14 01:28:22 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965 (non-flash)
Nov 14 01:28:22 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.239s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c204d5-d48d-4ee2-80f1-1c70c7cdb974]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UqNSelkC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 01:28:22 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:28:23 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.270s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:28:23 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] <== connect_volume: return (1272ms) {'type': 'block', 'scsi_wwn': '26435663633653262', 'path': '/dev/sdb'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:28:23 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435663633653262', 'path': '/dev/sdb'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 01:28:23 user nova-compute[74850]: DEBUG nova.objects.instance [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lazy-loading 'flavor' on Instance uuid 87b33bb4-3f25-4897-82c3-cb774fb0bea2 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:28:23 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 01:28:23 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:28:23 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 01:28:23 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:28:23 user nova-compute[74850]:   <serial>dbcef94f-eaa9-445a-a6f4-89f6b6890965</serial>
Nov 14 01:28:23 user nova-compute[74850]: </disk>
Nov 14 01:28:23 user nova-compute[74850]:  {{(pid=74850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 01:28:23 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:28:23 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 01:28:23 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:28:23 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:28:23 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] No VIF found with MAC fa:16:3e:d8:a2:2b, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:28:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-55237a29-9ce0-49c3-b9be-a913a97c87b8 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.114s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:28:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-750e34d4-7b7e-4313-96c7-ee1df2ca7aa1 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Acquiring lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:28:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-750e34d4-7b7e-4313-96c7-ee1df2ca7aa1 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:28:26 user nova-compute[74850]: INFO nova.compute.manager [None req-750e34d4-7b7e-4313-96c7-ee1df2ca7aa1 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Detaching volume dbcef94f-eaa9-445a-a6f4-89f6b6890965
Nov 14 01:28:26 user nova-compute[74850]: INFO nova.virt.block_device [None req-750e34d4-7b7e-4313-96c7-ee1df2ca7aa1 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Attempting to driver detach volume dbcef94f-eaa9-445a-a6f4-89f6b6890965 from mountpoint /dev/vdb
Nov 14 01:28:26 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-750e34d4-7b7e-4313-96c7-ee1df2ca7aa1 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Attempting to detach device vdb from instance 87b33bb4-3f25-4897-82c3-cb774fb0bea2 from the persistent domain config. {{(pid=74850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 01:28:26 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-750e34d4-7b7e-4313-96c7-ee1df2ca7aa1 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:28:26 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:28:26 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 01:28:26 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:28:26 user nova-compute[74850]:   <serial>dbcef94f-eaa9-445a-a6f4-89f6b6890965</serial>
Nov 14 01:28:26 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 01:28:26 user nova-compute[74850]: </disk>
Nov 14 01:28:26 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:28:26 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-750e34d4-7b7e-4313-96c7-ee1df2ca7aa1 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Successfully detached device vdb from instance 87b33bb4-3f25-4897-82c3-cb774fb0bea2 from the persistent domain config.
Nov 14 01:28:26 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-750e34d4-7b7e-4313-96c7-ee1df2ca7aa1 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 87b33bb4-3f25-4897-82c3-cb774fb0bea2 from the live domain config. {{(pid=74850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 01:28:26 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-750e34d4-7b7e-4313-96c7-ee1df2ca7aa1 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:28:26 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:28:26 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 01:28:26 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:28:26 user nova-compute[74850]:   <serial>dbcef94f-eaa9-445a-a6f4-89f6b6890965</serial>
Nov 14 01:28:26 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 01:28:26 user nova-compute[74850]: </disk>
Nov 14 01:28:26 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:28:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:28:26 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-750e34d4-7b7e-4313-96c7-ee1df2ca7aa1 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 87b33bb4-3f25-4897-82c3-cb774fb0bea2 {{(pid=74850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 01:28:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:28:27 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:28:27 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:28:27 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 01:28:27 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Rebuilding the list of instances to heal {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 01:28:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "refresh_cache-87b33bb4-3f25-4897-82c3-cb774fb0bea2" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:28:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquired lock "refresh_cache-87b33bb4-3f25-4897-82c3-cb774fb0bea2" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:28:28 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Forcefully refreshing network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 01:28:28 user nova-compute[74850]: DEBUG nova.objects.instance [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lazy-loading 'info_cache' on Instance uuid 87b33bb4-3f25-4897-82c3-cb774fb0bea2 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:28:28 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Updating instance_info_cache with network_info: [{"id": "a25e20ce-1b3d-4e5b-8f3b-5c146716a682", "address": "fa:16:3e:d8:a2:2b", "network": {"id": "943fc504-ca87-4ae7-85c0-7d167e59aa1b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1690202443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e517ca63f1964c6da6cad708365a13a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25e20ce-1b", "ovs_interfaceid": "a25e20ce-1b3d-4e5b-8f3b-5c146716a682", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:28:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Releasing lock "refresh_cache-87b33bb4-3f25-4897-82c3-cb774fb0bea2" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:28:28 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Updated the network info_cache for instance {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 01:28:28 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:28:29 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:28:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:28:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:28:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:28:46 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-750e34d4-7b7e-4313-96c7-ee1df2ca7aa1 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 87b33bb4-3f25-4897-82c3-cb774fb0bea2 is timed out.
Nov 14 01:28:46 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-750e34d4-7b7e-4313-96c7-ee1df2ca7aa1 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Successfully detached device vdb from instance 87b33bb4-3f25-4897-82c3-cb774fb0bea2 from the live domain config.
Nov 14 01:28:46 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-750e34d4-7b7e-4313-96c7-ee1df2ca7aa1 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-750e34d4-7b7e-4313-96c7-ee1df2ca7aa1 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UqNSelkC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:28:46 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-750e34d4-7b7e-4313-96c7-ee1df2ca7aa1 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:28:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-750e34d4-7b7e-4313-96c7-ee1df2ca7aa1 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-750e34d4-7b7e-4313-96c7-ee1df2ca7aa1 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa00407f-92c0-4148-a6c3-420a4c1e53c7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-750e34d4-7b7e-4313-96c7-ee1df2ca7aa1 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 01:28:46 user nova-compute[74850]: No targets found.
Nov 14 01:28:46 user nova-compute[74850]: iSNS:
Nov 14 01:28:46 user nova-compute[74850]: No targets found.
Nov 14 01:28:46 user nova-compute[74850]: STATIC:
Nov 14 01:28:46 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965
Nov 14 01:28:46 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:28:46 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:28:46 user nova-compute[74850]: FIRMWARE:
Nov 14 01:28:46 user nova-compute[74850]: No targets found.
Nov 14 01:28:46 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-750e34d4-7b7e-4313-96c7-ee1df2ca7aa1 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 01:28:46 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 01:28:46 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-750e34d4-7b7e-4313-96c7-ee1df2ca7aa1 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8754c851-89ec-4133-859d-0aaa68348151]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[29232660-9482-47a8-bb97-e6474524bcdc]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-750e34d4-7b7e-4313-96c7-ee1df2ca7aa1 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965 (non-flash)
Nov 14 01:28:46 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-750e34d4-7b7e-4313-96c7-ee1df2ca7aa1 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965 (non-flash)
Nov 14 01:28:46 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-750e34d4-7b7e-4313-96c7-ee1df2ca7aa1 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a1c6ae680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965'): ({'sdb'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-750e34d4-7b7e-4313-96c7-ee1df2ca7aa1 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Removing single pathed devices sdb {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f89c19c-7673-4a04-aada-32471a6b11ee]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e6a91d-7b0e-4a5e-9ddf-426584f3b19d]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-750e34d4-7b7e-4313-96c7-ee1df2ca7aa1 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Flushing IO for device /dev/sdb {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aaf86e3-55bf-4f52-936c-ebe9d7c3a047]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-750e34d4-7b7e-4313-96c7-ee1df2ca7aa1 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc03a846-feec-4e95-a3a8-a917d0a2d099]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-750e34d4-7b7e-4313-96c7-ee1df2ca7aa1 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-750e34d4-7b7e-4313-96c7-ee1df2ca7aa1 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-750e34d4-7b7e-4313-96c7-ee1df2ca7aa1 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b971a10d-2b5d-43f6-a7ed-dc48aea99835]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-750e34d4-7b7e-4313-96c7-ee1df2ca7aa1 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:28:46 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965 -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:28:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965 -p 172.16.0.220:3260 --logout" returned: 0 in 0.040s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:28:47 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[db60438a-60be-4648-8221-929aaa92b0f7]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:28:47 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-750e34d4-7b7e-4313-96c7-ee1df2ca7aa1 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965, portal: 172.16.0.220,3260]
Nov 14 01:28:47 user nova-compute[74850]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965, portal: 172.16.0.220,3260] successful.
Nov 14 01:28:47 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:28:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965 -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:28:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbcef94f-eaa9-445a-a6f4-89f6b6890965 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:28:47 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4896eb91-376a-40c9-83a9-22f224153c7f]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:28:47 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-750e34d4-7b7e-4313-96c7-ee1df2ca7aa1 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:28:47 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-750e34d4-7b7e-4313-96c7-ee1df2ca7aa1 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:28:47 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-750e34d4-7b7e-4313-96c7-ee1df2ca7aa1 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] <== disconnect_volume: return (391ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:28:47 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-750e34d4-7b7e-4313-96c7-ee1df2ca7aa1 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 01:28:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:28:47 user nova-compute[74850]: DEBUG nova.objects.instance [None req-750e34d4-7b7e-4313-96c7-ee1df2ca7aa1 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lazy-loading 'flavor' on Instance uuid 87b33bb4-3f25-4897-82c3-cb774fb0bea2 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:28:47 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-750e34d4-7b7e-4313-96c7-ee1df2ca7aa1 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.657s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:28:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:28:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:29:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:29:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:29:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:29:15 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:29:16 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:29:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:29:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:29:16 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:29:16 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 01:29:17 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b33bb4-3f25-4897-82c3-cb774fb0bea2/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:29:17 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b33bb4-3f25-4897-82c3-cb774fb0bea2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:29:17 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b33bb4-3f25-4897-82c3-cb774fb0bea2/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:29:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:29:17 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b33bb4-3f25-4897-82c3-cb774fb0bea2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:29:17 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:29:17 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:29:17 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=9009MB free_disk=24.968891143798828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 01:29:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:29:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:29:17 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 87b33bb4-3f25-4897-82c3-cb774fb0bea2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:29:17 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 01:29:17 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 01:29:17 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:29:17 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:29:17 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 01:29:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:29:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Acquiring lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:29:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:29:18 user nova-compute[74850]: DEBUG nova.objects.instance [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lazy-loading 'flavor' on Instance uuid 87b33bb4-3f25-4897-82c3-cb774fb0bea2 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:29:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:29:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Acquiring lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:29:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:29:18 user nova-compute[74850]: INFO nova.compute.manager [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Attaching volume 0345ff0b-e47b-4d64-abdc-29e317af5216 to /dev/vdb
Nov 14 01:29:18 user nova-compute[74850]: DEBUG os_brick.utils [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:29:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:29:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:29:18 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e86b8a7-398c-48b0-b5c5-0740bcd96a39]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:29:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:29:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:29:18 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1ede04-e800-4dac-bc3d-87b3b03a94e0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:29:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:29:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:29:18 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2bc717-0eb2-4276-af2d-288e10d07a39]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:29:18 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0f2cf8-f939-40c6-b338-68b9e2d84a16]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:29:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:29:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:29:18 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 01:29:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:29:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:29:18 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 01:29:18 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5886d697-3513-4008-ad67-c96293c3c407]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:29:18 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 01:29:18 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 01:29:18 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 01:29:18 user nova-compute[74850]: DEBUG os_brick.utils [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:29:18 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Updating existing volume attachment record: 8802890e-15da-40c4-a116-65688b4b1d16 {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 01:29:19 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:29:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ovkOVXBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:29:22 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:29:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:29:22 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:29:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:29:22 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 01:29:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216 -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[711ea9aa-4a63-425f-bb2f-d606cec30434]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 01:29:22 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216 -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a214507-c565-493b-aaa8-50e4537823a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216] added
Nov 14 01:29:22 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[838d612a-6796-4d5e-9965-29041392cddc]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1f9c5a-27ed-49cf-9f35-dd55926f4dc9]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ovkOVXBE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ovkOVXBE" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[de523e15-5536-40cb-9c98-d6387ddbc19d]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ovkOVXBE'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2085a049-9c73-4cea-a1a5-c0423201a62a]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[394d9d7e-ef4d-46cd-b460-741c98d2101a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 01:29:22 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 01:29:22 user nova-compute[74850]:  {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:29:22 user nova-compute[74850]: WARNING os_brick.initiator.connectors.iscsi [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 01:29:22 user nova-compute[74850]: 
Nov 14 01:29:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216 -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b967242-1fd0-47d9-b5e3-bd748ae6f535]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216, portal: 172.16.0.220,3260]
Nov 14 01:29:22 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216, portal: 172.16.0.220,3260] successful.
Nov 14 01:29:22 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ad3c45-164f-4711-9423-4e19ca438a6f]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b11fb9-eabb-488b-83bb-e6709131f08e]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216 (non-flash)
Nov 14 01:29:22 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216 (non-flash)
Nov 14 01:29:22 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c2b3eb-d038-4935-a1ec-ede3da084dbd]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:29:22 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:29:23 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:29:23 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ovkOVXBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 01:29:23 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:29:23 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23163336631353832', 'path': '/dev/sdb'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:29:23 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163336631353832', 'path': '/dev/sdb'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 01:29:23 user nova-compute[74850]: DEBUG nova.objects.instance [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lazy-loading 'flavor' on Instance uuid 87b33bb4-3f25-4897-82c3-cb774fb0bea2 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:29:23 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 01:29:23 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:29:23 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 01:29:23 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:29:23 user nova-compute[74850]:   <serial>0345ff0b-e47b-4d64-abdc-29e317af5216</serial>
Nov 14 01:29:23 user nova-compute[74850]: </disk>
Nov 14 01:29:23 user nova-compute[74850]:  {{(pid=74850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 01:29:24 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:29:24 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:29:24 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] No VIF found with MAC fa:16:3e:d8:a2:2b, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:29:24 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-54718131-2eb8-4354-96e4-d809e16ac1aa tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.268s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:29:24 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:29:24 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:29:24 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 01:29:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5697ef7a-4855-4669-b8a4-c8ee393748ae tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Acquiring lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:29:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5697ef7a-4855-4669-b8a4-c8ee393748ae tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:29:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:29:26 user nova-compute[74850]: INFO nova.compute.manager [None req-5697ef7a-4855-4669-b8a4-c8ee393748ae tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Detaching volume 0345ff0b-e47b-4d64-abdc-29e317af5216
Nov 14 01:29:26 user nova-compute[74850]: INFO nova.virt.block_device [None req-5697ef7a-4855-4669-b8a4-c8ee393748ae tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Attempting to driver detach volume 0345ff0b-e47b-4d64-abdc-29e317af5216 from mountpoint /dev/vdb
Nov 14 01:29:26 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5697ef7a-4855-4669-b8a4-c8ee393748ae tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Attempting to detach device vdb from instance 87b33bb4-3f25-4897-82c3-cb774fb0bea2 from the persistent domain config. {{(pid=74850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 01:29:26 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-5697ef7a-4855-4669-b8a4-c8ee393748ae tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:29:26 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:29:26 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 01:29:26 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:29:26 user nova-compute[74850]:   <serial>0345ff0b-e47b-4d64-abdc-29e317af5216</serial>
Nov 14 01:29:26 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 01:29:26 user nova-compute[74850]: </disk>
Nov 14 01:29:26 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:29:26 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-5697ef7a-4855-4669-b8a4-c8ee393748ae tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Successfully detached device vdb from instance 87b33bb4-3f25-4897-82c3-cb774fb0bea2 from the persistent domain config.
Nov 14 01:29:26 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5697ef7a-4855-4669-b8a4-c8ee393748ae tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 87b33bb4-3f25-4897-82c3-cb774fb0bea2 from the live domain config. {{(pid=74850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 01:29:26 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-5697ef7a-4855-4669-b8a4-c8ee393748ae tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:29:26 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:29:26 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 01:29:26 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:29:26 user nova-compute[74850]:   <serial>0345ff0b-e47b-4d64-abdc-29e317af5216</serial>
Nov 14 01:29:26 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 01:29:26 user nova-compute[74850]: </disk>
Nov 14 01:29:26 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:29:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-5697ef7a-4855-4669-b8a4-c8ee393748ae tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 87b33bb4-3f25-4897-82c3-cb774fb0bea2 {{(pid=74850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 01:29:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:29:28 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:29:29 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:29:29 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:29:29 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 01:29:29 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Rebuilding the list of instances to heal {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 01:29:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "refresh_cache-87b33bb4-3f25-4897-82c3-cb774fb0bea2" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:29:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquired lock "refresh_cache-87b33bb4-3f25-4897-82c3-cb774fb0bea2" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:29:29 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Forcefully refreshing network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 01:29:29 user nova-compute[74850]: DEBUG nova.objects.instance [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lazy-loading 'info_cache' on Instance uuid 87b33bb4-3f25-4897-82c3-cb774fb0bea2 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:29:30 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Updating instance_info_cache with network_info: [{"id": "a25e20ce-1b3d-4e5b-8f3b-5c146716a682", "address": "fa:16:3e:d8:a2:2b", "network": {"id": "943fc504-ca87-4ae7-85c0-7d167e59aa1b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1690202443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e517ca63f1964c6da6cad708365a13a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25e20ce-1b", "ovs_interfaceid": "a25e20ce-1b3d-4e5b-8f3b-5c146716a682", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:29:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Releasing lock "refresh_cache-87b33bb4-3f25-4897-82c3-cb774fb0bea2" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:29:30 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Updated the network info_cache for instance {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 01:29:30 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:29:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:29:34 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:29:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:29:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:29:47 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-5697ef7a-4855-4669-b8a4-c8ee393748ae tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 87b33bb4-3f25-4897-82c3-cb774fb0bea2 is timed out.
Nov 14 01:29:47 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-5697ef7a-4855-4669-b8a4-c8ee393748ae tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Successfully detached device vdb from instance 87b33bb4-3f25-4897-82c3-cb774fb0bea2 from the live domain config.
Nov 14 01:29:47 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5697ef7a-4855-4669-b8a4-c8ee393748ae tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5697ef7a-4855-4669-b8a4-c8ee393748ae tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ovkOVXBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:29:47 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-5697ef7a-4855-4669-b8a4-c8ee393748ae tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:29:47 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-5697ef7a-4855-4669-b8a4-c8ee393748ae tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-5697ef7a-4855-4669-b8a4-c8ee393748ae tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6612775c-f58b-44fd-be02-d92a336fb38e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5697ef7a-4855-4669-b8a4-c8ee393748ae tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 01:29:47 user nova-compute[74850]: No targets found.
Nov 14 01:29:47 user nova-compute[74850]: iSNS:
Nov 14 01:29:47 user nova-compute[74850]: No targets found.
Nov 14 01:29:47 user nova-compute[74850]: STATIC:
Nov 14 01:29:47 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216
Nov 14 01:29:47 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:29:47 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:29:47 user nova-compute[74850]: FIRMWARE:
Nov 14 01:29:47 user nova-compute[74850]: No targets found.
Nov 14 01:29:47 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5697ef7a-4855-4669-b8a4-c8ee393748ae tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 01:29:47 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 01:29:47 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5697ef7a-4855-4669-b8a4-c8ee393748ae tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc2f831-6f6f-42a5-93b5-6dfa5e893e31]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[782a8f04-106f-456e-9b26-2cc628df735a]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5697ef7a-4855-4669-b8a4-c8ee393748ae tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216 (non-flash)
Nov 14 01:29:47 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5697ef7a-4855-4669-b8a4-c8ee393748ae tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216 (non-flash)
Nov 14 01:29:47 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5697ef7a-4855-4669-b8a4-c8ee393748ae tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a1c6aea70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216'): ({'sdb'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-5697ef7a-4855-4669-b8a4-c8ee393748ae tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Removing single pathed devices sdb {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f978a0ee-6b27-4a2c-88be-3c15821db4c5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b870ea4a-ee7d-4d84-900c-b3b4acf08267]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-5697ef7a-4855-4669-b8a4-c8ee393748ae tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Flushing IO for device /dev/sdb {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7023119a-b49b-414b-be35-5cc36e777bd8]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-5697ef7a-4855-4669-b8a4-c8ee393748ae tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[44bcee9c-6c70-4a52-b215-d83db5ad80a0]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-5697ef7a-4855-4669-b8a4-c8ee393748ae tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-5697ef7a-4855-4669-b8a4-c8ee393748ae tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5697ef7a-4855-4669-b8a4-c8ee393748ae tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[401d102a-6515-48ce-8f76-a9e933d6463c]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5697ef7a-4855-4669-b8a4-c8ee393748ae tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216 -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50de1a2-edad-4c03-b9ec-90f6c183a615]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5697ef7a-4855-4669-b8a4-c8ee393748ae tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216, portal: 172.16.0.220,3260]
Nov 14 01:29:47 user nova-compute[74850]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216, portal: 172.16.0.220,3260] successful.
Nov 14 01:29:47 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216 -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74850) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0345ff0b-e47b-4d64-abdc-29e317af5216 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d933036-a436-4001-bec5-6c2e02430d71]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5697ef7a-4855-4669-b8a4-c8ee393748ae tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-5697ef7a-4855-4669-b8a4-c8ee393748ae tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5697ef7a-4855-4669-b8a4-c8ee393748ae tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] <== disconnect_volume: return (283ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:29:47 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5697ef7a-4855-4669-b8a4-c8ee393748ae tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 01:29:48 user nova-compute[74850]: DEBUG nova.objects.instance [None req-5697ef7a-4855-4669-b8a4-c8ee393748ae tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lazy-loading 'flavor' on Instance uuid 87b33bb4-3f25-4897-82c3-cb774fb0bea2 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:29:48 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-5697ef7a-4855-4669-b8a4-c8ee393748ae tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.646s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:29:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:29:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:30:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:30:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:30:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:30:15 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:30:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:30:17 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:30:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:30:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:30:17 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:30:17 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 01:30:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b33bb4-3f25-4897-82c3-cb774fb0bea2/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:30:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b33bb4-3f25-4897-82c3-cb774fb0bea2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:30:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b33bb4-3f25-4897-82c3-cb774fb0bea2/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:30:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b33bb4-3f25-4897-82c3-cb774fb0bea2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:30:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Acquiring lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:30:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:30:18 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:30:18 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:30:18 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=9029MB free_disk=24.967853546142578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 01:30:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:30:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:30:18 user nova-compute[74850]: DEBUG nova.objects.instance [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lazy-loading 'flavor' on Instance uuid 87b33bb4-3f25-4897-82c3-cb774fb0bea2 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:30:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:30:18 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 87b33bb4-3f25-4897-82c3-cb774fb0bea2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:30:18 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 01:30:18 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 01:30:18 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:30:18 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:30:18 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 01:30:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:30:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Acquiring lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:30:18 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:30:18 user nova-compute[74850]: INFO nova.compute.manager [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Attaching volume fd4e4b17-3b42-441d-9488-9934c12a75b7 to /dev/vdb
Nov 14 01:30:18 user nova-compute[74850]: DEBUG os_brick.utils [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:30:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:30:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:30:18 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e53890-8f61-4166-b5ee-5c5014e63657]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:87f689d422fb\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:30:18 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:30:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:30:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7237df5-52d4-4335-b0f1-cab44a4a3df4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:30:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:30:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:30:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2a1651-6e59-4847-bcb7-c24067324232]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:30:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0604424-fd3c-4da8-8da2-204c0593da74]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:30:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Running cmd (subprocess): nvme version {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:30:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] 'nvme version' failed. Not Retrying. {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:30:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] nvme not present on system {{(pid=74850) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 01:30:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:30:19 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 01:30:19 user nova-compute[74850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 01:30:19 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7c0f12-f97b-421d-9bb3-f573264f6847]: (4, '') {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:30:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74850) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 01:30:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 01:30:19 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.lightos [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] LIGHTOS: no hostnqn found. {{(pid=74850) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 01:30:19 user nova-compute[74850]: DEBUG os_brick.utils [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:87f689d422fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:30:19 user nova-compute[74850]: DEBUG nova.virt.block_device [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Updating existing volume attachment record: e7c79ec4-f261-4e70-afd1-fd17710b0893 {{(pid=74850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 01:30:21 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:30:21 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:30:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Calling os-brick to attach iSCSI Volume {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qzDLpyUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:30:23 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:30:23 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:30:23 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:30:23 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:30:23 user nova-compute[74850]: INFO os_brick.initiator.connectors.iscsi [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 01:30:23 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7 -p 172.16.0.220:3260 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bcc372-2b37-423c-9c2d-f6be80b66a26]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 01:30:23 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2048fa8f-62cd-4451-a8fa-a746974fc82f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7] added\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7] added
Nov 14 01:30:23 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacbb063-1ab0-406f-863f-dacbc8f73e81]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4556b586-22fc-4e4f-bda2-5ea6545281f3]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qzDLpyUk {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qzDLpyUk" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[18002b86-d944-498d-ab73-26438bcf2724]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qzDLpyUk'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c46ad3b-100f-4944-94d9-dff3123b68e5]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b29ff3d-f4b0-44f0-a7ac-4780225e6a07]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 01:30:23 user nova-compute[74850]:  {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 01:30:23 user nova-compute[74850]:  {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:30:23 user nova-compute[74850]: WARNING os_brick.initiator.connectors.iscsi [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 01:30:23 user nova-compute[74850]: 
Nov 14 01:30:23 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7 -p 172.16.0.220:3260 --login {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa1d3ce-ed91-4384-ac98-0f93e9355705]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7, portal: 172.16.0.220,3260]
Nov 14 01:30:23 user nova-compute[74850]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7, portal: 172.16.0.220,3260] successful.
Nov 14 01:30:23 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f444e3f4-b8e8-4231-9519-7cf153b2052f]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[391c24a7-3d4b-4035-bfc6-a969cfae85df]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7 (non-flash)
Nov 14 01:30:23 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7 (non-flash)
Nov 14 01:30:23 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Connected to 172.16.0.220:3260 {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=74850) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74850) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51bc154-827a-42ef-a65b-79fddf907551]: (4, ('- - 0', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74850) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 01:30:23 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qzDLpyUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74850) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 01:30:24 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:30:24 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 01:30:24 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:30:24 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23733656437373936', 'path': '/dev/sdb'} {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:30:24 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733656437373936', 'path': '/dev/sdb'} {{(pid=74850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 01:30:24 user nova-compute[74850]: DEBUG nova.objects.instance [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lazy-loading 'flavor' on Instance uuid 87b33bb4-3f25-4897-82c3-cb774fb0bea2 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:30:24 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 01:30:24 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:30:24 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 01:30:24 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:30:24 user nova-compute[74850]:   <serial>fd4e4b17-3b42-441d-9488-9934c12a75b7</serial>
Nov 14 01:30:24 user nova-compute[74850]: </disk>
Nov 14 01:30:24 user nova-compute[74850]:  {{(pid=74850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 01:30:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] No BDM found with device name vda, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:30:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 01:30:25 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] No VIF found with MAC fa:16:3e:d8:a2:2b, not building metadata {{(pid=74850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 01:30:25 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-c25a1fdf-0df6-4447-8ce4-826abafbf673 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.647s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:30:25 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:30:26 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:30:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:30:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-109d5346-6d5b-4b8a-ad2b-1a10d37ab9af tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Acquiring lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:30:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-109d5346-6d5b-4b8a-ad2b-1a10d37ab9af tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:30:28 user nova-compute[74850]: INFO nova.compute.manager [None req-109d5346-6d5b-4b8a-ad2b-1a10d37ab9af tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Detaching volume fd4e4b17-3b42-441d-9488-9934c12a75b7
Nov 14 01:30:28 user nova-compute[74850]: INFO nova.virt.block_device [None req-109d5346-6d5b-4b8a-ad2b-1a10d37ab9af tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Attempting to driver detach volume fd4e4b17-3b42-441d-9488-9934c12a75b7 from mountpoint /dev/vdb
Nov 14 01:30:28 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-109d5346-6d5b-4b8a-ad2b-1a10d37ab9af tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Attempting to detach device vdb from instance 87b33bb4-3f25-4897-82c3-cb774fb0bea2 from the persistent domain config. {{(pid=74850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 01:30:28 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-109d5346-6d5b-4b8a-ad2b-1a10d37ab9af tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:30:28 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:30:28 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 01:30:28 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:30:28 user nova-compute[74850]:   <serial>fd4e4b17-3b42-441d-9488-9934c12a75b7</serial>
Nov 14 01:30:28 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 01:30:28 user nova-compute[74850]: </disk>
Nov 14 01:30:28 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:30:28 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-109d5346-6d5b-4b8a-ad2b-1a10d37ab9af tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Successfully detached device vdb from instance 87b33bb4-3f25-4897-82c3-cb774fb0bea2 from the persistent domain config.
Nov 14 01:30:28 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-109d5346-6d5b-4b8a-ad2b-1a10d37ab9af tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 87b33bb4-3f25-4897-82c3-cb774fb0bea2 from the live domain config. {{(pid=74850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 01:30:28 user nova-compute[74850]: DEBUG nova.virt.libvirt.guest [None req-109d5346-6d5b-4b8a-ad2b-1a10d37ab9af tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 01:30:28 user nova-compute[74850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 01:30:28 user nova-compute[74850]:   <source dev="/dev/sdb"/>
Nov 14 01:30:28 user nova-compute[74850]:   <target dev="vdb" bus="virtio"/>
Nov 14 01:30:28 user nova-compute[74850]:   <serial>fd4e4b17-3b42-441d-9488-9934c12a75b7</serial>
Nov 14 01:30:28 user nova-compute[74850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 01:30:28 user nova-compute[74850]: </disk>
Nov 14 01:30:28 user nova-compute[74850]:  {{(pid=74850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 01:30:28 user nova-compute[74850]: DEBUG nova.virt.libvirt.driver [None req-109d5346-6d5b-4b8a-ad2b-1a10d37ab9af tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 87b33bb4-3f25-4897-82c3-cb774fb0bea2 {{(pid=74850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 01:30:29 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:30:29 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:30:29 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 01:30:29 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Rebuilding the list of instances to heal {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 01:30:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "refresh_cache-87b33bb4-3f25-4897-82c3-cb774fb0bea2" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 01:30:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquired lock "refresh_cache-87b33bb4-3f25-4897-82c3-cb774fb0bea2" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 01:30:30 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Forcefully refreshing network info cache for instance {{(pid=74850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 01:30:30 user nova-compute[74850]: DEBUG nova.objects.instance [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lazy-loading 'info_cache' on Instance uuid 87b33bb4-3f25-4897-82c3-cb774fb0bea2 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:30:30 user nova-compute[74850]: DEBUG nova.network.neutron [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Updating instance_info_cache with network_info: [{"id": "a25e20ce-1b3d-4e5b-8f3b-5c146716a682", "address": "fa:16:3e:d8:a2:2b", "network": {"id": "943fc504-ca87-4ae7-85c0-7d167e59aa1b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1690202443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e517ca63f1964c6da6cad708365a13a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25e20ce-1b", "ovs_interfaceid": "a25e20ce-1b3d-4e5b-8f3b-5c146716a682", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:30:30 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Releasing lock "refresh_cache-87b33bb4-3f25-4897-82c3-cb774fb0bea2" {{(pid=74850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 01:30:30 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Updated the network info_cache for instance {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 01:30:30 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:30:31 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:30:31 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:30:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:30:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:30:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:30:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74850) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 01:30:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:30:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:30:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:30:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:30:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:30:48 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-109d5346-6d5b-4b8a-ad2b-1a10d37ab9af tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 87b33bb4-3f25-4897-82c3-cb774fb0bea2 is timed out.
Nov 14 01:30:48 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-109d5346-6d5b-4b8a-ad2b-1a10d37ab9af tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Successfully detached device vdb from instance 87b33bb4-3f25-4897-82c3-cb774fb0bea2 from the live domain config.
Nov 14 01:30:48 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-109d5346-6d5b-4b8a-ad2b-1a10d37ab9af tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] calling os-brick to detach iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-109d5346-6d5b-4b8a-ad2b-1a10d37ab9af tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9a3c7d9870>, {'target_iqn': 'iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qzDLpyUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 01:30:48 user nova-compute[74850]: WARNING os_brick.initiator.connectors.base [None req-109d5346-6d5b-4b8a-ad2b-1a10d37ab9af tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 01:30:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-109d5346-6d5b-4b8a-ad2b-1a10d37ab9af tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-109d5346-6d5b-4b8a-ad2b-1a10d37ab9af tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f5f40d-3afb-41bf-abb7-f01fda8ab384]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-109d5346-6d5b-4b8a-ad2b-1a10d37ab9af tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 01:30:48 user nova-compute[74850]: No targets found.
Nov 14 01:30:48 user nova-compute[74850]: iSNS:
Nov 14 01:30:48 user nova-compute[74850]: No targets found.
Nov 14 01:30:48 user nova-compute[74850]: STATIC:
Nov 14 01:30:48 user nova-compute[74850]: Target: iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7
Nov 14 01:30:48 user nova-compute[74850]:         Portal: 172.16.0.220:3260,-1
Nov 14 01:30:48 user nova-compute[74850]:                 Iface Name: default
Nov 14 01:30:48 user nova-compute[74850]: FIRMWARE:
Nov 14 01:30:48 user nova-compute[74850]: No targets found.
Nov 14 01:30:48 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-109d5346-6d5b-4b8a-ad2b-1a10d37ab9af tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 01:30:48 user nova-compute[74850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 01:30:48 user nova-compute[74850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74850) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-109d5346-6d5b-4b8a-ad2b-1a10d37ab9af tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7', 0)] {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[676ca96d-c090-45c4-9bc5-7fa49675347a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f357f56-60e8-44f0-9b97-b73b377eb76b]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7 (non-flash)\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-109d5346-6d5b-4b8a-ad2b-1a10d37ab9af tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7 (non-flash)
Nov 14 01:30:48 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-109d5346-6d5b-4b8a-ad2b-1a10d37ab9af tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7 (non-flash)
Nov 14 01:30:48 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-109d5346-6d5b-4b8a-ad2b-1a10d37ab9af tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9a5c25f0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7'): ({'sdb'}, set())}) {{(pid=74850) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-109d5346-6d5b-4b8a-ad2b-1a10d37ab9af tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Removing single pathed devices sdb {{(pid=74850) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dca7af1-a3df-4a6f-bb0c-3fe5ab0585ef]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b2bd27-61aa-472c-b222-f65775af3091]: (4, ('ok\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-109d5346-6d5b-4b8a-ad2b-1a10d37ab9af tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Flushing IO for device /dev/sdb {{(pid=74850) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea72bbd-f72d-4241-b8ba-77fe8d7684a8]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-109d5346-6d5b-4b8a-ad2b-1a10d37ab9af tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74850) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6806da85-1a50-40bb-9904-8350b42a341c]: (4, ('1', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-109d5346-6d5b-4b8a-ad2b-1a10d37ab9af tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG os_brick.initiator.linuxscsi [None req-109d5346-6d5b-4b8a-ad2b-1a10d37ab9af tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] SCSI volumes sdb have been removed. {{(pid=74850) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-109d5346-6d5b-4b8a-ad2b-1a10d37ab9af tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7')] {{(pid=74850) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee751c6-8e4e-4b99-96c8-31047bd39a39]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-109d5346-6d5b-4b8a-ad2b-1a10d37ab9af tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7 -p 172.16.0.220:3260 --logout {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8febbcc-041a-49b4-8494-d9dddfb8ea38]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-109d5346-6d5b-4b8a-ad2b-1a10d37ab9af tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7, portal: 172.16.0.220,3260]
Nov 14 01:30:48 user nova-compute[74850]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7, portal: 172.16.0.220,3260] successful.
Nov 14 01:30:48 user nova-compute[74850]:  stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7 -p 172.16.0.220:3260 --op delete {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd4e4b17-3b42-441d-9488-9934c12a75b7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea776c90-94fe-4c14-b87f-2d45eec54bfc]: (4, ('', '')) {{(pid=84948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-109d5346-6d5b-4b8a-ad2b-1a10d37ab9af tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74850) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.base [None req-109d5346-6d5b-4b8a-ad2b-1a10d37ab9af tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG os_brick.initiator.connectors.iscsi [None req-109d5346-6d5b-4b8a-ad2b-1a10d37ab9af tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] <== disconnect_volume: return (290ms) None {{(pid=74850) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 01:30:48 user nova-compute[74850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-109d5346-6d5b-4b8a-ad2b-1a10d37ab9af tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Disconnected iSCSI Volume {{(pid=74850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 01:30:49 user nova-compute[74850]: DEBUG nova.objects.instance [None req-109d5346-6d5b-4b8a-ad2b-1a10d37ab9af tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lazy-loading 'flavor' on Instance uuid 87b33bb4-3f25-4897-82c3-cb774fb0bea2 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:30:49 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-109d5346-6d5b-4b8a-ad2b-1a10d37ab9af tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.595s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:30:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:30:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:31:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:31:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:31:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:31:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:31:17 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:31:19 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:31:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:31:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:31:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:31:19 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 01:31:20 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b33bb4-3f25-4897-82c3-cb774fb0bea2/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:31:20 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b33bb4-3f25-4897-82c3-cb774fb0bea2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:31:20 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b33bb4-3f25-4897-82c3-cb774fb0bea2/disk --force-share --output=json {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 01:31:20 user nova-compute[74850]: DEBUG oslo_concurrency.processutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b33bb4-3f25-4897-82c3-cb774fb0bea2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 01:31:20 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:31:20 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:31:20 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=9018MB free_disk=24.966903686523438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 01:31:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:31:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:31:20 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Instance 87b33bb4-3f25-4897-82c3-cb774fb0bea2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 01:31:20 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 01:31:20 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 01:31:20 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:31:20 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:31:21 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 01:31:21 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:31:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:31:23 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:31:25 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:31:25 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 01:31:26 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:31:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a85ee10d-b00b-46f4-9f35-43309a94d8a0 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Acquiring lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:31:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a85ee10d-b00b-46f4-9f35-43309a94d8a0 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:31:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a85ee10d-b00b-46f4-9f35-43309a94d8a0 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Acquiring lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:31:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a85ee10d-b00b-46f4-9f35-43309a94d8a0 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:31:26 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a85ee10d-b00b-46f4-9f35-43309a94d8a0 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:31:26 user nova-compute[74850]: INFO nova.compute.manager [None req-a85ee10d-b00b-46f4-9f35-43309a94d8a0 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Terminating instance
Nov 14 01:31:26 user nova-compute[74850]: DEBUG nova.compute.manager [None req-a85ee10d-b00b-46f4-9f35-43309a94d8a0 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Start destroying the instance on the hypervisor. {{(pid=74850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 01:31:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:31:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:31:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:31:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:31:27 user nova-compute[74850]: DEBUG nova.compute.manager [req-c8984d1a-8ae7-4dd0-a77f-4b70ece56745 req-b05be4a1-fe70-473c-9f66-dc38e282f796 service nova] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Received event network-vif-unplugged-a25e20ce-1b3d-4e5b-8f3b-5c146716a682 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:31:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c8984d1a-8ae7-4dd0-a77f-4b70ece56745 req-b05be4a1-fe70-473c-9f66-dc38e282f796 service nova] Acquiring lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:31:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c8984d1a-8ae7-4dd0-a77f-4b70ece56745 req-b05be4a1-fe70-473c-9f66-dc38e282f796 service nova] Lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:31:27 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-c8984d1a-8ae7-4dd0-a77f-4b70ece56745 req-b05be4a1-fe70-473c-9f66-dc38e282f796 service nova] Lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:31:27 user nova-compute[74850]: DEBUG nova.compute.manager [req-c8984d1a-8ae7-4dd0-a77f-4b70ece56745 req-b05be4a1-fe70-473c-9f66-dc38e282f796 service nova] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] No waiting events found dispatching network-vif-unplugged-a25e20ce-1b3d-4e5b-8f3b-5c146716a682 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:31:27 user nova-compute[74850]: DEBUG nova.compute.manager [req-c8984d1a-8ae7-4dd0-a77f-4b70ece56745 req-b05be4a1-fe70-473c-9f66-dc38e282f796 service nova] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Received event network-vif-unplugged-a25e20ce-1b3d-4e5b-8f3b-5c146716a682 for instance with task_state deleting. {{(pid=74850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 01:31:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:31:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:31:27 user nova-compute[74850]: INFO nova.virt.libvirt.driver [-] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Instance destroyed successfully.
Nov 14 01:31:27 user nova-compute[74850]: DEBUG nova.objects.instance [None req-a85ee10d-b00b-46f4-9f35-43309a94d8a0 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lazy-loading 'resources' on Instance uuid 87b33bb4-3f25-4897-82c3-cb774fb0bea2 {{(pid=74850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 01:31:27 user nova-compute[74850]: DEBUG nova.virt.libvirt.vif [None req-a85ee10d-b00b-46f4-9f35-43309a94d8a0 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T01:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-161944321',display_name='tempest-SnapshotDataIntegrityTests-server-161944321',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-161944321',id=53,image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIfcvNTD/fUHLa6TVlEjXmh15J/5EkBvriPQW1tNwh7kkj2gbJg6NXMWRT0iXpwSXgPT/p7jZh4csiJ35pOzUomNDvIg3iNUILfxQ8ef6XFVifgqJPtpc3iOfceM6cy0uw==',key_name='tempest-keypair-2111339531',keypairs=<?>,launch_index=0,launched_at=2023-11-14T01:25:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e517ca63f1964c6da6cad708365a13a7',ramdisk_id='',reservation_id='r-zontt3zb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ed46099-4abf-4916-8deb-e38edb515c26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1320156603',owner_user_name='tempest-SnapshotDataIntegrityTests-1320156603-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T01:25:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='616a68485eaa4b8a935a529065768663',uuid=87b33bb4-3f25-4897-82c3-cb774fb0bea2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a25e20ce-1b3d-4e5b-8f3b-5c146716a682", "address": "fa:16:3e:d8:a2:2b", "network": {"id": "943fc504-ca87-4ae7-85c0-7d167e59aa1b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1690202443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e517ca63f1964c6da6cad708365a13a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25e20ce-1b", "ovs_interfaceid": "a25e20ce-1b3d-4e5b-8f3b-5c146716a682", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 01:31:27 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-a85ee10d-b00b-46f4-9f35-43309a94d8a0 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Converting VIF {"id": "a25e20ce-1b3d-4e5b-8f3b-5c146716a682", "address": "fa:16:3e:d8:a2:2b", "network": {"id": "943fc504-ca87-4ae7-85c0-7d167e59aa1b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1690202443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e517ca63f1964c6da6cad708365a13a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25e20ce-1b", "ovs_interfaceid": "a25e20ce-1b3d-4e5b-8f3b-5c146716a682", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 01:31:27 user nova-compute[74850]: DEBUG nova.network.os_vif_util [None req-a85ee10d-b00b-46f4-9f35-43309a94d8a0 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:a2:2b,bridge_name='br-int',has_traffic_filtering=True,id=a25e20ce-1b3d-4e5b-8f3b-5c146716a682,network=Network(943fc504-ca87-4ae7-85c0-7d167e59aa1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa25e20ce-1b') {{(pid=74850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 01:31:27 user nova-compute[74850]: DEBUG os_vif [None req-a85ee10d-b00b-46f4-9f35-43309a94d8a0 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:a2:2b,bridge_name='br-int',has_traffic_filtering=True,id=a25e20ce-1b3d-4e5b-8f3b-5c146716a682,network=Network(943fc504-ca87-4ae7-85c0-7d167e59aa1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa25e20ce-1b') {{(pid=74850) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 01:31:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:31:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa25e20ce-1b, bridge=br-int, if_exists=True) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:31:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:31:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:31:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:31:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fb7bd9d0-56e0-4ba5-81c3-6ebf0520ac86) {{(pid=74850) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 01:31:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:31:27 user nova-compute[74850]: INFO os_vif [None req-a85ee10d-b00b-46f4-9f35-43309a94d8a0 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:a2:2b,bridge_name='br-int',has_traffic_filtering=True,id=a25e20ce-1b3d-4e5b-8f3b-5c146716a682,network=Network(943fc504-ca87-4ae7-85c0-7d167e59aa1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa25e20ce-1b')
Nov 14 01:31:27 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-a85ee10d-b00b-46f4-9f35-43309a94d8a0 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Deleting instance files /opt/stack/data/nova/instances/87b33bb4-3f25-4897-82c3-cb774fb0bea2_del
Nov 14 01:31:27 user nova-compute[74850]: INFO nova.virt.libvirt.driver [None req-a85ee10d-b00b-46f4-9f35-43309a94d8a0 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Deletion of /opt/stack/data/nova/instances/87b33bb4-3f25-4897-82c3-cb774fb0bea2_del complete
Nov 14 01:31:27 user nova-compute[74850]: INFO nova.compute.manager [None req-a85ee10d-b00b-46f4-9f35-43309a94d8a0 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 01:31:27 user nova-compute[74850]: DEBUG oslo.service.loopingcall [None req-a85ee10d-b00b-46f4-9f35-43309a94d8a0 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74850) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 01:31:27 user nova-compute[74850]: DEBUG nova.compute.manager [-] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Deallocating network for instance {{(pid=74850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 01:31:27 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] deallocate_for_instance() {{(pid=74850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 01:31:28 user nova-compute[74850]: DEBUG nova.network.neutron [-] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Updating instance_info_cache with network_info: [] {{(pid=74850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 01:31:28 user nova-compute[74850]: INFO nova.compute.manager [-] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Took 0.76 seconds to deallocate network for instance.
Nov 14 01:31:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a85ee10d-b00b-46f4-9f35-43309a94d8a0 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:31:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a85ee10d-b00b-46f4-9f35-43309a94d8a0 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:31:28 user nova-compute[74850]: DEBUG nova.compute.manager [req-90e0cbb0-7eb4-445c-9f3b-c25560d148ea req-383c6f3f-dba5-4346-a5ae-a98226a44936 service nova] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Received event network-vif-deleted-a25e20ce-1b3d-4e5b-8f3b-5c146716a682 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:31:28 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-a85ee10d-b00b-46f4-9f35-43309a94d8a0 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:31:28 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-a85ee10d-b00b-46f4-9f35-43309a94d8a0 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:31:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a85ee10d-b00b-46f4-9f35-43309a94d8a0 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.115s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:31:28 user nova-compute[74850]: INFO nova.scheduler.client.report [None req-a85ee10d-b00b-46f4-9f35-43309a94d8a0 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Deleted allocations for instance 87b33bb4-3f25-4897-82c3-cb774fb0bea2
Nov 14 01:31:28 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-a85ee10d-b00b-46f4-9f35-43309a94d8a0 tempest-SnapshotDataIntegrityTests-1320156603 tempest-SnapshotDataIntegrityTests-1320156603-project-member] Lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.922s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:31:29 user nova-compute[74850]: DEBUG nova.compute.manager [req-ed074444-88d0-4f0e-9f72-603a9d9aae20 req-5a0e0ba5-d688-449b-ba1e-bf1dfb67027a service nova] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Received event network-vif-plugged-a25e20ce-1b3d-4e5b-8f3b-5c146716a682 {{(pid=74850) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 01:31:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ed074444-88d0-4f0e-9f72-603a9d9aae20 req-5a0e0ba5-d688-449b-ba1e-bf1dfb67027a service nova] Acquiring lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:31:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ed074444-88d0-4f0e-9f72-603a9d9aae20 req-5a0e0ba5-d688-449b-ba1e-bf1dfb67027a service nova] Lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:31:29 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [req-ed074444-88d0-4f0e-9f72-603a9d9aae20 req-5a0e0ba5-d688-449b-ba1e-bf1dfb67027a service nova] Lock "87b33bb4-3f25-4897-82c3-cb774fb0bea2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:31:29 user nova-compute[74850]: DEBUG nova.compute.manager [req-ed074444-88d0-4f0e-9f72-603a9d9aae20 req-5a0e0ba5-d688-449b-ba1e-bf1dfb67027a service nova] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] No waiting events found dispatching network-vif-plugged-a25e20ce-1b3d-4e5b-8f3b-5c146716a682 {{(pid=74850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 01:31:29 user nova-compute[74850]: WARNING nova.compute.manager [req-ed074444-88d0-4f0e-9f72-603a9d9aae20 req-5a0e0ba5-d688-449b-ba1e-bf1dfb67027a service nova] [instance: 87b33bb4-3f25-4897-82c3-cb774fb0bea2] Received unexpected event network-vif-plugged-a25e20ce-1b3d-4e5b-8f3b-5c146716a682 for instance with vm_state deleted and task_state None.
Nov 14 01:31:30 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:31:30 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:31:30 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 01:31:30 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Rebuilding the list of instances to heal {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 01:31:30 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Didn't find any instances for network info cache update. {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 01:31:30 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:31:31 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:31:31 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:31:31 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74850) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 01:31:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:31:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:31:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:31:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74850) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 01:31:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:31:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:31:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:31:37 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:31:39 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:31:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:31:45 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:31:46 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:31:46 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Cleaning up deleted instances {{(pid=74850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 01:31:46 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] There are 0 instances to clean {{(pid=74850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 01:31:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:31:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:31:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74850) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 01:31:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:31:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:31:47 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:31:52 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:31:57 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:32:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:32:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:32:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74850) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 01:32:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:32:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74850) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 01:32:02 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:32:07 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:32:12 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:32:17 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:32:18 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:32:18 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:32:19 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:32:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:32:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:32:19 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:32:19 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 01:32:20 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:32:20 user nova-compute[74850]: WARNING nova.virt.libvirt.driver [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 01:32:20 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Hypervisor/Node resource view: name=user free_ram=9163MB free_disk=24.993804931640625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 01:32:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 01:32:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 01:32:20 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 01:32:20 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 01:32:20 user nova-compute[74850]: DEBUG nova.compute.provider_tree [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed in ProviderTree for provider: fe703abb-f68c-420d-a7f0-bf5240e23c54 {{(pid=74850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 01:32:20 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:32:20 user nova-compute[74850]: DEBUG nova.scheduler.client.report [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Inventory has not changed for provider fe703abb-f68c-420d-a7f0-bf5240e23c54 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 01:32:20 user nova-compute[74850]: DEBUG nova.compute.resource_tracker [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Compute_service record updated for user:user {{(pid=74850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 01:32:20 user nova-compute[74850]: DEBUG oslo_concurrency.lockutils [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.230s {{(pid=74850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 01:32:22 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:32:22 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:32:24 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:32:25 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:32:25 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 01:32:27 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:32:28 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:32:31 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:32:32 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 01:32:32 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:32:32 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Starting heal instance info cache {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 01:32:32 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Rebuilding the list of instances to heal {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 01:32:32 user nova-compute[74850]: DEBUG nova.compute.manager [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Didn't find any instances for network info cache update. {{(pid=74850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 01:32:32 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:32:33 user nova-compute[74850]: DEBUG oslo_service.periodic_task [None req-4500e840-ac7e-4795-800a-91eb856059f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 01:32:37 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 01:32:42 user nova-compute[74850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74850) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}